arXiv Weekly Digest — Week 25, 2026

Fetched: 2026-06-15 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 85

Mana: Dexterous Manipulation of Articulated Tools

Authors: Zhao-Heng Yin, Guanya Shi, Pieter Abbeel et al. | Submitted: 2026-06-11 | arXiv: 2606.13677 Categories: cs.RO, cs.AI, cs.CV, cs.LG

Research Background: Articulated tool manipulation — controlling objects with internal joints — remains one of the hardest challenges in dexterous robotics because the robot must simultaneously manage the tool’s own degrees of freedom and contact-rich interactions. Prior work mostly addressed rigid objects, leaving articulated tools underexplored. 研究背景： 具有內部關節的鉸接式工具操作，是靈巧機器人學中最艱難的挑戰之一，機器人必須同時管理工具本身的自由度與豐富的接觸互動。先前的研究多聚焦於剛性物體，對鉸接工具的探索仍然不足。

Technical Approach: Mana (Manipulation Animator) reframes dexterous manipulation as a computer animation problem, using a coarse-to-fine pipeline that converts procedurally generated grasp keyframes into full manipulation trajectories via motion planning and reinforcement learning. Data generation is largely automated, requiring only a few mouse clicks to define functional affordances in under a minute per tool. 技術方法： Mana 將靈巧操作重新定義為電腦動畫問題，採用由粗到細的流程，透過運動規劃與強化學習將程序生成的抓取關鍵幀轉換為完整的操作軌跡。資料生成高度自動化，每件工具只需點擊幾下滑鼠、不到一分鐘即可完成。

Key Takeaway: Mana achieves zero-shot sim-to-real transfer across four articulated tools of different scales and joint types, demonstrating a scalable path to dexterous articulated tool use. 核心發現： Mana 在四種不同尺度與關節類型的鉸接工具上實現了零樣本模擬到現實的遷移，展示了靈巧鉸接工具使用的可擴展路徑。

Improving Robotic Generalist Policies via Flow Reversal Steering

Authors: Andy Tang, William Chen, Andrew Wagenmaker et al. | Submitted: 2026-06-11 | arXiv: 2606.13675 Categories: cs.RO

Research Background: Generalist robot policies trained on diverse datasets have rich behavioral priors, but directly commanding them often fails on challenging new tasks. A method is needed to extract and invoke appropriate behaviors from within these priors without retraining the policy. 研究背景： 在多樣化資料集上訓練的通用機器人策略擁有豐富的行為先驗，但直接對其下指令往往在困難的新任務上失敗。需要一種方法能從這些先驗中提取並呼叫適當的行為，而無需重新訓練。

Technical Approach: Flow Reversal Steering (FRS) takes suboptimal but reasonable actions, inverts them through the flow-matching policy to recover latent noise representations, then maps them to nearby high-quality action modes in the generalist’s learned distribution. These steered trajectories can be distilled via behavioral cloning into an auxiliary policy, and FRS can also bootstrap reinforcement learning with semantic knowledge. 技術方法： 流程反轉引導（FRS）接收次優但合理的動作，透過流匹配策略進行反轉以恢復潛在雜訊表徵，再將其映射至通用策略學習分布中鄰近的高品質動作模式。引導後的軌跡可透過行為複製蒸餾至輔助策略，FRS 也能以語義知識引導強化學習。

Key Takeaway: FRS enables coarse human or VLM guidance to be transformed into precise robot actions, achieving up to 95% absolute task success rate improvements in under one minute of additional training. 核心發現： FRS 能將粗略的人類或視覺語言模型指引轉換為精確的機器人動作，在不到一分鐘的額外訓練內提升最多 95% 的絕對任務成功率。

WEAVER, Better, Faster, Longer: An Effective World Model for Robotic Manipulation

Authors: Arnav Kumar Jain, Yilin Wu, Jesse Farebrother et al. | Submitted: 2026-06-11 | arXiv: 2606.13672 Categories: cs.RO

Research Background: World models — learned simulators of robot environments — are promising for policy evaluation, improvement, and planning, but prior approaches struggle to jointly achieve high fidelity, long-horizon consistency, and fast inference. These three properties are all necessary to unlock real-world utility. 研究背景： 世界模型（環境的學習型模擬器）在策略評估、改進與規劃方面很有潛力，但先前的方法難以同時實現高保真度、長程一致性與快速推理，而這三者對於現實應用都不可或缺。

Technical Approach: WEAVER is a multi-view world model trained to predict future latent states and reward values using a flow-matching loss. Key design decisions span model architecture, memory management, and prediction objectives to jointly satisfy fidelity, consistency, and efficiency. The model is applied directly on real robot hardware for policy evaluation, improvement, and test-time planning. 技術方法： WEAVER 是一種多視角世界模型，使用流匹配損失訓練以預測未來潛在狀態與獎勵值。關鍵設計決策涵蓋模型架構、記憶體管理與預測目標，以同時滿足保真度、一致性與效率需求。該模型直接應用於真實機器人硬體，用於策略評估、改進與測試時規劃。

Key Takeaway: WEAVER achieves 0.870 correlation with real-world success rate, a 38% policy improvement over the pi0.5 foundation model, and 14% test-time planning gain with 5-10x speedup over prior world models. 核心發現： WEAVER 與真實世界成功率的相關係數達 0.870，在 pi0.5 基礎模型基礎上提升 38% 策略表現，並以比先前世界模型快 5-10 倍的速度實現 14% 的測試時規劃提升。

MCR-Bionic Hand: Anatomical Structural Priors for Dexterous Manipulation

Authors: Haosen Yang, Guowu Wei | Submitted: 2026-06-11 | arXiv: 2606.13601 Categories: cs.RO, eess.SY

Research Background: Human hand dexterity arises not just from neural control but from the physical architecture of bones, tendons, ligaments, and muscles that encode structural intelligence. Robotic hands that ignore this biomechanical structure require more complex active control to achieve comparable dexterity. 研究背景： 人類手部的靈巧性不僅來自神經控制，更來自骨骼、肌腱、韌帶與肌肉的物理結構，這些結構本身就編碼了結構性智能。忽略此生物力學結構的機器人手需要更複雜的主動控制才能達到相當的靈活性。

Technical Approach: The MCR-Bionic Hand is a 1:1 musculoskeletal biomimetic hand integrating a two-row eight-bone wrist, cross-wrist tendons, anatomical flexor routing, ligament constraints, dorsal extensor hood, and intrinsic muscle pathways. Two linked structural mechanisms — tenodesis-based prior generation and muscle-mediated modulation — transform low-dimensional inputs into default grasps and fine post-contact adjustments. 技術方法： MCR 仿生手是一款 1:1 肌肉骨骼仿生手，整合了雙排八骨腕關節、跨腕肌腱、解剖式屈肌佈線、韌帶約束、背側伸肌罩及內在肌通路。兩個相連的結構機制（基於腱效應的先驗生成與肌肉調節）可將低維度輸入轉換為預設抓取姿態及精細的接觸後調整。

Key Takeaway: Anatomical biomimetics provides dexterous manipulation capability not through visual similarity to human hands, but by transferring the structural control intelligence embedded in human hand anatomy. 核心發現： 解剖仿生學提供了靈巧操作能力，其價值不在於外觀上與人手相似，而在於移植了人類手部解剖結構中蘊含的結構性控制智能。

LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories

Authors: Baochang Ren, Xinjie Liu, Xi Chen et al. | Submitted: 2026-06-11 | arXiv: 2606.13578 Categories: cs.CL, cs.AI, cs.LG, cs.MM, cs.RO

Research Background: AI can help plan scientific experiments, but physically executing lab protocols still requires human operators. Existing VLA models are trained mainly on household tasks and lack exposure to lab instruments, transparent liquids, and fixed protocol workflows, creating a critical gap for laboratory automation. 研究背景： AI 能協助規劃科學實驗，但實際執行實驗室操作流程仍需人工介入。現有的 VLA 模型主要在家用任務上訓練，缺乏對實驗室儀器、透明液體和固定流程的接觸，造成實驗室自動化的關鍵缺口。

Technical Approach: LabVLA is trained with a two-stage recipe: FAST action token pretraining first makes a Qwen3-VL-4B-Instruct backbone action-aware before any continuous control is learned, and flow matching posttraining then attaches a DiT action expert under knowledge insulation. A companion simulation engine, RoboGenesis, composes lab workflows from atomic skills and generates structured demonstrations across diverse robot profiles. 技術方法： LabVLA 採用兩階段訓練方案：首先以 FAST 動作標記預訓練使 Qwen3-VL-4B-Instruct 骨幹具備動作感知能力，再以流匹配後訓練在知識隔離下附加 DiT 動作專家。配套的模擬引擎 RoboGenesis 從原子技能組合實驗室工作流程，並生成跨多種機器人配置的結構化示範。

Key Takeaway: LabVLA achieves the highest average success rate on the LabUtopia benchmark under both in-distribution and out-of-distribution settings, advancing the feasibility of VLA-driven scientific lab robotics. 核心發現： LabVLA 在 LabUtopia 基準測試中於分布內與分布外設定下均達到最高平均成功率，推進了 VLA 驅動的科學實驗室機器人的可行性。

MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models

Authors: Hanyang Yu, Haitao Lin, Jingbo Zhang et al. | Submitted: 2026-06-11 | arXiv: 2606.13515 Categories: cs.CV, cs.LG, cs.RO

Research Background: World Action Models (WAMs) use video prediction for robotic control, but standard text inputs create referential ambiguity in cluttered scenes, while unstructured RGB predictions lack semantic grounding and are biased by irrelevant backgrounds. These spatial bottlenecks limit policy generalization. 研究背景： 世界動作模型（WAMs）透過視頻預測實現機器人控制，但標準文字輸入在雜亂場景中會造成指稱模糊，而非結構化的 RGB 預測缺乏語義錨定且受無關背景干擾，這些空間瓶頸限制了策略的泛化能力。

Technical Approach: MaskWAM is an object-centric WAM that jointly integrates segmentation masks as both explicit inputs and predictions via a unified Mixture of Transformers (MoT). Predicting future object masks provides semantic supervision that suppresses visual noise, while first-frame mask prompts provide precise spatial anchors that resolve language ambiguity. 技術方法： MaskWAM 是一種以物件為中心的 WAM，透過統一的 Transformer 混合（MoT）將分割遮罩同時作為顯式輸入與預測目標整合。預測未來物件遮罩提供語義監督以抑制視覺噪音，而第一幀遮罩提示則提供精確的空間錨點以消除語言歧義。

Key Takeaway: MaskWAM significantly outperforms baselines on LIBERO, RoboTwin, and real-world tasks for both language-clear and language-ambiguous manipulation settings. 核心發現： MaskWAM 在 LIBERO、RoboTwin 及真實任務上，在語言清晰和語言模糊的操作設定下均顯著優於基準方法。

SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale

Authors: Nils Blank, Paul Mattes, Maximilian Xiling Li et al. | Submitted: 2026-06-11 | arXiv: 2606.13497 Categories: cs.RO, cs.CV

Research Background: Structured spatial annotations such as bounding boxes and object trajectories benefit many robotics applications, but automated annotation pipelines provide no reliable quality signal — detector confidence is poorly calibrated, forcing a tradeoff between accepting noisy labels and discarding useful data. 研究背景： 邊界框和物件軌跡等結構化空間標注對許多機器人應用有益，但自動化標注流程缺乏可靠的品質信號——偵測器置信度校準不佳，迫使系統在接受噪音標注與捨棄有用資料之間做出取捨。

Technical Approach: SPARC leverages the spatio-temporal structure inherent in robot tasks to generate a reliability score alongside each annotation. A companion benchmark, IA-Bench, measures model accuracy in grounding the locations of interacted objects across 1.7k human-annotated demonstrations spanning diverse embodiments. 技術方法： SPARC 利用機器人任務固有的時空結構為每個標注生成可靠性分數。配套基準 IA-Bench 在涵蓋多種機器人形態的 1,700 個人工標注示範中衡量模型在定位互動物件上的準確性。

Key Takeaway: SPARC significantly outperforms detection-only baselines in localization accuracy while retaining three times more high-precision samples, and policies trained on SPARC annotations outperform baselines in cluttered real-world scenes. 核心發現： SPARC 在定位準確性上顯著優於僅靠偵測的基準方法，同時保留三倍以上的高精度樣本，且以 SPARC 標注訓練的策略在雜亂的現實場景中優於基準方法。

Authors: Daichi Azuma, Taiki Miyanishi, Koya Sakamoto et al. | Submitted: 2026-06-11 | arXiv: 2606.13494 Categories: cs.RO, cs.CV

Research Background: Goal-conditioned visual navigation requires robots to anticipate how their motion will change future views and whether those changes bring them closer to the goal. Existing navigation world models remain separate prediction modules that require an external planner to convert predictions into closed-loop control. 研究背景： 目標條件式視覺導航要求機器人預測自身運動如何改變未來的視野，以及這些變化是否能使其更接近目標。現有的導航世界模型仍是獨立的預測模組，需要外部規劃器將預測轉換為閉環控制。

Technical Approach: NavWAM is a diffusion-transformer policy that unifies future observation prediction, goal-progress value estimation, and action chunk generation within a single shared latent sequence. Trained through simulation pretraining and real-robot adaptation, it converts visual foresight directly into executable robot actions without requiring separate planning steps. 技術方法： NavWAM 是一種擴散 Transformer 策略，在單一共享潛在序列中統一未來觀測預測、目標進度價值估計與動作塊生成。透過模擬預訓練與真實機器人適應訓練，它直接將視覺預見轉換為可執行的機器人動作，無需額外規劃步驟。

Key Takeaway: NavWAM improves over planning-based world-model baselines in offline benchmarks and closed-loop real-robot deployment, operating in default policy mode without costly action search. 核心發現： NavWAM 在離線基準測試與閉環真實機器人部署中均優於基於規劃的世界模型基準，且在預設策略模式下無需昂貴的動作搜尋程序。

GIVE: Grounding Human Gestures in Vision-Language-Action Models

Authors: Pengfei Liu, Gen Li, Junqiao Fan et al. | Submitted: 2026-06-11 | arXiv: 2606.13435 Categories: cs.RO

Research Background: Human communication is inherently multimodal — gestures accompany language to convey intent. Current VLA models treat manipulation as a purely text-driven task, ignoring gestures, which leads to inaccurate intent grounding when language instructions are ambiguous in HRI settings. 研究背景： 人類溝通本質上是多模態的——手勢伴隨語言傳達意圖。當前的 VLA 模型將操作視為純粹由文字驅動的任務，忽略了手勢，這在人機互動場景中語言指令模糊時，會導致意圖錨定不準確。

Technical Approach: GIVE (Gesture Intent via Visual-Semantic Enhancement) enhances pre-trained VLA models with gesture understanding through two complementary pathways: a visual pathway that overlays hand skeletons and fingertip rays onto robot observations for explicit object grounding, and a semantic pathway that generates high-level descriptions of gestures and task instructions for intent grounding. No architectural modifications to the base VLA are required. 技術方法： GIVE 透過兩條互補路徑增強預訓練 VLA 模型的手勢理解：視覺路徑將手部骨架與指尖射線疊加至機器人觀測上以明確定位物件；語義路徑生成手勢與任務指令的高階描述以錨定意圖。無需修改基礎 VLA 的架構。

Key Takeaway: GIVE improves target object recognition accuracy by 40% and overall task success rate by 80% in real-world HRI experiments, with strong robustness to unseen spatial layouts and diverse participants. 核心發現： GIVE 在真實世界人機互動實驗中將目標物體識別準確率提升 40%、整體任務成功率提升 80%，且對未見過的空間佈局和不同參與者均具有強大的魯棒性。

GeoHAT: Geometry-Adaptive Hybrid Action Transformer for Mobile Manipulation

Authors: Xiangyu Zhu, Renjun Wu, Luzhou Ge et al. | Submitted: 2026-06-11 | arXiv: 2606.13394 Categories: cs.RO

Research Background: Whole-body mobile manipulation requires coordinating a mobile base and manipulator under shifting viewpoints, demanding geometric perception and differentiated action generation. Current policies relying on 2D or sparse 3D representations fail to capture dense spatial structure and often conflate arm and base control. 研究背景： 全身移動操作需要在視角不斷變化下協調移動底座與機械臂，要求幾何感知以及差異化的動作生成。依賴 2D 或稀疏 3D 表徵的當前策略無法捕捉密集的空間結構，且往往混淆手臂與底座的控制。

Technical Approach: GeoHAT uses a lightweight Fourier spatial encoder that maps per-pixel 3D coordinates into geometric tokens, injected into vision foundation model features via per-token gated fusion conditioned on depth validity. A Hybrid Whole-Body Action Decoder decomposes arm and base into distinct subspaces with separate cross-attention pathways, while causal temporal modeling captures inter-timestep coordination. 技術方法： GeoHAT 使用輕量級傅立葉空間編碼器將每像素 3D 座標映射為幾何標記，再透過以深度有效性為條件的逐標記門控融合注入視覺基礎模型特徵。混合全身動作解碼器將手臂與底座分解為各自的子空間，配備獨立的交叉注意力路徑，而因果時序建模捕捉跨時間步的協調關係。

Key Takeaway: GeoHAT achieves a 79.3% mean success rate on the ManiSkill-HAB benchmark, surpassing the strongest baseline by 23.7%, with consistent real-world improvements across diverse tasks. 核心發現： GeoHAT 在 ManiSkill-HAB 基準測試上達到 79.3% 的平均成功率，比最強基準高出 23.7%，並在多樣化的真實世界任務中持續提升表現。

Real-Time Execution with Autoregressive Policies

Authors: Sangkyu Lee, Seohyeon Park, Tackgeun You et al. | Submitted: 2026-06-11 | arXiv: 2606.13355 Categories: cs.RO, cs.AI

Research Background: Real-time robot execution requires both smooth action trajectories and fast reactivity. While most real-time execution research focuses on diffusion policies, autoregressive VLA policies have slower rollout speeds and arguably need real-time execution support more urgently. 研究背景： 機器人的即時執行需要平滑的動作軌跡與快速反應能力。雖然大多數即時執行研究針對擴散策略，但 VLA 的自回歸策略推理速度較慢，實際上更迫切需要即時執行支援。

Technical Approach: The method adjusts the tokenization horizon and applies constrained decoding to guarantee strict latency bounds, enabling multi-trajectory decoding to maximize task performance within the latency budget. This makes autoregressive policies capable of true real-time execution without specialized hardware. 技術方法： 該方法調整標記化時域並應用受限解碼以保證嚴格的延遲上限，從而在延遲預算內實現多軌跡解碼以最大化任務表現。這使自回歸策略能夠在不需要特殊硬體的情況下實現真正的即時執行。

Key Takeaway: Autoregressive policies with these modifications consistently outperform equivalent flow-matching policies while achieving significantly faster task completion speeds, confirming their competitiveness for real-time robot control. 核心發現： 配備這些改進的自回歸策略在持續優於等效流匹配策略的同時，任務完成速度也顯著加快，確立了其作為即時機器人控制的競爭力方法。

See Selectively, Act Adaptively: Dual-Level Structural Decomposition for Bimanual Robot Manipulation

Authors: Yoon-Ji Choi, Young-Chae Son, Soo-Chul Lim | Submitted: 2026-06-11 | arXiv: 2606.13279 Categories: cs.RO

Research Background: Bimanual manipulation policies must handle visual inputs that vary in relevance across task stages and coordinate two arms shifting between independent and synchronized modes. Monolithic VLA policies with a single shared representation cannot adequately account for these two distinct structural challenges simultaneously. 研究背景： 雙臂操作策略必須處理隨任務階段而變化相關性的視覺輸入，並協調在獨立與協同模式之間切換的兩隻手臂。具有單一共享表徵的整體 VLA 策略無法同時充分應對這兩個截然不同的結構性挑戰。

Technical Approach: The framework applies Dual-Level Structural Decomposition: a View-Selective Visual Router dynamically adjusts the contribution of each wrist-view camera to emphasize relevant visual cues, while an Interaction-Aware Action Mixture-of-Experts (MoE) decomposes action generation into coordinated and arm-wise pathways to adapt to varying bimanual interaction modes. 技術方法： 框架應用雙層結構分解：視角選擇式視覺路由器動態調整每個腕部視角攝影機的貢獻以強調相關視覺線索，而互動感知動作混合專家（MoE）將動作生成分解為協調式與逐臂式路徑，以適應不同的雙臂互動模式。

Key Takeaway: The framework improves average success rate by 27.7% in simulation and 43.3% in real-world evaluation over a monolithic baseline, confirming joint visual selectivity and bimanual decomposition as effective inductive biases. 核心發現： 該框架在模擬中提升整體平均成功率 27.7%，在真實世界評估中提升 43.3%，確認了聯合視覺選擇性與雙臂分解作為有效歸納偏置的價值。

WT-UMI: Tactile-based Whole-Body Manipulation via Force-Supervised Contact-Aware Planning

Authors: Jaehwi Jang, Zhaoyuan Gu, Alfred Cueva et al. | Submitted: 2026-06-11 | arXiv: 2606.13232 Categories: cs.RO

Research Background: Whole-body humanoid manipulation of deformable and shared-load objects requires distributed contact sensing and explicit force regulation, yet most imitation learning policies treat contact forces only implicitly. Human demonstrations capture natural forces but not robot actions, while teleoperation captures actions but with less natural force regulation. 研究背景： 人形機器人對可變形和共擔負載物體的全身操作需要分布式接觸感測和明確的力調節，但大多數模仿學習策略僅隱式處理接觸力。人類示範能捕捉自然力但非機器人動作，而遙操作能捕捉動作但力調節較不自然。

Technical Approach: WT-UMI is a wearable whole-body tactile interface providing tactile images, contact forces, and end-effector poses in both human demonstration and humanoid teleoperation modes. A force-conditioned target-pose correction module converts human poses into contact-aware robot targets, and a force-supervised planner predicts pose chunks and contact-force trajectories that drive a tactile-based admittance controller. 技術方法： WT-UMI 是一種可穿戴的全身觸覺介面，在人類示範和人形機器人遙操作模式下均提供觸覺圖像、接觸力和末端執行器姿態。力條件目標姿態校正模組將人類姿態轉換為接觸感知的機器人目標，而力監督規劃器預測姿態塊和接觸力軌跡以驅動基於觸覺的導納控制器。

Key Takeaway: Across five contact-rich tasks spanning deformable objects, bulky rigid objects, and human-humanoid collaboration, WT-UMI improves success rate and reduces contact-position tracking error over four policy baselines. 核心發現： 在涵蓋可變形物體、大型剛性物體和人機協作的五個富接觸任務中，WT-UMI 在四個策略基準上均提升了成功率並降低了接觸位置追蹤誤差。

Embedding ISO 10218 Safety Compliance in Robots via Control Barrier Functions for Human-Robot Collaboration

Authors: Federico Parma, Cesare Tonola, Nicola Pedrocchi et al. | Submitted: 2026-06-11 | arXiv: 2606.13203 Categories: cs.RO

Research Background: Human-robot collaboration requires strict adherence to safety standards like ISO 10218. Standard Speed and Separation Monitoring relies on conservative constant-velocity assumptions, causing overly cautious speed limits and unnecessary operational halts that hurt productivity. 研究背景： 人機協作要求嚴格遵守 ISO 10218 等安全標準。標準速度與分離監控依賴保守的恆速假設，導致過度謹慎的速度限制和不必要的操作停頓，影響生產效率。

Technical Approach: A Control Barrier Function incorporating human acceleration data analytically predicts the minimum human-robot separation distance during worst-case stopping trajectories. Two methods are proposed: a CBF-constrained PD safety filter (Method I) and a task-scaling SQP controller enforcing a spatial tube constraint (Method II), both integrated as inequality constraints within a Sequential Quadratic Programming framework. 技術方法： 包含人體加速度資料的控制屏障函數分析性地預測機器人最壞情況停止軌跡期間的最小人機分離距離。提出兩種方法：CBF 約束 PD 安全過濾器（方法一）和執行空間管道約束的任務縮放 SQP 控制器（方法二），均作為不等式約束整合在循序二次規劃框架中。

Key Takeaway: Method II achieves 63% reduction in mean trajectory error compared to Method I and avoids excessive evasive maneuvers, maintaining high task throughput while complying with ISO 10218 on a UR10e robot. 核心發現： 方法二相比方法一將平均軌跡誤差降低 63% 並避免過度迴避機動，在 UR10e 機器人上符合 ISO 10218 的同時維持高任務吞吐量。

FTP-1: A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation

Authors: Chengbo Yuan, Zicheng Zhang, Mingjie Zhou et al. | Submitted: 2026-06-11 | arXiv: 2606.13102 Categories: cs.RO

Research Background: Tactile-based robot policies remain tied to fixed sensor setups because tactile signals are highly heterogeneous across hardware, making cross-sensor generalization extremely difficult. Unlike vision-based generalist policies, no foundation model for tactile manipulation has previously existed. 研究背景： 基於觸覺的機器人策略因觸覺信號在不同硬體間高度異質而受限於固定的感測器配置，使跨感測器泛化極為困難。與視覺基礎模型不同，觸覺操作領域此前尚無基礎模型。

Technical Approach: FTP-1 uses heterogeneous encoders to project diverse tactile inputs (image-based, array-based, state-based) into unified morphology-aware latent tokens jointly modeled by a shared tactile Transformer expert. Pretrained on approximately 3,000 hours of data from 26 sources spanning 21 sensors and multiple embodiments, it learns transferable tactile skills that generalize beyond sensors seen during pretraining. 技術方法： FTP-1 使用異質編碼器將多種觸覺輸入（圖像式、陣列式、狀態式）投影為統一的形態感知潛在標記，由共享觸覺 Transformer 專家聯合建模。在來自 26 個資料來源、涵蓋 21 種感測器的約 3,000 小時資料上預訓練，學習可遷移的觸覺技能以泛化至預訓練外的感測器。

Key Takeaway: FTP-1 improves contact-rich manipulation by +17.2% on seen sensor setups and achieves +31% success rate gain on two previously unseen tactile-sensor setups, establishing the first unified foundation baseline for tactile manipulation. 核心發現： FTP-1 在已見過的感測器配置上提升接觸豐富操作 17.2%，並在兩個未曾見過的觸覺感測器配置上實現 31% 的成功率提升，確立了觸覺操作的第一個統一基礎模型基準。

EA-WM: Event-Aware World Models with Task-Specification Grounding for Long-Horizon Manipulation

Authors: Kailin Wang, Haoxiang Jie, Yaoyuan Yan et al. | Submitted: 2026-06-11 | arXiv: 2606.13053 Categories: cs.RO, cs.AI

Research Background: World models for robot planning predict future visual or latent states, but visual prediction alone cannot determine whether an imagined future satisfies task-relevant events such as object displacement or placement predicates. Long-horizon manipulation needs physically grounded relational progress signals. 研究背景： 機器人規劃的世界模型預測未來視覺或潛在狀態，但單純的視覺預測無法判斷想像的未來是否滿足與任務相關的事件，例如物體位移或放置謂詞。長程操作需要物理錨定的關係性進度信號。

Technical Approach: EA-WM augments frozen visual-feature dynamics with task-specification-grounded event prediction and verification. Candidate futures are rolled out in pretrained visual-feature space, decoded into structured event states, and scored using task-progress, semantic-consistency, physical-feasibility, and uncertainty terms to guide sampling-based planning. 技術方法： EA-WM 以任務規格錨定的事件預測與驗證來擴增凍結的視覺特徵動態。候選未來在預訓練視覺特徵空間中展開，解碼為結構化事件狀態，並使用任務進度、語義一致性、物理可行性和不確定性項目評分，以引導基於採樣的規劃。

Key Takeaway: Event-aware verification makes feature-space world models more interpretable and better aligned with task progress across navigation, deformable-object, and language-described manipulation tasks. 核心發現： 事件感知驗證使特徵空間世界模型在導航、可變形物體和語言描述的操作任務中更具可解釋性且與任務進度更好地對齊。

RoboProcessBench: Benchmarking Process-Aware Understanding in Vision-Language Robotic Manipulation

Authors: Dayu Xia, Yue Shi, Yao Mu et al. | Submitted: 2026-06-11 | arXiv: 2606.13040 Categories: cs.RO

Research Background: VLMs are increasingly used as visual critics, reward generators, and failure detectors for robotic manipulation, which requires understanding not just final outcomes but how manipulation is physically and temporally progressing. Yet no benchmark specifically tests this fine-grained process understanding. 研究背景： VLMs 越來越多地被用作機器人操作的視覺評判者、獎勵生成器和失敗偵測器，這不僅需要判斷最終結果，還需理解操作在物理和時序上的進展過程，但目前尚無基準測試這種精細的過程理解能力。

Technical Approach: RoboProcessBench decomposes process understanding into static monitoring and dynamic reasoning, instantiated as 12 diagnostic question families. The benchmark corpus ProcessData contains approximately 58k question-answer pairs across 260 manipulation tasks, split into ProcessData-SFT for fine-tuning and ProcessData-Eval for evaluation. 技術方法： RoboProcessBench 將過程理解分解為靜態監控與動態推理，實例化為 12 個診斷問題類別。基準語料庫 ProcessData 包含 260 個操作任務的約 58,000 個問答對，分為用於微調的 ProcessData-SFT 和用於評估的 ProcessData-Eval。

Key Takeaway: Current VLMs show broad limitations across all 12 diagnostic task families, but post-training with ProcessData-SFT yields consistent gains in process understanding, confirming the benchmark as both an evaluation tool and training resource. 核心發現： 當前 VLMs 在所有 12 個診斷任務類別中均表現出廣泛的侷限性，但使用 ProcessData-SFT 進行後訓練可帶來一致的過程理解提升，確認該基準同時作為評估工具和訓練資源的價值。

GenHOI: Contact-Aware Humanoid-Object Interaction by Imitating Generated Videos without Task-Specific Training

Authors: Zhihai Bi, Qiang Zhang, Guoyang Zhao et al. | Submitted: 2026-06-11 | arXiv: 2606.12995 Categories: cs.RO

Research Background: Humanoid-object interaction (HOI) is fundamental for humanoid robots but challenging due to the tight coupling of dynamic balance and stable interaction with diverse objects. Existing methods require task-specific policy training or rigid trajectory replay, limiting their ability to handle novel interaction scenarios. 研究背景： 人形物體互動（HOI）對人形機器人至關重要，但由於動態平衡與多樣化物體穩定互動之間的緊密耦合而極具挑戰性。現有方法需要特定任務的策略訓練或固定軌跡回放，限制了其處理新型互動場景的能力。

Technical Approach: GenHOI enables zero-shot HOI by imitating a single generated video, without task-specific training or physical demonstration data. The framework reconstructs the robot-object scene, conditions a video generator on a first-frame image and language command, identifies contact events in the generated video, and converts these into geometric constraints guiding motion optimization and refinement for closed-loop tracking. 技術方法： GenHOI 透過模仿單一生成的視頻實現零樣本 HOI，無需特定任務訓練或物理示範資料。框架重建機器人-物體場景，以第一幀圖像和語言命令為條件生成互動視頻，識別其中的接觸事件，並將其轉換為引導運動優化與精修的幾何約束以供閉環追蹤。

Key Takeaway: GenHOI validates across diverse real and simulated tasks — including asymmetric bimanual chair carrying and table lifting — without any task-specific training or demonstration data. 核心發現： GenHOI 在多樣化的真實和模擬任務（包括不對稱雙臂搬椅子和抬桌子）中均通過驗證，且無需任何特定任務訓練或示範資料。

Diffusion Transformer World-Action Model for AV Scene Prediction

Authors: Ruslan Sharifullin, Benjamin Jiang, Kai Xi Chew | Submitted: 2026-06-11 | arXiv: 2606.12987 Categories: cs.CV, cs.AI, cs.LG, cs.RO

Research Background: Action-conditioned world models for autonomous vehicles predict future camera scenes from planned controls, enabling simulation without real-world rollouts. However, standard distortion metrics like SSIM reward blurry regression averages over realistic predictions, actively misleading model development at compact training scales. 研究背景： 自動駕駛車輛的動作條件式世界模型從規劃的控制輸入預測未來攝影機場景，無需真實試驗即可實現模擬。然而，SSIM 等標準失真指標獎勵模糊的回歸平均值而非逼真的預測，在緊湊訓練規模下積極誤導模型開發。

Technical Approach: A compact latent Diffusion Transformer (DiT) predicts future scene latents decoded to 256x256 frames up to 8 seconds ahead. The study benchmarks six frozen encoders across four representation families, identifies four key DiT ingredients (spatial tokens, x0 objective, residual anchoring, and uncertainty-matched sampling), and develops calibrated FID/KID-based evaluation to reveal the perception-distortion tradeoff. 技術方法： 一種緊湊的潛在擴散 Transformer（DiT）預測未來場景潛在表示，解碼為 256x256 的幀，預測範圍達 8 秒。研究對四種表徵家族的六個凍結編碼器進行基準測試，識別 DiT 的四個關鍵要素（空間標記、x0 目標、殘差錨定、不確定性匹配採樣），並開發校準的 FID/KID 評估以揭示感知-失真的取捨關係。

Key Takeaway: The diffusion model achieves KID 0.078 versus 0.375 for regression (4.8x better) and is genuinely action-controllable, with a compact 1.7M-parameter jump model recovering full ground-truth motion magnitude. 核心發現： 擴散模型的 KID 達到 0.078，而回歸模型為 0.375（提升 4.8 倍），且真正具備動作可控性，其中 170 萬參數的緊湊跳躍模型能恢復完整的真實運動幅度。

Trajectory-Level Redirection Attacks on Vision-Language-Action Models

Authors: Gokul Puthumanaillam, Vardhan Dongre, Pranay Thangeda et al. | Submitted: 2026-06-11 | arXiv: 2606.12978 Categories: cs.RO, cs.CV, eess.SY

Research Background: VLA policies reuse text prompts at every replanning step, making text a persistent control channel. While prior adversarial work elicited specific low-level actions, a stronger threat exists: prompts that appear to specify the intended task but covertly redirect the robot’s entire physical trajectory to an attacker-chosen target. 研究背景： VLA 策略在每個重新規劃步驟重複使用文字提示，使文字成為持續的控制通道。雖然先前的對抗性研究聚焦於引發特定的低層動作，但存在更強的威脅：看似指定預期任務但暗中將機器人整個物理軌跡重定向至攻擊者選定目標的提示。

Technical Approach: The paper formalizes command-preserving trajectory redirection as a prompt-only threat model where the attacker chooses one prompt before the episode, the prompt must stay semantically close to the benign instruction while omitting target words, and all policy and environment components remain fixed. An on-policy prompt search uses rollouts to discover perturbations whose closed-loop behavior tracks an attacker-specified target. 技術方法： 本文將保命令軌跡重定向形式化為僅提示攻擊模型，攻擊者在回合前選擇一個提示，該提示必須在語義上接近良性指令同時省略目標詞語，且所有策略和環境組件保持不變。在策略提示搜索利用推演發現閉環行為追蹤攻擊者指定目標的擾動。

Key Takeaway: Near-benign prompt perturbations can redirect VLA rollouts to attacker-specified targets in both simulation and on hardware, exposing a fundamental trajectory-level vulnerability in VLA instruction grounding. 核心發現： 接近良性的提示擾動可在模擬和真實硬體上將 VLA 推演重定向至攻擊者指定的目標，揭示了 VLA 指令錨定中的基本軌跡層級漏洞。

EmbodiSteer: Steering Embodiment-Agnostic Visuomotor Policies with Joint-Space Guidance for Zero-Shot Cross-Embodiment Deployment

Authors: Shihefeng Wang, Kangchen Lv, Mingrui Yu et al. | Submitted: 2026-06-11 | arXiv: 2606.12965 Categories: cs.RO

Research Background: Large-scale robot imitation learning using diverse or body-free data produces Cartesian end-effector policies that are embodiment-agnostic. However, these policies are unaware of the deployed robot’s specific body, making them brittle under robot-specific constraints like whole-body collision avoidance. 研究背景： 使用多樣化或無機體資料的大規模機器人模仿學習自然產生與機體無關的笛卡爾末端執行器策略。然而，這些策略不了解所部署機器人的具體形態，使其在全身碰撞避免等機器人特定約束下表現脆弱。

Technical Approach: EmbodiSteer is a training-free framework that steers embodiment-agnostic policies during inference by lifting diffusion sampling into the target robot’s joint space via forward kinematics and Jacobian-based updates. Whole-body collision-aware guidance is applied over joint trajectories after each denoising step, steering the arm away from collisions while preserving learned end-effector behavior. 技術方法： EmbodiSteer 是一個免訓練框架，在推理時透過正向運動學和基於雅可比矩陣的更新將擴散採樣提升至目標機器人的關節空間，以引導與機體無關的策略。在每個去噪步驟後對關節軌跡應用全身碰撞感知引導，在保留學習末端執行器行為的同時引導手臂遠離碰撞。

Key Takeaway: EmbodiSteer reduces collision rate by 46.1% and improves task success rate by 28.5% across 9 simulated robots, and achieves 90% collision rate reduction on physical robots in highly constrained scenarios. 核心發現： EmbodiSteer 在 9 個模擬機器人上將碰撞率降低 46.1%、任務成功率提升 28.5%，並在高度受限場景的真實機器人上實現 90% 的碰撞率降低。

SERF: Spatiotemporal Environment and Robot Feature Map for Long-Horizon Mobile Manipulation

Authors: Sunghwan Kim, Byeonghyun Pak, Kehan Long et al. | Submitted: 2026-06-11 | arXiv: 2606.12956 Categories: cs.RO

Research Background: Long-horizon mobile manipulation requires continual reasoning about localization, environment changes, and task progress — all of which are difficult to infer from image observations alone. Standard image-based policies lack persistent spatial memory of the environment and robot state across long task sequences. 研究背景： 長程移動操作需要對定位、環境變化和任務進度進行持續推理，而這些都難以僅從圖像觀測中推斷。標準圖像策略缺乏在長任務序列中對環境和機器人狀態的持久空間記憶。

Technical Approach: SERF maintains a spatiotemporal feature map that represents the environment and articulated robot body as neural points in a shared latent space, updated online from egocentric observations and proprioceptive state. Environment points use object-level rigid tracking; robot points use forward kinematics. Multi-scale map tokens extracted across reference frames and spatial scales are fed to a VLA model as state input. 技術方法： SERF 維護一個時空特徵圖，將環境和關節式機器人身體表示為共享潛在空間中的神經點，從自我中心觀測和本體感知狀態在線更新。環境點使用物件層級剛體追蹤；機器人點使用正向運動學。從多個參考幀和空間尺度提取的多尺度地圖標記作為狀態輸入送入 VLA 模型。

Key Takeaway: The SERF VLA policy outperforms image-only baselines on BEHAVIOR-1K, reaching subgoals faster, improving robustness to scene-configuration shifts, and recovering from object-drop failures. 核心發現： SERF VLA 策略在 BEHAVIOR-1K 上優於僅圖像的基準方法，更快到達子目標、提升對場景配置變化的魯棒性，並能從物體掉落失敗中恢復。

Towards Reliable Sequential Object Picking in Clutter: The Runner-up Solution to RGMC 2025

Authors: Wei Yu, Xidan Zhang, Ziyi Zheng et al. | Submitted: 2026-06-11 | arXiv: 2606.12954 Categories: cs.RO

Research Background: Sequential object picking in cluttered industrial environments demands robust grasping across diverse objects (including deformable ones) and efficient search strategies for target objects. While individual grasping success rates have improved, mature solutions for complete sequential picking with search and decluttering are scarce. 研究背景： 在雜亂的工業環境中進行序列化物體揀取，需要對各種物體（包括可變形物體）進行穩健抓取以及高效的目標搜索策略。儘管單次抓取成功率已有所提升，但涵蓋搜索和清理的完整序列化揀取成熟方案仍然匱乏。

Technical Approach: An integrated hardware-software pipeline combines object recognition, decluttering, and multi-modal grasping. Key contributions include a multifunctional gripper hardware design and novel representations for object distribution and occlusion relationships in cluttered space, enabling efficient sequential search and grasping. 技術方法： 一套整合的軟硬體流程結合物體識別、清理和多模態抓取。主要貢獻包括多功能夾爪的硬體設計，以及針對雜亂空間中物體分佈和遮擋關係的新型表示方法，實現高效的序列化搜索和抓取。

Key Takeaway: The proposed pipeline achieved second place in the Pick-in-Clutter track of RGMC 2025, demonstrating strong performance in both laboratory tests and live competition scenarios. 核心發現： 所提出的流程在 RGMC 2025 的 Pick-in-Clutter 賽道中獲得第二名，在實驗室測試和現場競賽場景中均表現出色。

An Embodied Simulation Platform, Benchmark, and Data-Efficient Augmentation Framework for Wet-Lab Robotics

Authors: Zhe Liu, Huanbo Jin, Zhaohui Du et al. | Submitted: 2026-06-11 | arXiv: 2606.12936 Categories: cs.RO, cs.AI

Research Background: Wet-lab robots can improve the reproducibility and throughput of biomedical experiments, but scaling their learning requires customizable simulators, open laboratory assets, and efficient pipelines that turn limited demonstrations into usable training data — all largely absent in the field. 研究背景： 濕實驗室機器人可提升生物醫學實驗的重現性和吞吐量，但擴展其學習需要可自定義的模擬器、開放的實驗室資產，以及將有限示範轉換為可用訓練資料的高效流程——而這些在該領域基本上都缺乏。

Technical Approach: Pipette is an embodied simulation platform releasing over 43 open-source wet-lab assets with an extensible build pipeline. Its simulation-based data augmentation replays human demonstrations in simulation with lighting, camera, speed, and action perturbations, then filters episodes with automatic success checks. An 11-task wet-lab benchmark covers sample handling, culture-ware manipulation, device operation, and precision placement. 技術方法： Pipette 是一個實體化模擬平台，發布超過 43 個開源濕實驗室資產及可擴展的建構流程。其基於模擬的資料增強在模擬中重播人類示範，加入光照、攝影機、速度和動作擾動，再以自動成功檢查過濾回合。11 個任務的濕實驗室基準涵蓋樣本處理、培養器皿操作、設備操作和精準放置。

Key Takeaway: Simulation augmentation improves SmolVLA from 44.1% to 74.7% average success rate with only 30 demonstrations per task, demonstrating Pipette’s effectiveness for data-efficient VLA training. 核心發現： 模擬增強以每個任務僅 30 個示範將 SmolVLA 的平均成功率從 44.1% 提升至 74.7%，證明了 Pipette 在資料高效 VLA 訓練中的有效性。

Bounding Boxes as Goals: Language-Conditioned Grasping via Neuro-Symbolic Planning

Authors: Allison Andreyev, Landon Eum, Nestor Tiglao et al. | Submitted: 2026-06-11 | arXiv: 2606.12910 Categories: cs.RO, cs.AI, cs.CV, eess.SY

Research Background: For robots to work in household or industrial settings, they must respond to natural-language prompts in real time. Current vision-language approaches for task-and-motion planning are often computationally heavy or require thousands of training demonstrations to achieve open-vocabulary manipulation. 研究背景： 為使機器人能在家庭或工業環境中工作，它們必須能即時回應自然語言提示。當前的視覺語言任務與運動規劃方法往往計算量龐大，或需要數千個訓練示範才能實現開放詞彙操作。

Technical Approach: GRASP (Grounded Reasoning and Symbolic Planning) uses a pretrained VLM to translate natural-language queries into neuro-symbolic goal states, grounded in the physical world through a bounding-box detection pipeline. It interprets abstract spatial concepts (e.g., “top shelf”) without additional fine-tuning or fixed color lists. 技術方法： GRASP（紮根推理與符號規劃）使用預訓練 VLM 將自然語言查詢轉換為神經符號目標狀態，透過邊界框偵測流程錨定在物理世界中。無需額外微調或固定顏色列表即可解釋抽象的空間概念（例如「頂層架子」）。

Key Takeaway: GRASP achieves 73.3% overall success across 90 real-robot trials at three difficulty levels, requiring no task-specific training, demonstrating a lightweight path toward open-vocabulary tabletop manipulation. 核心發現： GRASP 在三個難度等級的 90 次真實機器人試驗中達到 73.3% 的整體成功率，且無需特定任務訓練，展示了通往開放詞彙桌面操作的輕量路徑。

AIR-VLA+: Decoupling Movement and Manipulation via Cascaded Dual-Action Decoders with Asymmetric MoE for Aerial Robots

Authors: Jianli Sun, Bin Tian, Qiyao Zhang et al. | Submitted: 2026-06-11 | arXiv: 2606.12859 Categories: cs.RO

Research Background: Aerial manipulation systems couple UAV platform movement and arm manipulation in end-to-end control, but these two action types differ substantially in scale, dynamics, and control objectives. This representation coupling degrades overall performance. 研究背景： 空中操作系統在端對端控制中耦合了無人機平台移動與手臂操作，但這兩種動作類型在規模、動力學和控制目標上有很大差異，這種表徵耦合會降低整體性能。

Technical Approach: AIR-VLA+ features cascaded dual-action decoders for manipulation and movement, where the UAV decoder can unidirectionally observe the manipulator’s intent for workflow coordination while backpropagation of UAV movement information is isolated from arm stability. An asymmetric Mixture-of-Experts (MoE) with implicit visual grasp projector and compressed global semantics is deployed in the movement decoder for task-stage adaptability. 技術方法： AIR-VLA+ 採用串聯雙動作解碼器分別處理操作和移動，無人機解碼器可單向觀察操作臂的意圖以協調工作流程，同時隔離無人機移動資訊的反向傳播以保護手臂穩定性。在移動解碼器中部署帶有隱式視覺抓取投影器和壓縮全局語義的非對稱混合專家（MoE），以增強任務階段適應性。

Key Takeaway: AIR-VLA+ achieves an overall score of 48.0 on the AIR-VLA benchmark, improving overall task completion by 80.2% compared to the single-head pi0.5 policy. 核心發現： AIR-VLA+ 在 AIR-VLA 基準上取得 48.0 的整體分數，相比單頭 pi0.5 策略整體任務完成度提升 80.2%。

Stubborn: A Streamlined and Unified Reinforcement Learning Framework for Robust Motion Tracking and Fall Recovery for Humanoids

Authors: Xiao Ren, Yuhui Yang, Zongbiao Weng et al. | Submitted: 2026-06-11 | arXiv: 2606.12814 Categories: cs.RO, cs.AI

Research Background: Most humanoid RL work treats motion tracking and fall recovery as separate tasks requiring multi-stage training with specialized recovery rewards or separate policies. Additionally, training episodes that terminate immediately at failure prevent exploration of fall-recovery behaviors in unstable states. 研究背景： 大多數人形機器人強化學習工作將運動追蹤和跌倒恢復視為需要多階段訓練的分離任務，需要專門的恢復獎勵或獨立策略。此外，失敗後立即終止的訓練回合阻礙了在不穩定狀態下探索跌倒恢復行為。

Technical Approach: Stubborn uses an asymmetric Actor-Critic architecture with three key components: a yaw-aligned tracking representation that reduces sensitivity to global drift while preserving balance information; a Bernoulli-based probabilistic termination mechanism that encourages fall-recovery exploration; and a tracking-error-driven adaptive sampling strategy that reshapes training distribution based on difficulty. 技術方法： Stubborn 使用非對稱 Actor-Critic 架構，包含三個關鍵組件：一種降低對全局漂移敏感性同時保留平衡信息的偏航對齊追蹤表示；一種鼓勵跌倒恢復探索的基於伯努利的概率終止機制；以及根據難度動態重塑訓練分布的追蹤誤差驅動自適應採樣策略。

Key Takeaway: Stubborn achieves competitive performance against state-of-the-art methods in a unified framework, with the probabilistic termination mechanism and adaptive sampling strategy providing the key performance gains. 核心發現： Stubborn 在統一框架中達到與最先進方法相當的競爭性能，概率終止機制和自適應採樣策略是關鍵性能提升的來源。

PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation

Authors: Namai Chandra, Shriram Damodaran, Lin Wang | Submitted: 2026-06-11 | arXiv: 2606.13886 Categories: cs.RO, cs.CV, cs.LG

Research Background: VLA models are trained primarily to fit behavioral demonstrations and do not explicitly enforce physical principles such as rigid-body dynamics or contact constraints. This physics gap causes trajectory quality failures that simple temporal smoothing cannot resolve. 研究背景： VLA 模型主要被訓練以適配行為示範，並不明確強制執行剛體動力學或接觸約束等物理原則。這種物理差距導致軌跡品質失敗，而簡單的時序平滑無法解決。

Technical Approach: PhysVLA is a plug-and-play inference-time framework that wraps any frozen VLA backbone without retraining or weight access. It intercepts predicted actions and applies a dual-layered correction: a phase-aware finite-state machine structuring discrete task segments, and a selective Euler-Lagrange gate that activates only when a dynamics oracle detects kinodynamic inconsistency. Overhead is less than 1 ms per control step. 技術方法： PhysVLA 是一個即插即用的推理時框架，可包裝任何凍結的 VLA 骨幹，無需重新訓練或訪問權重。它攔截預測動作並應用雙層校正：一種結構化離散任務片段的相位感知有限狀態機，以及一種僅在動力學預言器偵測到運動動力學不一致時啟動的選擇性歐拉-拉格朗日門。每個控制步驟的開銷小於 1 毫秒。

Key Takeaway: PhysVLA delivers up to 17% absolute success rate increases and 19% stability improvements across four VLA backbones, with no per-task regressions and up to 50% real-robot success rate improvement on a physical arm. 核心發現： PhysVLA 在四個 VLA 骨幹上提供最高 17% 的絕對成功率提升和 19% 的穩定性改善，無任務退步，並在真實機械臂上實現最高 50% 的成功率提升。

mu0: A Scalable 3D Interaction-Trace World Model

Authors: Seungjae Lee, Yoonkyo Jung, Jusuk Lee et al. | Submitted: 2026-06-11 | arXiv: 2606.13769 Categories: cs.RO, cs.CV, cs.LG

Research Background: World models for robot learning must bridge pixel-space video models (which waste capacity on appearance) and direct action models (which require embodiment-specific labels). A scalable intermediate representation is needed that captures physical change without depending on robot-specific supervision. 研究背景： 機器人學習的世界模型必須橋接像素空間視頻模型（浪費容量於外觀重建）和直接動作模型（需要機體特定標籤）。需要一種可擴展的中間表示，能夠捕捉物理變化而不依賴機器人特定的監督。

Technical Approach: mu0 forecasts smooth 3D trajectories for salient interaction points (objects, tools, hands, contact regions) rather than dense pixels or direct actions. The TraceExtract system automatically extracts 3D supervision from diverse video sources by selecting keypoints, constructing globally aligned traces, and associating motion segments with hierarchical language captions. 技術方法： mu0 預測顯著互動點（物體、工具、手部、接觸區域）的平滑 3D 軌跡，而非密集像素或直接動作。TraceExtract 系統透過選擇關鍵點、構建全局對齊的軌跡並將運動片段與層次化語言說明關聯，自動從多樣化視頻來源提取 3D 監督信號。

Key Takeaway: Despite action-free pretraining, trace-conditioned policies derived from mu0 achieve performance competitive with action-supervised VLA models like pi0, establishing 3D traces as a scalable cross-embodiment manipulation representation. 核心發現： 儘管採用無動作預訓練，從 mu0 衍生的軌跡條件式策略達到與動作監督 VLA 模型（如 pi0）相當的競爭性能，確立 3D 軌跡作為可擴展跨機體操作表示的地位。

RepWAM: World Action Modeling with Representation Visual-Action Tokenizers

Authors: Junke Wang, Qihang Zhang, Shuai Yang et al. | Submitted: 2026-06-11 | arXiv: 2606.13674 Categories: cs.CV

Research Background: Existing World Action Models (WAMs) use reconstruction-oriented video tokenizers that preserve visual fidelity but offer limited guidance for learning instruction-following dynamics linking future prediction with robot control. Better tokenization could provide semantic grounding for world-action modeling. 研究背景： 現有的世界動作模型（WAMs）使用以重建為導向的視頻標記器，保留視覺保真度但對學習連接未來預測與機器人控制的指令跟隨動態提供有限指導。更好的標記化可以為世界動作建模提供語義錨定。

Technical Approach: RepWAM trains a representation visual-action tokenizer that maps visual inputs into aligned visual and latent action tokens, creating a semantic visual-action latent space. The WAM then jointly models future visual states and the latent actions connecting them under language instructions, followed by adaptation to real robot trajectories for closed-loop manipulation. 技術方法： RepWAM 訓練一種表徵視覺-動作標記器，將視覺輸入映射為對齊的視覺和潛在動作標記，創建語義視覺-動作潛在空間。WAM 然後在語言指令下聯合建模未來視覺狀態和連接它們的潛在動作，隨後適應真實機器人軌跡以進行閉環操作。

Key Takeaway: RepWAM delivers strong performance across diverse real-world and simulated manipulation settings, with ablations confirming semantic visual-action tokenization outperforms reconstruction-oriented alternatives. 核心發現： RepWAM 在多樣化的真實世界和模擬操作設定中表現出色，消融實驗確認語義視覺-動作標記化優於以重建為導向的替代方案。

VICX: Generalizable Robot Manipulation via Video Generation and In-Context Operator Network

Authors: Song Chen, Linyan Xiang, Ying Zhou et al. | Submitted: 2026-06-10 | arXiv: 2606.12028 Categories: cs.RO

Research Background: Generalizable robot manipulation requires both task-level reasoning over unseen scenes and reliable grounding of visual plans into embodiment-specific execution. Neither visual planning alone nor direct execution policy alone achieves both simultaneously. 研究背景： 可泛化的機器人操作需要對未見場景的任務層級推理，以及將視覺計劃可靠錨定至特定機體執行的能力。單純的視覺規劃或直接執行策略都無法同時達成這兩點。

Technical Approach: VICX (Video generation and In-Context eXecution) decouples planning from execution: a frozen video generation model produces high-level visual plans conditioned on vision and language, while a Video-to-Trajectory In-Context Operator Network (V2T-ICON) grounds these plans into robot-state trajectories using segmentation-extracted arm-only observations and retrieved image-state pairs as in-context prompts. 技術方法： VICX 將規劃與執行解耦：凍結的視頻生成模型在視覺和語言條件下生成高階視覺計劃，而視頻到軌跡的上下文算子網絡（V2T-ICON）使用分割提取的純手臂觀測和檢索的圖像-狀態對作為上下文提示，將這些計劃錨定為機器人狀態軌跡。

Key Takeaway: VICX supports cross-task generalization, closed-loop self-correction, and cross-embodiment transfer on Meta-World, demonstrating dual generalization across both task semantics and robot execution modalities. 核心發現： VICX 在 Meta-World 上支持跨任務泛化、閉環自我校正和跨機體遷移，展示了跨任務語義和機器人執行模式的雙重泛化能力。

Deformable In-Hand Slip-Aware Tactile Sensor with Integrated Velocity, Force/Torque, and Pressure Map Sensing

Authors: Gabriel Arslan Waltersson, Yiannis Karayiannidis | Submitted: 2026-06-10 | arXiv: 2606.11952 Categories: cs.RO

Research Background: In-hand manipulation with slip-aware control requires multiple sensing modalities — velocity, force/torque, and distributed pressure — but existing sensors address these separately, requiring multiple devices and complicating integration into robotic grippers. 研究背景： 具有滑動感知控制的手內操作需要多種感測模態——速度、力/扭矩和分布式壓力——但現有感測器分別處理這些問題，需要多個設備並使集成到機器人夾爪中變得複雜。

Technical Approach: A novel tactile sensor integrates velocity, force/torque, and pressure map sensing into a single device with a deformable contact pad. The sensor features a compliant contact surface capable of tracking both flat and curved surfaces across diverse materials. The design prioritizes rapid and low-cost fabrication using standard PCB manufacturing and rapid prototyping techniques. 技術方法： 一種新型觸覺感測器將速度、力/扭矩和壓力圖感測整合在帶有可變形接觸墊的單一設備中。感測器具有可在多種材料的平面和曲面上追蹤的柔順接觸表面。設計優先考慮使用標準 PCB 製造和快速原型技術實現快速、低成本製造。

Key Takeaway: This is the first sensor to combine velocity, force/torque, and pressure map sensing within a single compliant structure, validated through comprehensive experiments highlighting both capabilities and current limitations. 核心發現： 這是第一個在單一柔順結構中結合速度、力/扭矩和壓力圖感測的感測器，透過全面實驗驗證，揭示了其能力和當前局限性。

DuoBench: A Reproducible Benchmark for Bimanual Manipulation in Simulation and the Real World

Authors: Tobias Julg, Seongjin Bien, Simon Hilber et al. | Submitted: 2026-06-10 | arXiv: 2606.11901 Categories: cs.RO, cs.AI

Research Background: Bimanual robot systems substantially expand manipulation capabilities, but coordinating two arms introduces control complexity and failure modes not captured by existing benchmarks. No reproducible testbed exists that spans both simulation and real-world bimanual evaluation across multiple coordination categories. 研究背景： 雙臂機器人系統大幅擴展了操作能力，但協調兩條手臂引入了現有基準未能捕捉的控制複雜性和失敗模式。目前缺乏跨多個協調類別在模擬和真實世界雙臂評估中均可重現的測試平台。

Technical Approach: DuoBench is an extensible benchmarking framework comprising eleven tasks across four coordination categories, implemented in simulation and partially reproduced in the real world using reproducible task recipes with 3D-printable assets on the FR3 Duo platform. A stage-based evaluation scheme supports fine-grained failure analysis, and human-teleoperated datasets are provided for all tasks. 技術方法： DuoBench 是一個可擴展的基準框架，包含四個協調類別的十一個任務，在模擬中實現並使用可 3D 列印資產的可重現任務方案部分在真實世界中重現。基於階段的評估方案支持細粒度失敗分析，並為所有任務提供人工遙操作資料集。

Key Takeaway: Current policies remain challenged by bimanual manipulation — particularly in early interaction stages, parallel arm execution, and sim-to-real transfer — establishing DuoBench as a systematic testbed for diagnosing dual-arm policy failures. 核心發現： 當前策略仍受雙臂操作挑戰——尤其是在早期互動階段、並行手臂執行和模擬到真實遷移方面——確立 DuoBench 作為診斷雙臂策略失敗的系統性測試平台。

Critic Architecture Matters: Dual vs. Unified Critics for Humanoid Loco-Manipulation

Authors: Mehmet Turan Yardimci | Submitted: 2026-06-10 | arXiv: 2606.11891 Categories: cs.RO, cs.LG

Research Background: Multi-objective RL for humanoid robots must coordinate locomotion and manipulation within a single policy. A fundamental design question is whether to use a single (unified) critic estimating combined value or separate (dual) critics with disjoint reward signals — yet this choice has received little systematic study. 研究背景： 人形機器人的多目標強化學習必須在單一策略中協調運動和操作。一個基本設計問題是使用估計組合價值的單一（統一）評論器，還是具有獨立獎勵信號的分離（雙）評論器——但這一選擇尚未得到系統性研究。

Technical Approach: A controlled comparison is conducted on the Unitree G1 humanoid (23 active DoF) in NVIDIA Isaac Lab, training loco-manipulation policies through a 13-level sequential curriculum from stationary reaching to walking with variable-orientation targets. The study compares unified and dual critics in standardized evaluation, also testing anti-gaming reward mechanisms. 技術方法： 在 NVIDIA Isaac Lab 中對 Unitree G1 人形機器人（23 個主動自由度）進行受控比較，透過從靜止到達到帶可變方向目標的行走的 13 級序列課程訓練運動-操作策略。研究在標準化評估中比較統一和雙評論器，也測試反博弈獎勵機制。

Key Takeaway: Dual-critic policies reach targets 3.5x faster, achieve 2x higher throughput, and attain higher validated reach rates (65.2% vs. 53.8%) than unified critics, with greater impact than reward engineering. 核心發現： 雙評論器策略比統一評論器快 3.5 倍到達目標、吞吐量提升 2 倍、驗證到達率更高（65.2% 對 53.8%），其影響大於獎勵工程。

Modular Anthropomorphic Hand Design via Multi-Parameter Finger Benchmarking and Selection

Authors: Yu Zhang, Huijiang Wang, Josie Hughes | Submitted: 2026-06-10 | arXiv: 2606.11826 Categories: cs.RO

Research Background: Designing anthropomorphic dexterous robotic hands is challenging because the design space spans morphology, actuation, and sensing, and performance metrics are both task-dependent and task-agnostic. Existing optimization methods are often unstructured or focused on a single metric, limiting systematic comparison. 研究背景： 設計擬人靈巧機器人手很有挑戰性，因為設計空間跨越形態、驅動和感測，而性能指標既依賴任務又與任務無關。現有的優化方法通常缺乏結構或只關注單一指標，限制了系統性比較。

Technical Approach: A robotic hand platform allows modular finger integration, enabling rapid screening of different finger-level prototypes through quantitative benchmarks before full-hand integration. Candidate finger designs varying in joint, bone, skin, and sensor placement are assessed using both mechanism-oriented and task-relevant metrics to create a quantitative link between component design and hand performance. 技術方法： 機器人手平台允許模組化手指整合，在全手整合之前透過定量基準快速篩選不同的手指級原型。在關節、骨骼、皮膚和感測器放置上有所不同的候選手指設計使用機構導向和任務相關指標進行評估，在組件設計和手部性能之間建立定量聯繫。

Key Takeaway: The modular benchmarking framework enables systematic finger optimization, validated through an anthropomorphic hand showing performance improvements across multi-object grasping and light bulb screwing tasks. 核心發現： 模組化基準框架實現了系統性手指優化，透過在多物體抓取和燈泡擰緊任務中表現提升的擬人手進行了驗證。

Human-Guided Co-Manipulation of Carbon Fiber Plies

Authors: Rami Ojanen, James Fant-Male, Roel Pieters | Submitted: 2026-06-10 | arXiv: 2606.11818 Categories: cs.RO

Research Background: Handling flexible materials like carbon fiber plies is difficult to fully automate due to deformability challenges, while a fully manual process is ergonomically demanding and inefficient. Human-robot co-manipulation is an attractive middle ground, but effective multimodal control methods are needed. 研究背景： 處理碳纖維薄板等柔性材料因可變形性挑戰而難以完全自動化，而完全人工操作在人體工學上要求較高且效率低下。人機共同操作是一種有吸引力的折中方案，但需要有效的多模態控制方法。

Technical Approach: The paper examines and compares multiple control methods for co-manipulation of carbon fiber plies in a controlled setting. The proposed solution combines three modalities: speech commands, wrist-tracking through vision, and force with compliant control, evaluated in terms of intuitiveness and task effectiveness. 技術方法： 本文在受控環境中檢驗並比較多種碳纖維薄板共同操作的控制方法。所提解決方案結合三種模態：語音命令、透過視覺的腕部追蹤，以及帶有柔順控制的力，在直覺性和任務有效性方面進行評估。

Key Takeaway: A multimodal combination of speech commands, vision-based wrist tracking, and force with compliant control provides the best solution for complete and intuitive co-manipulation control of flexible material handling tasks. 核心發現： 語音命令、基於視覺的腕部追蹤以及帶有柔順控制的力的多模態組合，為柔性材料處理任務的完整且直覺的共同操作控制提供了最佳解決方案。

Authors: Shengcheng Luo, Xiyan Huang, Zhe Xu et al. | Submitted: 2026-06-10 | arXiv: 2606.11767 Categories: cs.RO, cs.AI

Research Background: Blind grasping with a dexterous hand using only tactile feedback (no vision) is a crucial manipulation capability, but learning such policies is hampered by the large tactile sim-to-real gap and the limited expressiveness of sparse tactile signals. 研究背景： 靈巧手僅靠觸覺反饋（無視覺）進行盲抓是一種關鍵的操作能力，但這種策略的學習受到大量觸覺模擬到現實差距和稀疏觸覺信號有限表達能力的阻礙。

Technical Approach: The framework combines three components: a Real2Sim tactile calibration pipeline constructing a contact-calibrated digital-twin simulator; a layout-aware tactile encoder with sensor-geometry priors through self-supervised pretraining; and RL experts trained in the calibrated simulator whose successful trajectories are aggregated into a tactile-conditioned Diffusion Policy. 技術方法： 框架結合三個組件：構建接觸校準數字孿生模擬器的 Real2Sim 觸覺校準流程；通過自監督預訓練具有感測器幾何先驗的佈局感知觸覺編碼器；以及在校準模擬器中訓練的強化學習專家，其成功軌跡被聚合為觸覺條件的擴散策略。

Key Takeaway: The deployed policy achieves 27% real-world grasp success rate across 20 objects (10 seen, 10 unseen) without real-world grasping demonstrations or visual input, demonstrating viable tactile-only blind dexterous grasping. 核心發現： 部署的策略在 20 個物體（10 個見過，10 個未見過）上達到 27% 的真實世界抓取成功率，且不需要真實世界的抓取示範或視覺輸入，展示了可行的純觸覺盲式靈巧抓取。

TacCoRL: Integrating Tactile Feedback into VLA via Simulation

Authors: Siyu Ma, Yuqi Liang, Chang Yu et al. | Submitted: 2026-06-10 | arXiv: 2606.11743 Categories: cs.RO, cs.GR, cs.LG

Research Background: VLA models provide strong visual, language, and action priors for manipulation, but visual observations alone often miss the local contact state required for contact-rich tasks. The challenge is integrating tactile feedback into VLAs without requiring large-scale tactile pretraining or risky real-world contact exploration. 研究背景： VLA 模型為操作提供了強大的視覺、語言和動作先驗，但單獨的視覺觀測往往遺漏接觸豐富任務所需的局部接觸狀態。挑戰在於將觸覺反饋整合到 VLA 中，而不需要大規模觸覺預訓練或有風險的真實世界接觸探索。

Technical Approach: TacCoRL uses a real-aligned simulator as a closed-loop training environment. Mixed simulated and real trajectories first warm-start tactile-conditioned actions in the pretrained policy. Reinforcement learning with verifiable task rewards then optimizes the policy using simulated contact rollouts, while a supervised objective on real trajectories keeps the policy anchored to real deployment distributions. 技術方法： TacCoRL 使用真實對齊的模擬器作為閉環訓練環境。混合的模擬和真實軌跡首先熱啟動預訓練策略中的觸覺條件動作。具有可驗證任務獎勵的強化學習然後使用模擬接觸推演優化策略，而真實軌跡的監督目標則將策略錨定到真實部署分布。

Key Takeaway: The resulting visuo-tactile policy achieves 72.5% average success rate across four bimanual contact-rich tasks, compared to a 50.0% baseline, with direct zero-shot transfer to the real robot. 核心發現： 最終的視覺-觸覺策略在四個雙臂接觸豐富任務中達到 72.5% 的平均成功率，相比 50.0% 的基準，並直接零樣本遷移到真實機器人。

Learning to Assist: Collaborative VLAs for Implicit Human-Robot Collaboration

Authors: Leo Xu, Letian Li, Alex Cuellar et al. | Submitted: 2026-06-10 | arXiv: 2606.12475 Categories: cs.RO

Research Background: Human-robot collaboration combines complementary human and robot strengths to improve task efficiency, but most collaborative systems rely on hand-engineered pipelines. Whether end-to-end VLA models can support implicit HRC — where the robot must infer when and how to assist — has not been thoroughly studied. 研究背景： 人機協作結合人類和機器人的互補優勢以提升任務效率，但大多數協作系統依賴手工設計的流程。端對端 VLA 模型是否能支持隱式人機協作——機器人必須推斷何時以及如何協助——尚未得到充分研究。

Technical Approach: The work evaluates two state-of-the-art VLA models on implicit HRC and identifies a key failure mode: action-chunk policies experience demonstration action leakage when action chunks cross latent task transitions, causing premature assistive behavior. An inference-time steering method is proposed to mitigate erroneous assistive actions while preserving policy performance. 技術方法： 本研究評估兩個最先進的 VLA 模型在隱式人機協作上的表現，並識別一個關鍵失敗模式：當動作塊跨越潛在任務轉換時，動作塊策略會發生示範動作洩漏，導致過早的協助行為。提出一種推理時引導方法來緩解錯誤的協助動作同時保留策略性能。

Key Takeaway: A 16-participant user study confirms that inference-time steering enables longer execution horizons while mitigating premature assistance, leading to faster collaboration and fewer failures than shorter-horizon policies. 核心發現： 16 名參與者的用戶研究確認推理時引導能夠在緩解過早協助的同時實現更長的執行時域，導致比短時域策略更快的協作速度和更少的失敗。

Authors: Geonyeong Ko, Giung Lee, Changjoo Nam | Submitted: 2026-06-10 | arXiv: 2606.11636 Categories: cs.RO

Research Background: Vision-based navigation foundation models generate viable trajectories from RGB observations alone, but even state-of-the-art transformer- and diffusion-based policies struggle in unfamiliar environments with unseen obstacles, producing goal-directed but unsafe trajectories. Existing safety approaches do not train models to explicitly represent obstacle boundaries. 研究背景： 基於視覺的導航基礎模型僅從 RGB 觀測生成可行軌跡，但即使是最先進的基於 Transformer 和擴散的策略在有未見障礙物的陌生環境中也表現欠佳，產生指向目標但不安全的軌跡。現有的安全方法不訓練模型明確表示障礙物邊界。

Technical Approach: SAFER-Nav proposes a navigation model that incorporates obstacle boundary and traversable free-space structure directly into the policy via fine-tuning, designed to be compatible with diverse RGB-based backbones. It addresses both static and dynamic obstacle scenarios across multiple robot platforms. 技術方法： SAFER-Nav 提出一種導航模型，透過微調將障礙物邊界和可通行自由空間結構直接整合到策略中，設計上兼容多種基於 RGB 的骨幹。它解決了多個機器人平台上的靜態和動態障礙物場景。

Key Takeaway: SAFER-Nav reduces collision frequency relative to ViNT, NoMaD, and their CARE-augmented variants while maintaining goal-reaching performance across multiple robot platforms and indoor environments. 核心發現： SAFER-Nav 相比 ViNT、NoMaD 及其 CARE 增強變體降低碰撞頻率，同時在多個機器人平台和室內環境中保持目標到達性能。

LUCID: Learning Embodiment-Agnostic Intent Models from Unstructured Human Videos for Scalable Dexterous Robot Skill Acquisition

Authors: Harsh Gupta, Guanya Shi, Wenzhen Yuan | Submitted: 2026-06-10 | arXiv: 2606.11628 Categories: cs.RO, cs.AI

Research Background: Standard robot learning pipelines rely on robot demonstrations or structured human data, which are expensive and tied to specific embodiments. Unstructured human videos from the internet offer scalable diverse manipulation data but are not directly connected to robot actions. 研究背景： 標準機器人學習流程依賴機器人示範或結構化人類數據，這些既昂貴又綁定特定機體。來自網路的非結構化人類視頻提供了可擴展的多樣化操作數據，但與機器人動作沒有直接聯繫。

Technical Approach: LUCID is a two-stage framework: an intent model predicts short-horizon intent (what should happen next) from current observations in closed loop, trained from unstructured internet-scale human videos. An embodiment-specific sensorimotor policy then converts this intent into robot actions, with the intent interface shared across controllers and embodiments. 技術方法： LUCID 是一個兩階段框架：意圖模型從當前觀測預測短程意圖（接下來應該發生什麼），以閉環方式從非結構化互聯網規模人類視頻訓練。特定機體的感覺運動策略然後將此意圖轉換為機器人動作，意圖介面在不同控制器和機體間共享。

Key Takeaway: LUCID enables five real-world manipulation tasks supervised by only internet video or limited self-collected smartphone video, with zero-shot transfer to novel scenes and object instances. 核心發現： LUCID 僅靠互聯網視頻或有限的自行收集智能手機視頻即可監督五個真實世界操作任務，並零樣本遷移到新場景和物體實例。

Distortion-Resilient Robotic Imitation Learning for Autonomous Cable Routing

Authors: Hao Wang, Fu-Zhao Ou, Shiqi Wang et al. | Submitted: 2026-06-10 | arXiv: 2606.11577 Categories: cs.RO

Research Background: Cable routing is a challenging industrial robot task requiring dexterity and sequential decision-making. In practical deployments, image observation distortion frequently occurs, and low-quality observations hinder accurate model training — yet no dedicated control solution for distorted image conditions has been proposed. 研究背景： 電纜佈線是一項需要靈巧性和序列決策的具有挑戰性的工業機器人任務。在實際部署中，圖像觀測失真頻繁發生，低品質觀測阻礙了準確的模型訓練——但尚無針對失真圖像條件的專用控制解決方案。

Technical Approach: A robotic imitation learning framework combines an image quality assessment module, a confidence-based learning mechanism, and a decision-making module. The quality assessment module extracts image quality information, the confidence-based mechanism adaptively prioritizes challenging samples, and the decision-making module determines appropriate discrete skills or continuous actions. 技術方法： 一個機器人模仿學習框架結合了圖像品質評估模塊、基於置信度的學習機制和決策模塊。品質評估模塊提取圖像品質信息，基於置信度的機制自適應優先處理具有挑戰性的樣本，決策模塊確定適當的離散技能或連續動作。

Key Takeaway: The proposed framework enhances decision-making module performance under distorted image observations, providing a path toward reliable robot imitation learning in degraded visual conditions common in industrial settings. 核心發現： 所提框架在失真圖像觀測下增強了決策模塊性能，為工業環境中常見的退化視覺條件下可靠機器人模仿學習提供了路徑。

Adversarial Attacks on Learned Policies for Surgical Robotic Tasks

Authors: Shutong Jin, Ziyang Chen, Preethi Satish et al. | Submitted: 2026-06-10 | arXiv: 2606.11535 Categories: cs.RO

Research Background: Learning-based policies are being considered to augment surgeon dexterity in robot-assisted surgery. A critical but unstudied question is whether the end-to-end mapping from visual observations to robot actions in these policies is vulnerable to adversarial attacks that could cause patient injury. 研究背景： 基於學習的策略正被考慮用於在機器人輔助手術中增強外科醫生的靈巧性。一個關鍵但尚未研究的問題是，這些策略中從視覺觀測到機器人動作的端對端映射是否容易受到可能導致患者受傷的對抗性攻擊。

Technical Approach: The study investigates two threat modes — disruptive attacks (interrupting policy execution) and steering attacks (redirecting actions toward attacker targets) — using three adversarial attack methods with increasing policy access levels. Experiments cover three policy architectures (ACT, Diffusion Policy, Pi0) across two surgical subtasks. A new class of photometric attacks mimicking natural visual changes (lighting variations) is also introduced. 技術方法： 研究調查兩種威脅模式——破壞性攻擊（中斷策略執行）和引導性攻擊（將動作重定向至攻擊者目標）——使用三種具有不同策略訪問級別的對抗性攻擊方法。實驗涵蓋三種策略架構（ACT、擴散策略、Pi0）和兩個手術子任務。還引入了一類新的模擬自然視覺變化（光照變化）的光度攻擊。

Key Takeaway: Results from 560 physical experiments show that state-of-the-art policies can be significantly disrupted, with an average 61% reduction in surgical subtask success rates, highlighting a serious safety concern for deployed surgical AI. 核心發現： 560 次物理實驗的結果表明，最先進的策略可以被顯著破壞，手術子任務成功率平均降低 61%，突顯了已部署手術 AI 的嚴重安全隱患。

Learning Object Manipulation from Scratch via Contrastive Interaction

Authors: Tongle Shen, Caleb Chuck, Fan Feng et al. | Submitted: 2026-06-10 | arXiv: 2606.11525 Categories: cs.RO, cs.LG

Research Background: Contrastive Reinforcement Learning (CRL) succeeds in locomotion and simple control but struggles in manipulation tasks with object-centric interaction such as contact and grasping. The key difficulty is that interactions induce distinct dynamic mode changes that standard CRL energy functions cannot adequately represent. 研究背景： 對比強化學習（CRL）在運動和簡單控制方面取得成功，但在具有物體中心互動（如接觸和抓取）的操作任務中掙扎。主要困難在於互動誘導了標準 CRL 能量函數無法充分表示的不同動態模式變化。

Technical Approach: The work formulates manipulation dynamics as a piecewise-smooth Markov process and shows interaction-induced mode changes create piecewise nonlinear reachability structures. Interaction-weighted Resampling (IWR) performs interaction-aware resampling around phases before, during, and after interactions, encouraging learned representations to preserve mode boundaries that determine future reachability. 技術方法： 本研究將操作動態表述為分段平滑的馬可夫過程，並表明互動誘導的模式變化創造了分段非線性可達性結構。互動加權重採樣（IWR）在互動前、中、後的階段進行互動感知重採樣，鼓勵學習的表示保留決定未來可達性的模式邊界。

Key Takeaway: IWR improves sample efficiency and performance over prior CRL methods by 19.8% on average in simulation, and enables the first real-world goal-conditioned robot air hockey agent capable of hitting goals, improving success from 25% to 60%. 核心發現： IWR 在模擬中平均提升 19.8% 的樣本效率和性能相比先前 CRL 方法，並實現了第一個能夠擊球得分的真實世界目標條件機器人冰球智能體，成功率從 25% 提升至 60%。

Steering Multirobot Behavior via Closed-Loop Affine Activation Editing

Authors: Satyajeet Das, Darren Chiu, Shashank Hegde et al. | Submitted: 2026-06-09 | arXiv: 2606.11489 Categories: cs.RO

Research Background: Adapting robot behavior beyond a pre-trained policy’s envelope without catastrophic forgetting is a key challenge. Policy fine-tuning risks degrading base performance, while inference-time steering methods that leave policy weights intact are preferable but remain underdeveloped for multi-robot contexts. 研究背景： 在不造成災難性遺忘的情況下使機器人行為適應預訓練策略範圍之外是一個關鍵挑戰。策略微調有降低基礎性能的風險，而保持策略權重不變的推理時引導方法更為優選，但在多機器人場景中仍不夠成熟。

Technical Approach: CLAE (Closed-Loop Affine Activation Editing) steers frozen policy behavior by editing intermediate activations during inference. It trains a sparse autoencoder over frozen-policy activations, selects behavior-relevant latent features via post-hoc probing, and learns a lightweight RL-based steering policy that applies state-dependent affine edits to selected latents during inference. 技術方法： CLAE（閉環仿射激活編輯）在推理時通過編輯中間激活來引導凍結策略行為。它在凍結策略激活上訓練稀疏自動編碼器，通過事後探測選擇行為相關的潛在特徵，並學習一個輕量的基於 RL 的引導策略，在推理時對選定潛在量應用狀態依賴的仿射編輯。

Key Takeaway: CLAE successfully steers individual robot velocity profiles, coordinates multi-robot formation preservation, and produces entirely new behaviors (surveillance avoidance) on a frozen multi-quadrotor navigation policy without modifying its weights. 核心發現： CLAE 成功引導個體機器人速度配置文件、協調多機器人編隊保持，並在不修改凍結多四旋翼導航策略權重的情況下產生全新行為（監控規避）。

Bridging the sim2real gap in the table tennis robot with a transformer-based ball states predictor

Authors: Yin Bi, Christian Conti, Bilan Yang et al. | Submitted: 2026-06-09 | arXiv: 2606.11464 Categories: cs.RO

Research Background: Robotic table tennis is a benchmark for high-speed closed-loop control, where accurate ball state prediction is critical. Physics-based approaches require precise parameter identification, while learning-based methods struggle with long-range temporal dependencies and limited real-world data. 研究背景： 機器人乒乓球是高速閉環控制的基準，準確的球狀態預測至關重要。基於物理的方法需要精確的參數識別，而基於學習的方法難以處理長程時序依賴和有限的真實世界數據。

Technical Approach: A transformer-based framework leverages attention mechanisms to model long-range temporal correlations in ball trajectories directly from historical observations, without relying on explicit flight or bounce models. Training uses a large-scale real-world dataset from diverse skill levels and configurations. A plug-and-play sim-to-real transfer strategy (SPAD) replaces the physics simulator used during training with the real-world-trained predictor at deployment. 技術方法： 基於 Transformer 的框架利用注意力機制直接從歷史觀測中建模球軌跡的長程時序相關性，不依賴顯式的飛行或彈跳模型。訓練使用來自不同技術水平和配置的大規模真實世界數據集。即插即用的模擬到現實遷移策略（SPAD）在部署時將訓練期間使用的物理模擬器替換為真實世界訓練的預測器。

Key Takeaway: SPAD effectively narrows the sim-to-real gap without policy retraining, combining the efficiency and scalability of simulation-based training with real-world prediction accuracy for high-speed robotic control. 核心發現： SPAD 有效縮小模擬到現實差距而不需要策略重新訓練，結合基於模擬的訓練的效率和可擴展性與真實世界預測準確性，用於高速機器人控制。

Dynamic Execution Horizon Prediction for Chunk-based Robot Policies

Authors: Yuchi Zhao, Miroslav Bogdanovic, Arjun Sohal et al. | Submitted: 2026-06-09 | arXiv: 2606.11408 Categories: cs.RO

Research Background: Action chunking is standard in modern robot policies, but using a fixed execution horizon is suboptimal: during fine-grained manipulation, executing too many actions open-loop causes failures, while during free-space motion, frequent replanning is wasteful. The optimal horizon is task-stage-dependent but currently chosen by empirical tuning. 研究背景： 動作塊化在現代機器人策略中是標準做法，但使用固定執行時域並非最優：在精細操作中，開環執行過多動作會導致失敗；而在自由空間運動中，頻繁重新規劃很浪費。最優時域取決於任務階段，但目前通過經驗調整來選擇。

Technical Approach: DEHP (Dynamic Execution Horizon Prediction) trains a lightweight execution-horizon prediction branch using online reinforcement learning while keeping the pretrained chunk policy completely frozen, making it compatible with black-box policies. The predictor learns to output shorter horizons during fine-grained task stages and longer horizons during free-space motion. 技術方法： DEHP（動態執行時域預測）在使用在線強化學習訓練輕量執行時域預測分支的同時，保持預訓練的塊策略完全凍結，使其與黑盒策略相容。預測器學習在精細任務階段輸出較短的時域，在自由空間運動中輸出較長的時域。

Key Takeaway: DEHP improves the success rate of different high-precision and long-horizon manipulation tasks by a large margin, balancing the efficiency of open-loop chunk execution with the reactivity of closed-loop single-step control. 核心發現： DEHP 顯著提升不同高精度和長程操作任務的成功率，平衡了開環塊執行的效率與閉環單步控制的反應能力。

PLUME: Probabilistic Latent Unified World Modeling and Parameter Estimation for Multi-Finger Manipulation

Authors: Abhinav Kumar, Soshi Iba, Rana Soltani Zarrin et al. | Submitted: 2026-06-09 | arXiv: 2606.11396 Categories: cs.RO

Research Background: Dexterous manipulation with multi-finger hands is sensitive to physical parameters like object shape, pose, and friction. While simulation enables large-scale data collection with known parameters, deployed policies must handle uncertainty about these parameters, and domain randomization may be insufficient for precise tasks where strategies must change based on specific parameter values. 研究背景： 多指手的靈巧操作對物體形狀、姿態和摩擦力等物理參數敏感。雖然模擬允許在已知參數下大規模數據收集，但部署的策略必須處理這些參數的不確定性，而域隨機化對於策略必須根據特定參數值改變的精確任務可能不夠。

Technical Approach: PLUME jointly learns to evolve a belief over physical parameter values and system dynamics conditioned on those parameters. A latent space jointly represents multiple physical parameters along with rewards, enabling planning. Online parameter inference aligns the world model to true dynamics without retraining or fine-tuning. 技術方法： PLUME 聯合學習演化物理參數值的信念以及以這些參數為條件的系統動力學。潛在空間聯合表示多個物理參數和獎勵，以支持規劃。在線參數推斷在不重新訓練或微調的情況下將世界模型與真實動力學對齊。

Key Takeaway: PLUME achieves successful zero-shot transfer of simulation-trained policies to hardware screwdriver turning and outperforms state-of-the-art offline RL and world-model-augmented behavior cloning baselines across four manipulation tasks. 核心發現： PLUME 在螺絲刀擰轉上實現了模擬訓練策略到硬體的零樣本遷移，並在四個操作任務中優於最先進的離線 RL 和世界模型增強行為複製基準。

HiPi: Reproducible High-Fidelity Piezoresistive Sensors for Robotic Manipulation

Authors: Changyi Lin, Raihan Haque, Hui-Ping Wang et al. | Submitted: 2026-06-09 | arXiv: 2606.11372 Categories: cs.RO

Research Background: Piezoresistive tactile sensors are attractive for robotics due to their thin, lightweight, and scalable properties, but existing systems face a tradeoff: reproducible designs prioritize accessibility while high-fidelity readout architectures remain difficult to fabricate and deploy. Neither alone meets practical needs for dense bimanual tactile sensing. 研究背景： 壓阻式觸覺感測器因其薄、輕、可擴展的特性對機器人技術頗具吸引力，但現有系統面臨取捨：可重現設計優先考慮可訪問性，而高保真讀出架構仍難以製造和部署。單獨來看，兩者都無法滿足密集雙臂觸覺感測的實際需求。

Technical Approach: HiPi redesigns the complete hardware stack for reproducibility and deployability around a low-crosstalk readout principle. It includes a compact readout PCB compatible with commercial fabrication (eliminating manual soldering), a smaller STM32-based MCU module, an optimized communication pipeline achieving 220 Hz with four dense tactile arrays (2048 taxels total), and FPCB-based conductive layers simplifying sensor fabrication. 技術方法： HiPi 圍繞低串擾讀出原理重新設計完整硬體堆疊，以實現可重現性和可部署性。包括兼容商業製造的緊湊讀出 PCB（消除手動焊接）、更小的基於 STM32 的 MCU 模塊、在四個密集觸覺陣列（共 2048 個傳感元件）下實現 220 Hz 的優化通信流程，以及簡化感測器製造的基於 FPCB 的導電層。

Key Takeaway: HiPi improves average contact-geometry IoU from 0.428 to 0.797 compared to reproducible baselines, bridging the gap between reproducible fabrication and high-fidelity readout for practical bimanual and multi-fingered robotic systems. 核心發現： 與可重現基準相比，HiPi 將平均接觸幾何 IoU 從 0.428 提升至 0.797，縮小了可重現製造與高保真讀出之間的差距，適用於實際雙臂和多指機器人系統。

Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models

Authors: Yifu Yuan, Yaoting Huang, Xianze Yao et al. | Submitted: 2026-06-09 | arXiv: 2606.11324 Categories: cs.RO, cs.AI, cs.LG

Research Background: Physical intelligence for robotics requires integrating embodied cognition, task planning, failure correction, and spatial grounding within a single model capable of executing long-horizon tasks autonomously. Existing approaches typically address these capabilities in isolation, limiting their generalization to real-world deployment. 研究背景： 機器人的物理智能需要在單一模型中整合具身認知、任務規劃、失敗校正和空間錨定，使其能夠自主執行長程任務。現有方法通常孤立地處理這些能力，限制了其對真實世界部署的泛化。

Technical Approach: Embodied-R1.5 is a unified Embodied Foundation Model (EFM) trained on over 15B tokens from three automated data construction pipelines covering cognition, planning, correction, and pointing capabilities. A multi-task balanced RL recipe addresses heterogeneous task conflicts, and a Planner-Grounder-Corrector (PGC) closed-loop framework enables autonomous long-horizon execution and self-correction. 技術方法： Embodied-R1.5 是一個統一的具身基礎模型（EFM），在來自三個自動化數據構建流程的超過 150 億個標記上訓練，涵蓋認知、規劃、校正和指點能力。多任務平衡 RL 方案解決異質任務衝突，規劃器-錨定器-校正器（PGC）閉環框架實現自主長程執行和自我校正。

Key Takeaway: With only 8B parameters, Embodied-R1.5 achieves state-of-the-art on 16 out of 24 embodied VLM benchmarks, surpassing Gemini-Robotics-ER-1.5 and GPT-5.4, and outperforms leading VLA models like pi0.5 across 4 manipulation benchmark suites. 核心發現： 僅 80 億參數，Embodied-R1.5 在 24 個具身 VLM 基準中的 16 個上達到最先進水平，超越 Gemini-Robotics-ER-1.5 和 GPT-5.4，並在 4 個操作基準套件中優於 pi0.5 等領先 VLA 模型。

TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation

Authors: Yujie Zang, Yuhang Zheng, Xian Nie et al. | Submitted: 2026-06-09 | arXiv: 2606.11184 Categories: cs.RO

Research Background: Contact-rich manipulation requires robots to perceive and regulate evolving physical interactions under dynamic contact transitions. While tactile and force feedback individually help, most methods do not model the asymmetric spatiotemporal roles of global force signals and local tactile sensing together. 研究背景： 接觸豐富的操作要求機器人在動態接觸轉換下感知和調節不斷演變的物理互動。雖然觸覺和力反饋各自有幫助，但大多數方法不能一起建模全局力信號和局部觸覺感測的不對稱時空角色。

Technical Approach: TacForeSight comprises TacForceWM, a tactile world model predicting short-horizon tactile latent dynamics from dual-finger observations conditioned on high-frequency wrist force/torque signals, and a Predictive Tactile-Conditioned Policy that uses predicted latents as anticipatory contact priors, models current-to-future tactile evolution via cross-attention, and adaptively fuses visuo-tactile features through a gating module. 技術方法： TacForeSight 包含 TacForceWM（一種從以高頻腕部力/扭矩信號為條件的雙指觀測預測短程觸覺潛在動態的觸覺世界模型）和預測觸覺條件策略（使用預測潛在量作為預期接觸先驗，通過交叉注意力建模當前到未來的觸覺演變，並通過門控模塊自適應融合視觸覺特徵）。

Key Takeaway: Real-robot experiments on five tasks and three perturbation settings show TacForeSight consistently outperforms existing baselines, particularly under dynamic contact disturbances, enabling proactive contact reasoning at real-time inference speeds. 核心發現： 在五個任務和三個擾動設定下的真實機器人實驗表明，TacForeSight 持續優於現有基準，特別是在動態接觸干擾下，以實時推理速度實現主動接觸推理。

Authors: Drake Moore, Matt Cheng, Xiang Zhi Tan et al. | Submitted: 2026-06-09 | arXiv: 2606.11151 Categories: cs.RO

Research Background: Many everyday tasks for people with disabilities are fundamentally bimanual — opening jars, pouring liquids, lifting trays — yet single-arm wheelchair-mounted systems cannot perform them, and adding a permanent second arm is impractical due to space, cost, and power constraints. 研究背景： 殘疾人的許多日常任務從根本上是雙臂的——開罐、倒液體、舉托盤——但單臂輪椅安裝系統無法執行，而添加永久的第二隻手臂因空間、成本和電力限制不切實際。

Technical Approach: JOIN (bimanual joining via Opposition, Inference, and Navigation) frames the task as three-phase decomposition (plan, drive, grasp) where a VLM coupled with geometric tools provides task-level knowledge. Key contributions are a wheelchair-referenced opposition score and task-conditioned directional manipulability metric that determine where a mobile manipulator should stand and what to grasp to complement an anchor arm’s existing grasp. 技術方法： JOIN 將任務框架為三階段分解（規劃、驅動、抓取），VLM 結合幾何工具提供任務級知識。主要貢獻是輪椅參考的對立分數和任務條件方向可操作性指標，決定移動操作臂應在哪裡站立、抓取什麼以補充錨定臂的現有抓取。

Key Takeaway: JOIN accomplished 19 out of 20 task attempts compared to 14 out of 20 for state-of-the-art methods, and required markedly less operator correction across representative same-object and different-object bimanual ADL tasks. 核心發現： JOIN 在 20 次任務嘗試中完成 19 次，而最先進方法完成 14 次，並在代表性的相同物體和不同物體雙臂日常生活活動任務中需要明顯更少的操作者校正。

RoboNaldo: Accurate, Stable and Powerful Humanoid Soccer Shooting via Motion-Guided Curriculum Reinforcement Learning

Authors: Yichao Zhong, Yidan Lu, Yuhang Lu et al. | Submitted: 2026-06-09 | arXiv: 2606.11092 Categories: cs.RO, cs.AI

Research Background: Humanoid soccer shooting requires whole-body stability, high-impulse interactions, and accuracy — capabilities that strain both tracking-based and task-reward-based RL approaches. Motion tracking provides stable whole-body coordination but cannot adapt to varied ball positions, while task rewards alone struggle to discover valid kicks from scratch. 研究背景： 人形機器人足球射門需要全身穩定性、高衝量互動和準確性——這些能力都對基於追蹤和基於任務獎勵的強化學習方法提出了挑戰。運動追蹤提供穩定的全身協調但無法適應不同的球位，而僅憑任務獎勵很難從頭發現有效的踢球動作。

Technical Approach: RoboNaldo uses a three-stage motion-guided curriculum RL framework. A single human-kick reference is progressively shifted from stability learning to free-kick adaptation and finally moving-ball shooting through a locomotion-command and kick-trigger interface. During training a heuristic planner controls the interface; alternative high-level controllers can drive the same low-level policy at inference. 技術方法： RoboNaldo 使用三階段運動引導課程強化學習框架。單一人類踢球參考逐漸從穩定性學習轉向定點球適應，最後通過運動命令和踢球觸發介面轉向移動球射門。訓練期間啟發式規劃器控制介面；推理時可用替代的高層控制器驅動同一低層策略。

Key Takeaway: RoboNaldo demonstrates free-kick shot error 48.6% lower and shoot velocity 2.96x higher than baselines in simulation, achieving 0.73–0.86 m average target error from 3 m on real Unitree G1 with 13.10 m/s post-contact ball velocity. 核心發現： RoboNaldo 在模擬中展示的定點球射門誤差比基準低 48.6%，射門速度高 2.96 倍，在真實 Unitree G1 上從 3 米距離達到 0.73-0.86 米平均目標誤差，接觸後球速達 13.10 米/秒。

A Spiking Neural Architecture for Coordinating Arm and Locomotor Control

Authors: Lea Steffen, Kathryn Simone, Graeme Damberger et al. | Submitted: 2026-06-09 | arXiv: 2606.11034 Categories: cs.RO, cs.NE

Research Background: Spiking Neural Networks (SNNs) on neuromorphic hardware offer energy-efficient robot control, but existing SNN-based systems address bipedal locomotion and arm control in isolation. Integrated SNN control for both has remained unaddressed, limiting the practical applicability of neuromorphic computing to full humanoid robots. 研究背景： 神經形態硬體上的脈衝神經網絡（SNNs）提供節能的機器人控制，但現有的基於 SNN 的系統孤立地處理雙足運動和手臂控制。兩者的集成 SNN 控制一直未得到解決，限制了神經形態計算在全身人形機器人上的實際適用性。

Technical Approach: A spiking architecture coordinates force-based arm control and bipedal locomotion in a simulated humanoid using the Neural Engineering Framework (NEF) and Semantic Pointer Architecture (SPA). High-level action selection between locomotor and arm control is mediated by a biologically grounded spiking basal ganglia model. Co-simulation uses Nengo for neural control and Isaac Sim for physics. 技術方法： 一種脈衝架構使用神經工程框架（NEF）和語義指針架構（SPA）在模擬人形中協調基於力的手臂控制和雙足運動。運動和手臂控制之間的高層動作選擇由生物學支撐的脈衝基底神經節模型介導。協同模擬使用 Nengo 進行神經控制，Isaac Sim 用於物理。

Key Takeaway: This is the first integrated spiking controller to combine bipedal locomotion and arm control on a full-scale humanoid, demonstrating successful target reaching, digit drawing, path-following, and locomotion-to-arm-control switching via basal ganglia disinhibition. 核心發現： 這是第一個在全尺寸人形機器人上結合雙足運動和手臂控制的集成脈衝控制器，展示了成功的目標到達、數字繪製、路徑跟隨，以及通過基底神經節去抑制的運動到手臂控制切換。

Authors: Hang Yin, Yinan Liang, Jiazhao Zhang et al. | Submitted: 2026-06-09 | arXiv: 2606.10927 Categories: cs.RO

Research Background: Lifelong navigation in dynamic real-world environments requires robots to form persistent scene understanding from fragmentary observations. Explicit map-based or scene-graph approaches struggle to generalize beyond structured settings and cannot efficiently update with scene changes over time. 研究背景： 在動態真實世界環境中的終身導航要求機器人從零散觀測中形成持久的場景理解。明確的地圖或場景圖方法難以泛化到結構化設定之外，且無法有效地隨時間更新場景變化。

Technical Approach: AllDayNav implicitly encodes scene dynamics into billion-scale model parameters via reinforcement learning, powered by a self-evolving multimodal memory that maintains visual keyframes, semantic descriptions, and temporal context while autonomously generating open-vocabulary instructions, image goals, and structured rewards. 技術方法： AllDayNav 透過強化學習將場景動態隱式編碼到十億規模的模型參數中，由一個自我演化的多模態記憶驅動，該記憶維護視覺關鍵幀、語義描述和時序上下文，同時自主生成開放詞彙指令、圖像目標和結構化獎勵。

Key Takeaway: AllDayNav achieves near-100% success rates in cross-room, cross-episode, and cross-task scenarios, consistently surpassing map-based, VLM, and RL baselines in path efficiency and robustness, demonstrating memory-driven RL as a scalable alternative to explicit mapping. 核心發現： AllDayNav 在跨房間、跨回合和跨任務場景中達到接近 100% 的成功率，在路徑效率和魯棒性方面持續超越基於地圖、VLM 和 RL 的基準，展示記憶驅動的 RL 作為顯式映射的可擴展替代方案。

Task Robustness via Re-Labelling Vision-Action Robot Data

Authors: Artur Kuramshin, Ozgur Aslan, Cyrus Neary et al. | Submitted: 2026-06-09 | arXiv: 2606.10918 Categories: cs.RO, cs.LG

Research Background: Scaled robot learning policies still struggle with instruction-following, largely due to limited linguistic and action sequence diversity in existing datasets. Collecting new data is expensive, but existing data could be augmented to improve generalization without additional collection. 研究背景： 規模化的機器人學習策略仍在指令跟隨方面掙扎，主要因為現有數據集中語言和動作序列多樣性有限。收集新數據昂貴，但現有數據可以通過增強來改善泛化，而無需額外收集。

Technical Approach: TREAD (Task Robustness via Re-Labelling Vision-Action Robot Data) leverages VLMs to augment existing robotics datasets through three stages: generating semantic sub-tasks from original labels and initial scenes, segmenting demonstration videos conditioned on sub-tasks, and producing linguistically diverse instructions incorporating object properties to decompose demonstrations into grounded language-action pairs. 技術方法： TREAD（通過重新標記視覺-動作機器人數據實現任務魯棒性）利用 VLMs 通過三個階段增強現有機器人數據集：從原始標籤和初始場景生成語義子任務，根據子任務分割示範視頻，並生成包含物體屬性的語言多樣化指令，將示範分解為具體的語言-動作對。

Key Takeaway: Policies trained on TREAD-augmented LIBERO datasets exhibit improved performance on novel, unseen tasks, enhancing both planning generalization through trajectory decomposition and language-conditioned policy generalization through increased linguistic diversity. 核心發現： 在 TREAD 增強的 LIBERO 數據集上訓練的策略在新穎的未見任務上表現改善，通過軌跡分解增強了規劃泛化，並通過增加語言多樣性增強了語言條件策略泛化。

Authors: Tianhao Zang, Siwei Cheng, Haidong Huang et al. | Submitted: 2026-06-09 | arXiv: 2606.10903 Categories: cs.RO

Research Background: Monocular local navigation is attractive for lightweight robots, but existing vision-based policies couple perception to a specific robot body, camera height, and footprint. Transferring from wheeled to legged platforms currently requires retraining or active depth hardware. 研究背景： 單目局部導航對輕型機器人具有吸引力，但現有的基於視覺的策略將感知與特定的機器人形體、攝影機高度和足跡耦合在一起。從輪式到腿式平台的遷移目前需要重新訓練或主動深度硬體。

Technical Approach: AgniNav standardizes cross-embodiment transfer at the collision-envelope level using a four-parameter safety envelope (collision-relevant height, front length, rear length, half-width). The height parameter conditions an image-to-scan network to predict a 1D collision-relevant pseudo-laserscan from monocular color images, while the footprint parameters configure a dimension-aware local planner for collision checking. 技術方法： AgniNav 使用四參數安全包絡（碰撞相關高度、前長、後長、半寬）在碰撞包絡層面標準化跨機體遷移。高度參數將圖像到掃描網絡條件化以從單目彩色圖像預測一維碰撞相關偽激光掃描，而足跡參數配置尺寸感知局部規劃器進行碰撞檢查。

Key Takeaway: AgniNav achieves zero-retraining deployment across wheeled (Turtlebot2), quadruped (Unitree Go2), and humanoid (Accelerated Evolution K1) platforms with 39/40, 18/20, and 18/20 navigation successes at 30 Hz. 核心發現： AgniNav 在輪式（Turtlebot2）、四足（Unitree Go2）和人形（加速進化 K1）平台上實現零重新訓練部署，以 30 Hz 達到 39/40、18/20 和 18/20 的導航成功率。

MV-Actor: Aligning Multi-View Semantics and Spatial Awareness for Bimanual Manipulation

Authors: Yinchen Tian, Huan Li, Muyao Peng et al. | Submitted: 2026-06-09 | arXiv: 2606.10899 Categories: cs.RO

Research Background: Bimanual manipulation systems use multiple cameras from different viewpoints, but existing multi-view policies encode each view independently or fuse features shallowly, limiting shared semantic perception and producing unreliable spatial awareness — particularly under consumer-grade depth noise. 研究背景： 雙臂操作系統使用來自不同視角的多個攝影機，但現有的多視角策略獨立編碼每個視圖或淺層融合特徵，限制了共享語義感知並在消費級深度噪音下產生不可靠的空間感知。

Technical Approach: MV-Actor builds a unified semantic-spatial representation through three steps: Multi-view Semantic Interaction to share semantic perception across views; Semantic-Spatial Token Interaction grounding visual semantics with feedforward reconstruction model features for reliable spatial awareness; and a Guided Metric Depth Repair module refining degraded sensor depth under consumer-grade noise. 技術方法： MV-Actor 通過三個步驟建立統一的語義-空間表示：多視角語義互動以跨視圖共享語義感知；語義-空間標記互動，用前饋重建模型特徵錨定視覺語義以獲得可靠的空間感知；以及一個在消費級噪音下精細化降級感測器深度的引導度量深度修復模塊。

Key Takeaway: MV-Actor achieves a state-of-the-art 87.8% average success rate on PerAct2, and outperforms both RGB and RGB-D baselines in real-world evaluations with frequent viewpoint changes and unstable consumer-grade depth. 核心發現： MV-Actor 在 PerAct2 上達到最先進的 87.8% 平均成功率，並在具有頻繁視角變化和不穩定消費級深度的真實世界評估中優於 RGB 和 RGB-D 基準。

LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination

Authors: Taishan Li, Jiwen Zhang, Siyuan Wang et al. | Submitted: 2026-06-09 | arXiv: 2606.10862 Categories: cs.CV, cs.AI

Research Background: Standard VLA model evaluations assume task-relevant objects are fully visible, but in realistic settings, occlusion makes manipulation partially observable. The specific challenge of scene-induced occlusion — where the scene geometry itself blocks the robot’s view — has not been systematically studied. 研究背景： 標準 VLA 模型評估假設與任務相關的物體完全可見，但在實際環境中，遮擋使操作成為部分可觀察問題。場景誘導遮擋的具體挑戰——場景幾何本身阻擋機器人視線——尚未得到系統研究。

Technical Approach: LIBERO-Occ is an occlusion-oriented extension of LIBERO. To address performance degradation under occlusion, Viewpoint Imagination (VIM) generates a complementary view from an occluded primary observation and conditions action prediction on both observed and imagined evidence, without requiring additional cameras at deployment. 技術方法： LIBERO-Occ 是 LIBERO 的遮擋導向擴展。為解決遮擋下的性能下降，視角想象（VIM）從遮擋的主要觀測生成補充視角，並在觀測和想象的證據上進行動作預測，無需在部署時增加攝影機。

Key Takeaway: State-of-the-art VLAs suffer substantial degradation under occlusion, and VIM improves robustness across task suites, occlusion types, and severity levels, suggesting viewpoint imagination as a promising perception completion mechanism. 核心發現： 最先進的 VLA 在遮擋下遭受顯著性能下降，VIM 在任務套件、遮擋類型和嚴重程度上提升魯棒性，表明視角想象是一種有前途的感知補全機制。

Beyond APIs: Probing the Limits of MLLMs in Physical Tool Use

Authors: Zhixin Ma, Yutong Zhou, Yongqi Li et al. | Submitted: 2026-06-09 | arXiv: 2606.10803 Categories: cs.CL, cs.AI, cs.CV

Research Background: MLLMs increasingly serve as the “brain” of embodied AI, instructing robots to interact with the physical world. A central capability for this is the ability to recognize and plan the use of physical tools — yet no benchmark has systematically evaluated this in realistic settings. 研究背景： 多模態大語言模型（MLLMs）越來越多地作為具身 AI 的「大腦」，指示機器人與物理世界互動。為此，識別和規劃使用物理工具的能力至關重要——但尚無基準在現實設定中系統評估這一點。

Technical Approach: PhysTool-Bench introduces a physical tool-use benchmark with 2,510 queries over 2,678 real-world physical tools across domains including manufacturing, electrical work, agriculture, and healthcare. Models are evaluated on (1) recognizing all physical tools present in the scene, and (2) planning tool selection and use sequence based on instruction and visual context. 技術方法： PhysTool-Bench 引入一個物理工具使用基準，包含涵蓋製造、電氣工作、農業和醫療保健等領域的 2,678 個真實世界物理工具的 2,510 個查詢。模型在以下方面進行評估：（1）識別場景中所有物理工具，（2）根據指令和視覺上下文規劃工具選擇和使用序列。

Key Takeaway: Even the strongest model (Gemini-3.1-Pro) identifies only 58.7% of tools and completes merely 21.0% of queries end-to-end, revealing a two-level deficit in tool perception and functional commonsense planning critical for embodied AI development. 核心發現： 即使是最強的模型（Gemini-3.1-Pro）也只識別 58.7% 的工具並端到端完成僅 21.0% 的查詢，揭示了對具身 AI 開發至關重要的工具感知和功能常識規劃的兩層缺陷。

ManiSplat: Manipulation Trajectory Synthesis from Monocular Video via Decoupled 3D Gaussian Splatting

Authors: Wenhao Hu, Haonan Zhou, Liu Liu et al. | Submitted: 2026-06-09 | arXiv: 2606.10645 Categories: cs.CV

Research Background: Reconstructing dynamic and interactive 3D scenes from real-world observations is a fundamental challenge for robot policy learning. Extending 3D Gaussian Splatting to interactive environments with articulated robots and manipulable objects is particularly difficult due to complex contact interactions and abrupt pose changes. 研究背景： 從真實世界觀測中重建動態和互動式 3D 場景是機器人策略學習的基本挑戰。由於複雜的接觸互動和突然的姿態變化，將 3D 高斯點雲擴展到帶有關節機器人和可操縱物體的互動環境尤為困難。

Technical Approach: ManiSplat reconstructs controllable and decoupled Gaussian digital twins from monocular ego-view robotic videos using a Graph-Structured Disentangled Representation that separates robot, objects, and background into independently optimizable Gaussian subfields in a scene graph. A Task-Oriented Spatio-Temporal Alignment module leverages manipulation task structure (alternating Motion and Skill phases) to construct accurate pseudo-ground-truth trajectories. 技術方法： ManiSplat 使用圖結構解糾纏表示從單目自我視角機器人視頻重建可控和解耦的高斯數字孿生，將機器人、物體和背景分離到場景圖中獨立可優化的高斯子場。任務導向的時空對齊模塊利用操作任務結構（交替的運動和技能階段）構建準確的偽真實軌跡。

Key Takeaway: ManiSplat reconstructs interaction-driven dynamic scenes with high fidelity and controllability, effectively supporting downstream robotic tasks and policy learning from monocular video. 核心發現： ManiSplat 以高保真度和可控性重建互動驅動的動態場景，有效支持從單目視頻進行的下游機器人任務和策略學習。

YUBI: Yielding Universal Bidigital Interface for Bimanual Dexterous Manipulation at Scale

Authors: Takehiko Ohkawa, Jumpei Arima, Yuki Noguchi et al. | Submitted: 2026-06-08 | arXiv: 2606.10244 Categories: cs.RO, cs.AI

Research Background: Handheld data collection systems like UMI enable affordable robot learning, but their bulky pistol-grip designs create ergonomic and usability challenges for fine-grained dexterous bimanual tasks. A more intuitive, finger-driven interface could enable collection of higher-quality demonstrations at unprecedented scale. 研究背景： 像 UMI 這樣的手持數據收集系統實現了經濟實惠的機器人學習，但其笨重的手槍握把設計對精細靈巧雙臂任務造成人體工學和可用性挑戰。更直觀、手指驅動的介面可以實現前所未有規模的更高品質示範收集。

Technical Approach: YUBI presents a distinct design principle: yielding, finger-driven actuation that directly maps human finger movements to gripper jaw motion. Combined with VR-based 6 DoF tracking, a dataset of 8,434 hours across 1.20M episodes and 119 tasks is collected — the largest UMI-based dataset to date. A single policy trained on this dataset transfers across UR, Franka, and ELEY robots by mounting the YUBI gripper. 技術方法： YUBI 提出一種獨特設計原則：順從的手指驅動驅動，直接將人類手指動作映射到夾爪動作。結合基於 VR 的 6 自由度追蹤，收集了 8,434 小時、120 萬個回合、119 個任務的數據集——迄今最大的基於 UMI 的數據集。在此數據集上訓練的單一策略通過安裝 YUBI 夾爪可遷移到 UR、Franka 和 ELEY 機器人。

Key Takeaway: YUBI offers advantages over UMI in versatility for complex bimanual tasks and dexterity, and the collected data directly transfer as policy supervision, offering the open community a reproducible path to large-scale data acquisition for robotic foundation models. 核心發現： YUBI 在複雜雙臂任務的多功能性和靈巧性上優於 UMI，收集的數據可直接作為策略監督遷移，為開源社區提供了大規模數據採集以開發機器人基礎模型的可重現路徑。

What Demonstration Curation Metrics Do to Your Policy

Authors: Aarav Bedi | Submitted: 2026-06-08 | arXiv: 2606.10229 Categories: cs.RO, cs.LG

Research Background: Demonstration-curation metrics are used to filter defective training episodes before training behavior-cloning policies, but it is unknown whether high defect-detection AUROC actually translates to better downstream policy performance. These metrics are often evaluated by detection accuracy alone, not by the policies they produce. 研究背景： 示範篩選指標用於在訓練行為複製策略之前過濾有缺陷的訓練回合，但尚不清楚高缺陷檢測 AUROC 是否真正轉化為更好的下游策略性能。這些指標通常僅通過檢測準確性評估，而非通過它們生成的策略。

Technical Approach: A controlled study on a contact-rich LIBERO pick-and-place benchmark with a structural defect (early gripper release during carry phase) compares seven curation metrics by both detection AUROC and resulting policy success rate. Episode length is identified as a confound exploited by five of seven metrics, inflating reported AUROCs. 技術方法： 在帶有結構性缺陷（搬運階段早期夾爪釋放）的接觸豐富 LIBERO 揀取放置基準上進行受控研究，通過檢測 AUROC 和最終策略成功率比較七種篩選指標。回合長度被識別為七種指標中五種利用的混淆因素，虛高了報告的 AUROC。

Key Takeaway: The metric with the highest defect-detection AUROC (0.804) produces the worst curated policy (13.3%), while a lower-AUROC metric (0.638) produces a policy nearly matching the oracle (90.0% vs. 93.3%), demonstrating that curation methods must be evaluated by policy performance, not detection accuracy. 核心發現： 具有最高缺陷檢測 AUROC（0.804）的指標生成最差的篩選策略（13.3%），而較低 AUROC 指標（0.638）生成的策略幾乎與神諭相匹配（90.0% 對 93.3%），表明篩選方法必須通過策略性能而非檢測準確性來評估。

Flow Control: Steering Vision-Language-Action Models with Simple Real-Time Inputs

Authors: Jonathan C. Kao, Jason Chan, Andy Wang | Submitted: 2026-06-08 | arXiv: 2606.10180 Categories: cs.RO, cs.AI, cs.HC

Research Background: VLA models are trained to act autonomously, but in practice users often need to steer robot actions in real time to correct course or adapt to changing situations. A method is needed that enables user-guided control without retraining the VLA or requiring specialized hardware. 研究背景： VLA 模型被訓練為自主行動，但在實踐中用戶通常需要實時引導機器人動作以糾正路線或適應變化的情況。需要一種能夠在不重新訓練 VLA 或需要特殊硬體的情況下實現用戶引導控制的方法。

Technical Approach: Flow control steers VLA actions by mapping generic real-time inputs (such as keyboard presses) into the VLA’s learned action distribution using the flow-matching structure of the policy. User inputs are treated as coarse guidance that the VLA transforms into high-quality action samples reflecting both the expert action distribution and the user’s intent. 技術方法： 流程控制利用策略的流匹配結構，將通用實時輸入（如鍵盤按鍵）映射到 VLA 學習的動作分布中，以引導 VLA 動作。用戶輸入被視為粗略指引，VLA 將其轉換為既反映專家動作分布又體現用戶意圖的高品質動作樣本。

Key Takeaway: Flow control accurately and responsively steers VLA robot actions, is robust to suboptimal user inputs, significantly improves task success rates and completion speeds, and fine-tuning on flow-control trajectories further improves the autonomous policy. 核心發現： 流程控制準確且響應靈敏地引導 VLA 機器人動作，對次優用戶輸入具有魯棒性，顯著提升任務成功率和完成速度，且在流程控制軌跡上微調還能進一步改善自主策略。

Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination

Authors: Jiajun Li, Tiecheng Guo, Yifan Ye et al. | Submitted: 2026-06-08 | arXiv: 2606.10040 Categories: cs.RO

Research Background: World-Action Models (WAMs) couple future visual prediction with action generation, but most rely on photorealistic prediction that incurs high inference latency, making real-time robot deployment difficult. A more efficient WAM design is needed that preserves control benefits without the cost of high-fidelity visual generation. 研究背景： 世界動作模型（WAMs）將未來視覺預測與動作生成耦合，但大多數依賴寫實預測，導致高推理延遲，使實時機器人部署困難。需要一種更高效的 WAM 設計，在不承擔高保真視覺生成成本的情況下保留控制優勢。

Technical Approach: Efficient-WAM reduces inference cost via a compact video expert transferred from WAN-2.2-5B, token-sparse video latents, and asymmetric video-action denoising that allocates fewer sampling steps to video than to actions. Future video prediction is treated as a compact guidance signal for action generation rather than a visual fidelity objective. 技術方法： Efficient-WAM 透過從 WAN-2.2-5B 遷移的緊湊視頻專家、標記稀疏視頻潛在量，以及向動作分配比視頻更多採樣步驟的不對稱視頻-動作去噪，降低推理成本。未來視頻預測被視為動作生成的緊湊指導信號，而非視覺保真度目標。

Key Takeaway: Efficient-WAM’s 1B-parameter model achieves around 100 ms per-chunk latency (30x speedup over existing WAMs) while maintaining competitive action performance on RoboTwin 2.0 and real-world tasks, despite visibly coarse future predictions. 核心發現： Efficient-WAM 的 10 億參數模型實現約 100 毫秒每塊延遲（比現有 WAM 快 30 倍），同時在 RoboTwin 2.0 和真實任務上保持競爭性動作性能，儘管未來預測明顯粗糙。

GHOST: Hierarchical Sub-Goal Policies for Generalizing Robot Manipulation

Authors: Sriram Krishna, Ben Eisner, Haotian Zhan et al. | Submitted: 2026-06-08 | arXiv: 2606.10025 Categories: cs.RO, cs.CV, cs.LG

Research Background: Visuomotor manipulation policies that generalize beyond training distribution remain a key challenge. Flat policies that directly map observations to actions lack the structural separation needed to incorporate diverse human demonstrations and adapt to novel objects and scene variations. 研究背景： 能夠泛化到訓練分布之外的視覺運動操作策略仍然是一個關鍵挑戰。直接將觀測映射到動作的平坦策略缺乏整合多樣化人類示範並適應新物體和場景變化所需的結構分離。

Technical Approach: GHOST factorizes control into a high-level policy predicting the next 3D end-effector sub-goal as a heatmap in the image plane, and a low-level goal-conditioned controller executing embodiment-specific actions. The spatial interface makes goals embodiment-agnostic, allowing the high-level policy to be trained on human video demonstrations while the low-level policy trains on robot data. 技術方法： GHOST 將控制分解為高層策略（將下一個 3D 末端執行器子目標預測為圖像平面中的熱圖）和低層目標條件控制器（執行特定機體的動作）。空間介面使目標與機體無關，允許高層策略在人類視頻示範上訓練，而低層策略在機器人數據上訓練。

Key Takeaway: GHOST consistently improves manipulation performance over flat Diffusion Policy, and its hierarchical interface enables adaptation to novel objects and task variations using a small number of human demonstrations without noisy action retargeting. 核心發現： GHOST 在操作性能上持續優於平坦擴散策略，其層次化介面使用少量人類示範即可適應新物體和任務變化，無需噪音的動作重新定向。

MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Models

Authors: Hao Shi, Weiye Li, Bin Xie et al. | Submitted: 2026-06-08 | arXiv: 2606.09827 Categories: cs.RO, cs.CV

Research Background: Most VLA models rely primarily on the current observation, limiting their performance on long-horizon temporally dependent tasks that require memory of past interactions and anticipation of future states — capabilities analogous to working memory, episodic memory, and mental simulation in human cognition. 研究背景： 大多數 VLA 模型主要依賴當前觀測，限制了其在需要過去互動記憶和未來狀態預期的長程時序依賴任務上的表現——這些能力類似於人類認知中的工作記憶、情節記憶和心智模擬。

Technical Approach: MemoryVLA++ equips VLA models with a Perceptual-Cognitive Memory Bank that stores low-level and high-level tokens from past interactions updated through redundancy-aware consolidation. A world model imagines future states in a denoising latent space, and the imagined latents are integrated under memory guidance to form temporal-aware tokens that condition a diffusion action expert. 技術方法： MemoryVLA++ 為 VLA 模型配備了感知-認知記憶庫，存儲通過冗余感知整合更新的過去互動的低層和高層標記。世界模型在去噪潛在空間中想象未來狀態，想象的潛在量在記憶指導下整合，形成時序感知標記，以條件化擴散動作專家。

Key Takeaway: MemoryVLA++ achieves strong performance across 5 simulation benchmarks and 3 real-robot categories, with +9%, +26%, +28% gains on general, memory-dependent, and imagination-dependent real-robot tasks respectively. 核心發現： MemoryVLA++ 在 5 個模擬基準和 3 個真實機器人類別中取得強勁性能，在通用、依賴記憶和依賴想象的真實機器人任務上分別提升 9%、26% 和 28%。

iMaC: Translating Actions into Motion and Contact Images for Embodied World Models

Authors: Zhenyu Wu, Xiuwei Xu, Yukun Zhou et al. | Submitted: 2026-06-08 | arXiv: 2606.09813 Categories: cs.RO, cs.CV

Research Background: Embodied world models conventionally use low-dimensional structured action vectors (joint angles, end-effector poses) as control interfaces, which suffer from limited expressive capacity, poor cross-embodiment generalization, and unnatural modeling of complex physical interactions. 研究背景： 具身世界模型通常使用低維結構化動作向量（關節角度、末端執行器姿態）作為控制介面，這些受到有限表達能力、跨機體泛化差和對複雜物理互動的不自然建模的限制。

Technical Approach: iMaC (Image as Action Control) treats raw visual images as native action representations. A dual-branch architecture comprises an image-action encoder compressing target-driven visual images into compact action embeddings, and a dynamic world predictor learning environment transition rules conditioned on image actions for future state prediction and closed-loop control. 技術方法： iMaC（圖像作為動作控制）將原始視覺圖像視為原生動作表示。雙分支架構包括圖像-動作編碼器（將目標驅動的視覺圖像壓縮為紧湊動作嵌入）和動態世界預測器（學習以圖像動作為條件的環境轉換規則，用於未來狀態預測和閉環控制）。

Key Takeaway: iMaC outperforms vector-based action control baselines in prediction accuracy, task success rate, and cross-scene generalization, while eliminating reliance on manually defined action spaces for universal control of heterogeneous embodied agents. 核心發現： iMaC 在預測準確性、任務成功率和跨場景泛化上優於基於向量的動作控制基準，同時消除了對手動定義動作空間的依賴，實現了異質具身智能體的通用控制。

AHA-WAM: Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing

Authors: Jisong Cai, Long Ling, Shiwei Chu et al. | Submitted: 2026-06-08 | arXiv: 2606.09811 Categories: cs.RO, cs.AI, cs.CV

Research Background: Current world-action models couple world prediction and action execution at the same temporal resolution, forcing the video branch to model near-term frame variations that are redundant and weakly informative for control. This temporal coupling underutilizes the potential of video branches for embodied control. 研究背景： 當前的世界動作模型在相同時序分辨率下耦合世界預測和動作執行，迫使視頻分支建模對控制冗余且信息量弱的近期幀變化。這種時序耦合低估了視頻分支對具身控制的潛力。

Technical Approach: AHA-WAM uses a dual DiT architecture with temporal asymmetry: a video DiT acts as a low-frequency world planner maintaining rolling key-value memory over past observations; a high-frequency action DiT executes short action chunks by querying this context through layerwise joint attention. Horizon-adaptive offset training and Observation-Guided Video-Context Routing (OVCR) support asynchronous execution. 技術方法： AHA-WAM 使用具有時序不對稱性的雙 DiT 架構：視頻 DiT 作為低頻世界規劃器，維護對過去觀測的滾動鍵值記憶；高頻動作 DiT 通過層次聯合注意力查詢此上下文執行短動作塊。時域自適應偏移訓練和觀測引導視頻上下文路由（OVCR）支持異步執行。

Key Takeaway: AHA-WAM achieves 92.80% average success on RoboTwin and 78.3% on four real-world tasks, with 24.17 Hz closed-loop control at 4.59x speedup over Fast-WAM, without any robot-data pretraining. 核心發現： AHA-WAM 在 RoboTwin 上達到 92.80% 平均成功率，在四個真實世界任務上達到 78.3%，閉環控制達 24.17 Hz，比 Fast-WAM 快 4.59 倍，且無需任何機器人數據預訓練。

SynManDex: Synthesizing Human-like Dexterous Grasps from Synthetic Human Pre-Grasps

Authors: Yanming Shao, Zanxin Chen, Wenwei Lin et al. | Submitted: 2026-06-08 | arXiv: 2606.09798 Categories: cs.RO

Research Background: Human hand-object interactions encode functional intent (how to hold and use objects), but directly transferring human grasps to robotic hands fails due to morphology, contact, and reachability differences. A method is needed to leverage human grasp affordances while generating robot-native, physically valid grasps. 研究背景： 人類手部-物體互動編碼了功能意圖（如何握持和使用物體），但由於形態、接觸和可達性差異，直接將人類抓取遷移到機器人手上會失敗。需要一種能利用人類抓取可供性同時生成機器人原生、物理有效抓取的方法。

Technical Approach: SynManDex samples object-conditioned digital human pre-grasps, retargets them to dexterous robotic hand poses, optimizes force-closure contacts on the target embodiment, and admits trajectories passing checks at each step. VLM agents design diverse prehensile manipulation tasks such as tea pouring and flute playing based on the keyframes. 技術方法： SynManDex 採樣物體條件的數字人類預抓取，將其重新定向到靈巧機器人手姿態，在目標機體上優化力封閉接觸，並接受通過每步檢查的軌跡。VLM 智能體根據關鍵幀設計多樣化的前抓取操作任務，如倒茶和演奏長笛。

Key Takeaway: SynManDex achieves 86.4% grasp stability, 4.67/5 human-likeness (93.4%), 80.7% simulation success, and 25/30 real-robot successes on a 36-DOF bimanual dexterous platform, demonstrating high grasp quality and naturalness simultaneously. 核心發現： SynManDex 達到 86.4% 的抓取穩定性、4.67/5 的人類相似度（93.4%）、80.7% 的模擬成功率，以及在 36 自由度雙臂靈巧平台上 25/30 的真實機器人成功率，同時展示了高抓取品質和自然性。

AetheRock: An Arm-Worn Robot Teaching System for Force-Guided Vision-Tactile Learning

Authors: Hong Li, Yue Xu, Yihan Tang et al. | Submitted: 2026-06-08 | arXiv: 2606.09777 Categories: cs.RO

Research Background: Force and tactile sensing are both essential for contact-rich robot manipulation, but existing handheld or wearable teaching devices suffer from incompatible assembly of tactile and force sensors, making simultaneous collection of vision, force, and tactile data difficult in practice. 研究背景： 力感和觸覺感測對於接觸豐富的機器人操作都至關重要，但現有的手持或可穿戴教學設備的觸覺和力感測器組裝不相容，使視覺、力和觸覺數據的同時收集在實踐中困難。

Technical Approach: AetheRock is an arm-worn device featuring a modular visuo-tactile sensor (GelSlim-MiniFab) at the fingertip, a resistive pressure sensor at the human finger contact region, a customized PCB module, and a wearable kit. The companion ForceVT framework uses force and vision to guide fidelity-agnostic tactile learning, enabling robust inference regardless of manufacturing inconsistencies in tactile sensors. 技術方法： AetheRock 是一種臂戴設備，在指尖配備模塊化視覺-觸覺感測器（GelSlim-MiniFab）、在人體手指接觸區域配備電阻壓力感測器、定制 PCB 模塊和可穿戴套件。配套的 ForceVT 框架使用力和視覺引導與保真度無關的觸覺學習，無論觸覺感測器的製造不一致性如何，均能實現鑒固的推斷。

Key Takeaway: AetheRock achieves qualified data collection efficiency, and ForceVT effectively alleviates inefficiencies caused by manufacturing and utilization inconsistencies in visuo-tactile sensors, advancing practical force-guided vision-tactile robot learning. 核心發現： AetheRock 實現了合格的數據收集效率，ForceVT 有效緩解了視覺-觸覺感測器製造和使用不一致性造成的低效，推進了實用的力引導視覺-觸覺機器人學習。

Difference-Aware Retrieval Policies for Imitation Learning

Authors: Quinn Pfeifer, Ethan Pronovost, Paarth Shah et al. | Submitted: 2026-06-08 | arXiv: 2606.09758 Categories: cs.RO, cs.AI, cs.LG

Research Background: Parametric behavior cloning suffers from poor generalization to out-of-distribution states due to compounding errors during deployment. Semi-parametric retrieval-based approaches that reuse training data at inference can alleviate this, but existing retrieval methods make direct state-to-action mappings that remain brittle. 研究背景： 參數化行為複製因部署期間的複合錯誤而在分布外狀態上泛化不佳。在推理時重用訓練數據的半參數檢索方法可以緩解這一問題，但現有檢索方法進行直接的狀態到動作映射仍然脆弱。

Technical Approach: DARP (Difference-Aware Retrieval Policies) reparameterizes imitation learning in terms of local neighborhood structure: a model predicts actions based on k-nearest neighbor expert demonstrations, their corresponding actions, and relative distance vectors between neighbor states and query states. No additional data collection, online expert feedback, or task-specific knowledge is required beyond standard behavior cloning assumptions. 技術方法： DARP（差異感知檢索策略）在局部鄰域結構方面重新參數化模仿學習：模型基於 k 近鄰專家示範、對應動作，以及鄰近狀態和查詢狀態之間的相對距離向量預測動作。除標準行為複製假設外，不需要額外的數據收集、在線專家反饋或任務特定知識。

Key Takeaway: DARP demonstrates consistent performance improvements of 15–46% over standard behavior cloning across diverse domains including continuous control and robotic manipulation, using various visual and state-based representations. 核心發現： DARP 在包括連續控制和機器人操作的多樣化領域中，使用各種視覺和狀態表示，在標準行為複製上始終提升 15-46% 的性能。

Your Model Already Knows: Attention-Guided Safety Filter for Vision-Language-Action Models

Authors: Seongbin Park, Fan Zhang, Baharan Mirzasoleiman et al. | Submitted: 2026-06-08 | arXiv: 2606.09749 Categories: cs.RO, cs.LG

Research Background: VLA models offer no guarantees against collisions with task-irrelevant objects. Existing safety filters query external VLMs to identify obstacles, which is too slow for the control loop and can only run at episode initialization — leaving them unable to track moving obstacles. 研究背景： VLA 模型不能保證不與無關任務的物體發生碰撞。現有的安全過濾器查詢外部 VLM 識別障礙物，這對控制循環來說太慢，且只能在回合初始化時運行——使其無法追蹤移動的障礙物。

Technical Approach: A small number of attention heads within a VLA model reliably localize the object the policy intends to approach. A training-free safety framework exploits these heads to identify the active target at every step, treats the rest of the scene as obstacles, and feeds them into a Control Barrier Function (CBF) filter combined with a lightweight real-time object tracker. 技術方法： VLA 模型中少量注意力頭可可靠地定位策略意圖接近的物體。一種免訓練安全框架在每步利用這些頭識別主動目標，將場景其餘部分視為障礙物，並將其輸入結合輕量實時物體追蹤器的控制屏障函數（CBF）過濾器。

Key Takeaway: On dynamic obstacle scenarios, the method substantially outperforms oracle-based init-time VLM identification by 43% on average, demonstrating that VLA attention already contains the perceptual signals needed for real-time safety filtering. 核心發現： 在動態障礙物場景中，該方法平均超越基於神諭初始化時間 VLM 識別 43%，表明 VLA 注意力已包含實時安全過濾所需的感知信號。

ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Models

Authors: Fan Zhang, Seongbin Park, Baharan Mirzasoleiman et al. | Submitted: 2026-06-08 | arXiv: 2606.09740 Categories: cs.RO

Research Background: VLA models are brittle to perturbations such as lighting changes, altered camera viewpoints, and initial-state variations — common in real-world deployment. There is a need for training-free runtime interventions that detect and recover from failures without modifying policy weights or collecting additional demonstrations. 研究背景： VLA 模型對光照變化、攝影機視角改變和初始狀態變化等干擾脆弱——這在真實世界部署中很常見。需要能夠在不修改策略權重或收集額外示範的情況下，無訓練地在運行時偵測和恢復失敗。

Technical Approach: ProbeAct combines three components: a multi-target hidden-state probe predicting 3D positions of task-relevant objects from intermediate VLA features; an object-agnostic kinematic state machine detecting grasping, transport, and placement failures using only gripper-internal signals and kinematics; and a hierarchical CBF filter encoding repeated-failure locations as soft safe-set constraints that minimally correct VLA actions. 技術方法： ProbeAct 結合三個組件：從中間 VLA 特徵預測任務相關物體 3D 位置的多目標隱藏狀態探針；僅使用夾爪內部信號和運動學偵測抓取、搬運和放置失敗的與物體無關的運動學狀態機；以及將重複失敗位置編碼為軟安全集約束以最小程度校正 VLA 動作的層次 CBF 過濾器。

Key Takeaway: ProbeAct improves the success rate of OpenVLA-OFT from 69.6% to 74.1% on LIBERO-plus as a training-free plug-and-play intervention loop, demonstrating broad applicability to both base and fine-tuned VLA policies. 核心發現： ProbeAct 將 OpenVLA-OFT 在 LIBERO-plus 上的成功率從 69.6% 提升到 74.1%，作為免訓練的即插即用干預循環，展示了對基礎和微調 VLA 策略的廣泛適用性。

ReCoVLA: VLM-Guided Reward Compilation for Failure Recovery in Vision-Language-Action Policies

Authors: Haodi Hu, Chung-Ta Huang, Jing Liu et al. | Submitted: 2026-06-08 | arXiv: 2606.09630 Categories: cs.RO, cs.AI, cs.LG

Research Background: VLA policies provide strong priors for language-conditioned manipulation but remain brittle in off-nominal states requiring targeted recovery. Existing approaches either require the VLA to generate actions directly (limiting quality) or use VLMs to generate rewards (which can be poorly calibrated for low-level control). 研究背景： VLA 策略為語言條件操作提供了強大的先驗，但在需要針對性恢復的非正常狀態下仍然脆弱。現有方法要么要求 VLA 直接生成動作（限制品質），要么使用 VLM 生成獎勵（對低層控制可能校準不佳）。

Technical Approach: ReCoVLA keeps the pretrained VLA frozen, uses an external VLM as a semantic reward selector to infer the failure mode and recovery stage, and compiles a structured reward from task-relevant components via a reward mask. Residual recovery policies are trained in simulation from this compiled reward, then deployed zero-shot to the real robot. 技術方法： ReCoVLA 保持預訓練 VLA 凍結，使用外部 VLM 作為語義獎勵選擇器推斷失敗模式和恢復階段，並通過獎勵掩碼從任務相關組件編譯結構化獎勵。殘差恢復策略從此編譯獎勵在模擬中訓練，然後零樣本部署到真實機器人。

Key Takeaway: ReCoVLA improves simulation recovery success from 36.7% to 66.7% and achieves 61.7% zero-shot real-world success, demonstrating that semantic failure diagnosis decoupled from low-level corrective control is an effective recipe for VLA failure recovery. 核心發現： ReCoVLA 將模擬恢復成功率從 36.7% 提升到 66.7%，並實現 61.7% 的零樣本真實世界成功，表明從低層校正控制中解耦的語義失敗診斷是 VLA 失敗恢復的有效方案。

DexPIE: Stable Dexterous Policy Improvement from Real-World Experience

Authors: Ruizhe Liao, Wenrui Chen, Liangji Zeng et al. | Submitted: 2026-06-08 | arXiv: 2606.09615 Categories: cs.RO, cs.CV

Research Background: Dexterous manipulation policies trained purely from demonstrations suffer from compounding errors during deployment and require large amounts of expert data. Post-training improvement from real-world deployment experience can address these limitations, but data quality and temporal consistency challenges make this difficult in practice. 研究背景： 純粹從示範訓練的靈巧操作策略在部署期間遭受複合錯誤，且需要大量專家數據。從真實世界部署經驗進行後訓練改進可以解決這些限制，但數據品質和時序一致性挑戰使這在實踐中困難。

Technical Approach: DexPIE enables exploration coverage via a dexterous-hand-adapted intervention system and multi-stage DAgger-style data collection. Asynchronous inference in relative action space reduces temporal noise between post-training rollouts and demonstration data, allowing critics to learn better value functions. Policy improvement is conditioned on a continuous optimality indicator leveraging data quality in a fine-grained manner. 技術方法： DexPIE 透過靈巧手適配的干預系統和多階段 DAgger 式數據收集實現探索覆蓋。相對動作空間中的異步推斷減少後訓練推演和示範數據之間的時序噪音，允許評論器學習更好的價值函數。策略改進以持續最優性指標為條件，以細粒度方式利用數據品質。

Key Takeaway: DexPIE achieves a 37% improvement in success rate over the demonstration-based reference policy across three challenging real-world dexterous manipulation tasks, outperforming all baseline methods. 核心發現： DexPIE 在三個具有挑戰性的真實世界靈巧操作任務中，相比基於示範的參考策略實現 37% 的成功率提升，優於所有基準方法。

CT-VAM: A Cerebello-Thalamic-Inspired Vision-Action Model for Efficient Visuomotor Control

Authors: Jiacheng Li, Yize Guo, Jiabin Guo et al. | Submitted: 2026-06-08 | arXiv: 2606.09572 Categories: cs.RO, cs.AI

Research Background: VLA models repeatedly process language instructions at each control step despite language being primarily needed to specify task intent rather than for high-frequency execution. This inflates model size and inference cost, making efficient local visuomotor control with cloud-edge deployment impractical. 研究背景： VLA 模型在每個控制步驟重複處理語言指令，儘管語言主要用於指定任務意圖而非高頻執行。這增加了模型大小和推理成本，使帶有雲端-邊緣部署的高效局部視覺運動控制不切實際。

Technical Approach: CT-VAM is a compact local execution policy predicting action chunks from dual-view visual observations, proprioception, and a lightweight task condition. TARS (Thalamic Action Routing Stream), a stream-separated conditional attention decoder, independently routes action, visual, and task streams to prevent dense sensory tokens from overwhelming compact task conditions. With only 68M parameters, it enables a practical cloud-edge paradigm. 技術方法： CT-VAM 是一種緊湊的局部執行策略，從雙視角視覺觀測、本體感知和輕量任務條件預測動作塊。TARS（丘腦動作路由流），一種流分離條件注意力解碼器，獨立路由動作、視覺和任務流，防止密集感測標記淹沒緊湊任務條件。僅有 6800 萬參數，支持實際的雲端-邊緣範式。

Key Takeaway: CT-VAM achieves LIBERO success rates competitive with substantially larger VLA models while reducing inference latency, and demonstrates robust real-world deployment on resource-constrained robotic platforms. 核心發現： CT-VAM 達到與大得多的 VLA 模型相當的 LIBERO 成功率，同時降低推理延遲，並在資源受限的機器人平台上展示魯棒的真實世界部署。

Goal Sets, Not Goal States: Queryable Robot Goals through Goal-Set Hindsight Relabeling

Authors: Carlos Velez Garcia, Miguel Cazorla, Jorge Pomares | Submitted: 2026-06-08 | arXiv: 2606.09476 Categories: cs.RO

Research Background: Hindsight Experience Replay (HER) relabels achieved future states as exact goals, which overconstrains offline robot learning when task success depends only on a subset of state variables. This prevents flexible goal specification and reuse of learned policies across semantically related but differently specified goals. 研究背景： 後見之明經驗回放（HER）將實現的未來狀態重新標記為精確目標，當任務成功只取決於狀態變量的子集時，這過度約束了離線機器人學習。這阻礙了靈活的目標規格和跨語義相關但規格不同目標的學習策略重用。

Technical Approach: Goal-Set Hindsight Relabeling (GS-HER) generalizes HER to predicate-level goal sets where a binary query specifies which variables define success. Achieved states certify query-defined goal sets rather than singleton states, making the goal predicate an inference-time input while leaving the underlying offline goal-conditioned RL algorithm unchanged. 技術方法： 目標集後見之明重標記（GS-HER）將 HER 推廣到謂詞層級目標集，其中二進制查詢指定哪些變量定義成功。已實現的狀態認定查詢定義的目標集而非單一狀態，使目標謂詞成為推理時輸入，同時保持底層離線目標條件 RL 算法不變。

Key Takeaway: GS-HER improves performance when full-state goals are bottlenecked by nuisance dimensions, and turns hindsight relabeling into a reusable goal interface — one checkpoint can answer multiple robot goal predicates without retraining. 核心發現： 當全狀態目標受無關維度瓶頸約束時，GS-HER 提升性能，並將後見之明重標記轉化為可重用的目標介面——單一檢查點可以在不重新訓練的情況下回應多個機器人目標謂詞。

omega-EVA: Envision, Verify, and Act with Latent Interactive World Models

Authors: Zhenguo Sun, Yu Sun, Hande Huang et al. | Submitted: 2026-06-08 | arXiv: 2606.09457 Categories: cs.RO

Research Background: Embodied policies typically map observations directly to actions without explicitly inspecting the consequences of candidate actions before committing. World models can provide predictive supervision but rarely let a policy examine what would happen if it executed a proposed action before acting. 研究背景： 具身策略通常在承諾前將觀測直接映射到動作，而不明確檢查候選動作的後果。世界模型可以提供預測性監督，但很少讓策略在行動前檢查執行建議動作會發生什麼。

Technical Approach: omega-EVA implements an Envision-Verify-Act loop using a latent interactive world model. The framework learns action-conditioned latent dynamics, trains a flow policy on dynamics-aware visual representations, and feeds the policy’s proposal back through the world model. A tri-branch refiner jointly reasons over current state, proposal-conditioned future, and proposed action to produce the final action chunk — all in latent feature space. 技術方法： omega-EVA 使用潛在互動世界模型實現預想-驗證-行動循環。框架學習動作條件的潛在動態，在動態感知視覺表示上訓練流程策略，並將策略的提案反饋回世界模型。三分支精煉器在當前狀態、提案條件未來和提案動作上聯合推理以產生最終動作塊——全部在潛在特徵空間中。

Key Takeaway: With approximately 1.2B parameters and no additional robot-data pretraining, omega-EVA demonstrates a compact and competitive performance-scale-data tradeoff, confirming that consequence reasoning in latent space improves action proposals across diverse manipulation settings. 核心發現： 約 12 億參數且無額外機器人數據預訓練，omega-EVA 展示了緊湊且競爭性的性能-規模-數據權衡，確認潛在空間中的後果推理在多樣化操作設定中改善動作提案。

Dense Force Estimation with an Event-based Optical Tactile Sensor

Authors: Agis Politis, Rene Zurbrugg, Valentina Cavinato | Submitted: 2026-06-08 | arXiv: 2606.09451 Categories: cs.RO, cs.CV, cs.LG

Research Background: Dense spatially-resolved tactile force feedback at high temporal resolution is crucial for dexterous manipulation, but vision-based tactile sensors are limited by camera frame rates and motion blur. Event-based optical tactile sensors offer microsecond temporal resolution but have been restricted to predicting only net forces, not dense force fields. 研究背景： 高時序分辨率下密集的空間分辨觸覺力反饋對靈巧操作至關重要，但基於視覺的觸覺感測器受攝影機幀率和運動模糊限制。基於事件的光學觸覺感測器提供微秒級時序分辨率，但一直局限於只預測淨力，而非密集力場。

Technical Approach: The first framework for dense 3D force field reconstruction using event-based optical tactile sensors is presented. Shear displacements are recovered through an event-based marker tracking algorithm, while normal displacements are predicted by a CNN trained on synchronized force-displacement-event data. Forces are then estimated via inverse Finite Elements Method (iFEM). 技術方法： 提出第一個使用基於事件的光學觸覺感測器進行密集 3D 力場重建的框架。剪切位移通過基於事件的標記追蹤算法恢復，而法向位移由在同步力-位移-事件數據上訓練的 CNN 預測。然後通過逆有限元方法（iFEM）估計力。

Key Takeaway: The framework achieves mean absolute error of (0.14 N, 0.10 N, 0.93 N) over force ranges up to (4 N, 4 N, 20 N) at 100 Hz, constituting the first step toward dense force feedback for high-frequency dexterous manipulation control. 核心發現： 框架在最大 (4 N, 4 N, 20 N) 的力範圍下以 100 Hz 實現 (0.14 N, 0.10 N, 0.93 N) 的平均絕對誤差，是邁向高頻靈巧操作控制密集力反饋的第一步。

MASK: Multi-Agent Semantic K-Scheduling for Risk-Sensitive 6G Robotics

Authors: Ahmet Gunhan Aydin, Elif Tugce Ceran | Submitted: 2026-06-08 | arXiv: 2606.11249 Categories: cs.RO, cs.LG, cs.MA

Research Background: 6G connected robotics requires reconciling high-performance collaborative control with strict spectral limitations. In realistic multi-robot sensing scenarios, physical resource blocks are finite, making simultaneous transmission by all agents infeasible and necessitating principled scheduling under bandwidth constraints. 研究背景： 6G 連接機器人需要在高性能協作控制與嚴格頻譜限制之間取得平衡。在現實的多機器人感測場景中，物理資源塊有限，使所有智能體同時傳輸不可行，需要在頻寬約束下進行有原則的調度。

Technical Approach: MASK proposes Arbiter-Assisted Semantic Information Gating (A-SIG), a lightweight coordination mechanism enforcing hard bandwidth constraints by scheduling only the top-K agents based on locally computed semantic importance scores. Prioritized observations are aggregated into a compact latent state by a self-supervised global encoder, enabling a distributional policy to mitigate tail risks despite data sparsity. 技術方法： MASK 提出仲裁者輔助語義信息門控（A-SIG），一種通過基於本地計算語義重要性分數只調度前 K 個智能體來強制執行硬頻寬約束的輕量協調機制。優先觀測被自監督全局編碼器聚合為緊湊潛在狀態，使分布策略能夠在數據稀疏的情況下緩解尾部風險。

Key Takeaway: MASK matches the performance of communication-unconstrained baselines even when channel access is restricted to a small fraction of the swarm size, and exhibits inherent resilience to packet erasures, validating semantic scheduling for resource-constrained 6G robotics. 核心發現： 即使在信道訪問被限制為群體規模的小比例時，MASK 也與無通信約束的基準性能相匹配，並表現出對數據包丟失的固有韌性，驗證了語義調度在資源受限 6G 機器人技術中的有效性。

ReGIL: Retrieval-Guided Imitation Learning from a Single Demonstration

Authors: Yuying Zhang, Francesco Verdoja, Wenyan Yang et al. | Submitted: 2026-06-08 | arXiv: 2606.09381 Categories: cs.RO

Research Background: Learning robot manipulation from a single demonstration is extremely challenging: even small deviations compound into failures, while collecting substantial online interaction data is costly. Existing single-demonstration methods provide only static supervision, limiting policy improvement. 研究背景： 從單一示範學習機器人操作極具挑戰性：即使是微小偏差也會複合成失敗，而收集大量在線互動數據成本高昂。現有的單示範方法只提供靜態監督，限制了策略改進。

Technical Approach: ReGIL treats a single demonstration as external memory, repeatedly querying it throughout training to simultaneously guide exploration, generate a regularization buffer, and construct rewards. Rewards are computed through local temporal alignment between the current trajectory and retrieved demonstration segments, providing step-wise and informative feedback for policy improvement. 技術方法： ReGIL 將單一示範視為外部記憶，在訓練過程中反復查詢以同時引導探索、生成正則化緩衝區並構建獎勵。獎勵通過當前軌跡和檢索的示範片段之間的局部時序對齊計算，為策略改進提供逐步且信息豐富的反饋。

Key Takeaway: ReGIL outperforms prior baselines on LIBERO and Meta-World in the single-demonstration setting, and achieves over 75% success on three real-robot tasks with randomized poses using only one demonstration and less than one hour of online training. 核心發現： ReGIL 在單一示範設定下在 LIBERO 和 Meta-World 上優於先前基準，並使用僅一個示範和不到一小時的在線訓練，在具有隨機化姿態的三個真實機器人任務上達到超過 75% 的成功率。

TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulation

Authors: Huaihang Zheng, Yi Yang, Kai Ma et al. | Submitted: 2026-06-08 | arXiv: 2606.09337 Categories: cs.RO

Research Background: VLA models with tactile feedback have improved contact-rich manipulation, but are typically deployed as offline policies. When contact conditions shift from the training distribution, offline policies cannot adapt online — leading to inappropriate contact forces, inefficient retries, and task failures. 研究背景： 帶有觸覺反饋的 VLA 模型改善了接觸豐富的操作，但通常作為離線策略部署。當接觸條件偏離訓練分布時，離線策略無法在線適應——導致不適當的接觸力、低效的重試和任務失敗。

Technical Approach: TORL-VLA couples tactile feedback with online policy refinement: a tactile-derived wrench-aware VLA predicts reference actions and future wrench sequences, while a lightweight online RL module refines the reference actions. An intervention-censored critic prevents post-intervention successes from being wrongly credited to policy-generated actions preceding intervention. 技術方法： TORL-VLA 將觸覺反饋與在線策略精煉耦合：觸覺衍生的力矩感知 VLA 預測參考動作和未來力矩序列，而輕量在線強化學習模塊精煉參考動作。干預審查評論器防止干預後的成功被錯誤地歸功於干預前的策略生成動作。

Key Takeaway: TORL-VLA improves success rates at both subtask and full-task levels across long-horizon contact-rich tasks including latch manipulation, coffee-cup placement, and egg handling, demonstrating effective online adaptation to shifted contact conditions. 核心發現： TORL-VLA 在長程接觸豐富任務（包括門閂操作、咖啡杯放置和雞蛋處理）的子任務和完整任務層級上均提升成功率，展示對接觸條件偏移的有效在線適應。

KPGrasp: Scalable Keypoint Flow Matching for Dexterous Grasp Generation

Authors: Yuansen Huang, Jiayi Chen, Haoran Liu et al. | Submitted: 2026-06-08 | arXiv: 2606.09314 Categories: cs.RO

Research Background: Generating high-quality dexterous grasps with learning-based methods is challenging because existing approaches depend on carefully tuned contact losses or expensive contact-based test-time refinement. A scalable alternative that learns directly from large-scale data without contact loss engineering is needed. 研究背景： 使用基於學習的方法生成高品質靈巧抓取具有挑戰性，因為現有方法依賴精心調整的接觸損失或昂貴的基於接觸的測試時精煉。需要一種可直接從大規模數據學習而無需接觸損失工程的可擴展替代方案。

Technical Approach: KPGrasp couples an all-Euclidean 3D hand-keypoint parameterization with a simple Transformer flow model trained with standard flow-matching loss. The all-Euclidean parameterization expresses grasps in the same frame as the object point cloud, enabling native spatial reasoning and avoiding drawbacks of mixed SE(3) action spaces. The model scales effectively with data, capacity, and batch size. 技術方法： KPGrasp 將全歐幾里得 3D 手部關鍵點參數化與標準流匹配損失訓練的簡單 Transformer 流程模型耦合。全歐幾里得參數化在與物體點雲相同的坐標系中表達抓取，實現原生空間推理並避免混合 SE(3) 動作空間的缺點。模型在數據、容量和批量大小方面有效擴展。

Key Takeaway: KPGrasp reaches 76.3% grasp success rate on the Dexonomy benchmark (47.4% improvement over the strongest comparable baseline), achieves the best average performance on DexGrasp Anything without fine-tuning, and requires only 0.032 s per grasp for batched inference. 核心發現： KPGrasp 在 Dexonomy 基準上達到 76.3% 的抓取成功率（比最強可比基準提升 47.4%），在 DexGrasp Anything 上無微調即達最佳平均性能，批量推理每次抓取僅需 0.032 秒。

VAIC: Vision-Guided Humanoid Agile Object Interaction Control via Decoupled Commands

Authors: Dongting Li, Qianyang Wu, Xingyu Chen et al. | Submitted: 2026-06-08 | arXiv: 2606.09286 Categories: cs.RO

Research Background: Humanoid robots have great potential for real-world assistance, but agile interaction with objects in unstructured environments demands tightly coupled whole-body coordination. Current controllers rely on dense reference trajectories and perfect state observability, fundamentally limiting physical generalization to novel scenarios. 研究背景： 人形機器人在真實世界輔助方面具有巨大潛力，但在非結構化環境中與物體進行敏捷互動需要緊密耦合的全身協調。當前的控制器依賴密集的參考軌跡和完美的狀態可觀察性，從根本上限制了對新場景的物理泛化。

Technical Approach: VAIC (Vision-guided Agile Interaction Control) employs a two-stage distillation paradigm operating exclusively on onboard depth, historical proprioception, and decoupled user commands. A privileged teacher policy masters interaction skills with full state access, then a deployable student policy replaces full body tracking with velocity targets and an interaction indicator. A recurrent object adaptation module implicitly infers unobservable object dynamics from raw depth and proprioception. 技術方法： VAIC（視覺引導靈活互動控制）採用兩階段蒸餾範式，僅在車載深度、歷史本體感知和解耦用戶命令上運作。特權教師策略通過完整狀態訪問掌握互動技能，然後可部署的學生策略將全身追蹤替換為速度目標和互動指示器。遞歸物體適應模塊從原始深度和本體感知隱式推斷不可觀察的物體動力學。

Key Takeaway: A single VAIC policy successfully executes highly diverse dynamic tasks — box carrying, cart interaction, and skateboarding — on a real humanoid robot, consistently outperforming baselines and advancing autonomous humanoid deployment in unstructured environments. 核心發現： 單一 VAIC 策略在真實人形機器人上成功執行高度多樣化的動態任務——搬箱子、推車互動和滑板——持續優於基準方法，推進了人形機器人在非結構化環境中的自主部署。

Explorer

arXiv Digest — 2026-W25

arXiv Weekly Digest — Week 25, 2026

Graph View

Table of Contents

Backlinks