arXiv Weekly Digest — Week 31, 2026
Fetched: 2026-07-27 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 20
One Hand Watches The Other: Dynamic Multi-Agent Cooperation for Sample-Efficient Bimanual Manipulation in Dynamic Environments
Authors: Jan Ole von Hartz, Abhinav Valada, Joschka Boedecker | Submitted: 2026-07-24 | arXiv: 2607.22119
Categories: cs.RO, cs.AI, cs.LG
Research Background: Multi-stream manipulation policies gain sample efficiency by modeling actions relative to environmental reference frames, but the standard assumption that these frames are strictly exogenous breaks down in bimanual coordination and dynamic object manipulation, where each arm is itself a moving part of the other arm’s environment. 研究背景： 多流策略透過相對環境參考幀建模動作來提升樣本效率，但在雙臂協作與動態物體操作中，「參考幀嚴格外生」的假設失效——每隻手臂本身就是另一隻手臂動態環境的一部分。
Technical Approach: DynaMAC treats the opposite arm as a dynamic task parameter within a lightweight, policy-agnostic framework, providing a unified formulation for both single-arm dynamic manipulation and bimanual coordination without requiring an explicit leader-follower role assignment; DynaBench is introduced as a new benchmark suite to evaluate these capabilities. 技術方法： DynaMAC 將對側手臂視為動態任務參數，在輕量、無策略依賴的框架中統一表述單臂動態操作與雙臂協調，無需顯式指定主從關係；並引入 DynaBench 作為評估此能力的新基準套件。
Key Takeaway: DynaMAC outperforms probabilistic and generative baselines by over 35 percentage points while requiring 20× fewer demonstrations, and generalizes zero-shot from static demonstrations to dynamic environments — a critical step toward practical human-robot collaboration. 核心發現： DynaMAC 以超過 35 個百分點優於概率與生成基線，且所需演示量僅為其 1/20，並可從靜態演示零樣本泛化至動態環境，是邁向實用人機協作的關鍵一步。
Robot-Factored World Models via Robot Rendering
Authors: Byungjun Kim, Taeksoo Kim, Hyunsoo Cha et al. | Submitted: 2026-07-24 | arXiv: 2607.22535
Categories: cs.RO, cs.CV
Research Background: Action-conditioned video world models must bridge the gap between abstract action commands and their visual consequences; conditioning directly on raw actions forces the model to learn robot kinematics internally, while conditioning on logged future states leaks ground-truth outcomes — both undermining generalization. 研究背景： 動作條件化視頻世界模型需銜接抽象動作指令與其視覺結果；直接以原始動作為條件迫使模型內部學習機器人運動學，而以未來狀態為條件則洩露真實結果，兩者均損害泛化能力。
Technical Approach: Robot-factored world models externalize two robot-specific factors: action realization (rolling commands through the robot’s controller and kinematics to a nominal trajectory) and robot rendering (compositing the trajectory via the robot’s URDF into the image, paired with end-effector depth for geometric grounding); the remaining model only needs to predict how objects respond to visible robot geometry. 技術方法： 機器人分解世界模型將兩個機器人特有因素外顯化：動作實現（透過控制器與運動學將指令展開為標稱軌跡）和機器人渲染（經 URDF 將軌跡合成至圖像，並配合末端執行器深度提供幾何錨定）；剩餘模型只需預測物體對可見機器人幾何體的反應。
Key Takeaway: The rendered robot interface outperforms vector-conditioned baselines and generalizes to unseen embodiments at inference, and can generate manipulation videos by retargeting and rendering human hand demonstrations as robot geometry. 核心發現： 渲染機器人介面優於向量條件基線，並可泛化至推理時的未見具身形態，且能將人手演示重定向並渲染為機器人幾何體，生成操作影片。
Scale Up Strategically: Learning Compositional Generalization via Bias-Aware Evaluation and Data Collection for Robotic Manipulation
Authors: Yu Qi, Zhang Ye, Xinyi Xu et al. | Submitted: 2026-07-23 | arXiv: 2607.21582
Categories: cs.RO, cs.CV
Research Background: Pretrained manipulation policies are known to take shortcuts by over-relying on salient instruction factors (e.g., object color) rather than grounding all semantic components (verb, size, spatial), causing failure on novel compositional instructions. 研究背景： 預訓練操作策略傾向依賴顯著指令因素（如物體顏色）走捷徑，而非對所有語義成分（動詞、大小、空間）充分接地，導致在新穎組合指令上失敗。
Technical Approach: A diagnostic framework formalizes instruction-factor bias via two metrics — Factor Dominance Rate (FDR, capturing pairwise bias) and Factor Dominance Hierarchy (FDH, a global rank) — and evaluates six foundation policies, revealing a consistent ordering (color ≥ object ≥ spatial ≥ verb ≥ size). A bias-aware data collection strategy then reallocates the demonstration budget toward under-grounded factors. 技術方法： 診斷框架透過兩項指標形式化指令因素偏差——因素主導率（FDR，捕捉成對偏差）和因素主導層級（FDH，全局排名）——並評估六種基礎策略，揭示一致排序（顏色 ≥ 物體 ≥ 空間 ≥ 動詞 ≥ 大小）。偏差感知資料收集策略將演示預算重新分配至接地不足的因素。
Key Takeaway: Bias-aware data collection using only half the demonstrations outperforms standard baselines in both simulation and real robot settings, showing that knowing where to collect data matters as much as how much data is collected. 核心發現： 僅使用一半演示量的偏差感知資料收集在模擬與真實機器人環境中均優於標準基線，顯示「在哪裡收集資料」與「收集多少資料」同樣重要。
PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics
Authors: Haocheng Yin, Shuohan Tao, Yongsheng Chen et al. | Submitted: 2026-07-22 | arXiv: 2607.20653
Categories: cs.RO, cs.CV, cs.LG
Research Background: Predicting how deformable objects evolve under robot manipulation is critical for planning-based manipulation; per-object optimization of physics parameters is slow and non-generalizable, while purely learned models violate physical structure and extrapolate poorly. 研究背景： 預測可形變物體在機器人操作下的演化對基於規劃的操作至關重要；逐物體物理參數優化速度慢且難以泛化，而純學習模型則違反物理結構且外推能力差。
Technical Approach: PhysCoRe couples a differentiable Material Point Method (MPM) simulator with two feed-forward networks: Material from Motion (MfM) infers per-particle elasticity from visual observations to ground the simulator in object-specific physics, while Residual from Dynamics (RfD) predicts corrections to the simulator’s internal state to absorb systematic biases the analytical model cannot capture. Predictive uncertainty from MfM steers online exploration toward least-confident geometry. 技術方法： PhysCoRe 將可微物質點方法（MPM）模擬器與兩個前饋網路耦合：運動推材料（MfM）從視覺觀察推斷每粒子彈性，為模擬器提供物體特定物理錨定；動力學推殘差（RfD）預測模擬器內部狀態的修正，吸收解析模型無法捕捉的系統性偏差。MfM 的預測不確定性引導線上探索至置信度最低的幾何區域。
Key Takeaway: PhysCoRe outperforms state-of-the-art baselines in deformable object prediction accuracy on real manipulation sequences, and its predicted confidence provides a natural signal for curiosity-driven data collection. 核心發現： PhysCoRe 在真實操作序列的可形變物體預測精度上優於最先進基線，且其預測置信度為好奇心驅動的資料收集提供了自然信號。
KineBench: Benchmarking Embodied World Models via IDM-Free Kinematic Grounding
Authors: Zeyu Liu, Zhangzhe Zhu, Yang Zhang et al. | Submitted: 2026-07-22 | arXiv: 2607.19876
Categories: cs.RO, cs.CV
Research Background: Closed-loop evaluation of embodied world models (EWMs) via simulator rollouts is the gold standard, but almost all frameworks use learned Inverse Dynamics Models (IDMs) to extract actions from generated videos — introducing attribution ambiguity when IDMs fail on out-of-distribution generated content. 研究背景： 透過模擬器展開的閉環評估是具身世界模型（EWM）的金標準，但幾乎所有框架都使用學習的逆動力學模型（IDM）從生成影片中提取動作——當 IDM 在分布外的生成內容上失敗時，引入歸因歧義。
Technical Approach: KineBench bypasses IDMs with an explicit kinematic grounding pipeline: cascaded visual foundation models extract 6D end-effector poses from individual video frames, which are then executed in a physics simulator. Beyond task success, it adds two classical 3D kinematic metrics (SPARC for trajectory smoothness, Maruyama Manipulability Index for kinematic feasibility) across 20 manipulation tasks in ManiSkill3 spanning four progressive evaluation suites. 技術方法： KineBench 透過顯式運動學接地管線繞過 IDM：級聯視覺基礎模型從各幀影片中提取 6D 末端執行器姿態，再於物理模擬器中執行。除任務成功率外，還增加兩項經典 3D 運動學指標（SPARC 軌跡平滑度、丸山可操縱性指數），跨 ManiSkill3 中 20 項操作任務設立四個遞進評估套件。
Key Takeaway: Frontier EWMs show task-complexity-bounded nonlinear scaling across the four evaluation suites, with IDM-free grounding revealing systematic failure modes that were previously hidden by extractor noise. 核心發現： 前沿 EWM 在四個評估套件中表現出受任務複雜度限制的非線性規模效應，而無 IDM 的接地方式揭示了先前被提取器雜訊掩蓋的系統性失敗模式。
GS-Agent: Creating 4D Physical Worlds With Generative Simulation
Authors: Hongxin Zhang, Chunru Lin, Junyan Li et al. | Submitted: 2026-07-23 | arXiv: 2607.21522
Categories: cs.RO, cs.AI, cs.CL, cs.CV
Research Background: Generating dynamic, physically realistic 4D worlds from natural language is essential for synthetic data generation and robot training environments, but existing generative approaches struggle with physical plausibility and controllability across diverse object interactions. 研究背景： 從自然語言生成動態、物理真實的 4D 世界對合成資料生成和機器人訓練環境至關重要，但現有生成方法在多樣物體交互的物理合理性和可控性上仍有不足。
Technical Approach: GS-Agent is an end-to-end multi-agent framework that places physics engines in the loop. Inspired by human 4D world creation, it decomposes the task into entity management (3D asset curation, material tuning, placement, motion control) and rendering configuration (camera, lighting). Agents with distinct expertise interact with a physics engine via code, receive multimodal feedback, and iteratively construct scenes from natural language descriptions using 3D Gaussian Splatting as the representation. 技術方法： GS-Agent 是一個將物理引擎置於回路中的端到端多智能體框架，受人類 4D 世界創建啟發，將任務分解為實體管理（3D 資產策展、材料調整、放置、運動控制）和渲染配置（攝像機、燈光）。具有不同專長的智能體透過代碼與物理引擎交互，接收多模態反饋，並使用 3D 高斯潑灑作為表示，從自然語言描述迭代構建場景。
Key Takeaway: GS-Agent generates diverse, physically plausible 4D worlds with rich interactions among liquids, deformable objects, and rigid bodies from natural language, offering a compelling approach to automated simulation environment creation for physical AI. 核心發現： GS-Agent 從自然語言生成包含液體、可形變物體和剛體豐富交互的多樣、物理合理的 4D 世界，為物理 AI 自動化模擬環境創建提供了有力方案。
NavVerse: Benchmarking Indoor-to-Outdoor Embodied Navigation in Continuous Robot Simulation
Authors: Junzhe Wu, Yue Hu, Zeyu Han et al. | Submitted: 2026-07-22 | arXiv: 2607.19695
Categories: cs.RO, cs.CV
Research Background: Real deployment scenarios (delivery, campus, emergency response) require robots to navigate seamlessly from indoor to outdoor environments in a single episode, but benchmarks evaluate these settings in isolation and often abstract away robot kinematics — leaving the transition challenge unexplored. 研究背景： 真實部署場景（配送、校園、緊急響應）要求機器人在單次任務中無縫從室內導航至室外，但基準通常將這些場景分開評估且忽略機器人運動學，使轉換挑戰未被探索。
Technical Approach: NavVerse is a physics-enabled benchmark with 100 indoor, 50 outdoor, and 50 combined indoor-to-outdoor scenes spanning 10,000 episodes across Object Navigation, Vision-and-Language Navigation, and Place Navigation tasks. Agents use executable robot interfaces and are evaluated on task success, path efficiency, and safety metrics; zero-shot experiments compare RL, VLA, and modular baselines. 技術方法： NavVerse 是一個物理驅動的基準，包含 100 個室內、50 個室外和 50 個室內到室外組合場景，跨越 10,000 個場景，涵蓋物體導航、視覺語言導航和地點導航任務。智能體使用可執行的機器人介面，通過任務成功率、路徑效率和安全指標評估；零樣本實驗比較 RL、VLA 和模塊化基線。
Key Takeaway: End-to-end VLAs achieve the highest zero-shot success while modular methods offer the best safety profile; performance drops sharply from pure outdoor to indoor-to-outdoor scenes, identifying cross-context adaptation as the major open challenge. 核心發現： 端到端 VLA 實現最高零樣本成功率，而模塊化方法提供最佳安全性；從純室外到室內外組合場景性能急劇下降，確立跨情境適應為主要開放挑戰。
From Sign Language Generation to Humanoid Execution: Vision-Language Guided Retargeting with Collision Mitigation
Authors: Nabeela Khan, Bowen Wu, Runwu Shi et al. | Submitted: 2026-07-20 | arXiv: 2607.17769
Categories: cs.RO, cs.CV, cs.HC
Research Background: Sign language generation (SLG) systems increasingly output dense 3D body representations, but generated signing motions frequently exhibit self-intersections (hand-hand and hand-torso penetrations) that are tolerable in rendering but cause infeasible IK solutions and collisions when executed on humanoid robots. 研究背景： 手語生成（SLG）系統越來越多地輸出密集 3D 身體表示，但生成的手語動作常出現自我交叉（手-手和手-軀幹穿透），在渲染中可容忍，但在人形機器人上執行時會導致不可行的 IK 解和碰撞。
Technical Approach: A system-level framework bridges SLG to humanoid joint-space execution via two components: a volumetric SMPL-X collision-mitigation module that projects generated motions toward physically plausible configurations with minimal trajectory deviation, and a vision-language-guided retargeting algorithm where a VLM acts as a visual critic over rendered humanoid motion, identifies failure modes, and triggers targeted task-space IK corrections. 技術方法： 一個系統級框架透過兩個組件將 SLG 橋接到人形機器人關節空間執行：一個體積式 SMPL-X 碰撞緩解模塊，將生成動作投影到物理可行配置同時最小化軌跡偏差；以及一個視覺語言引導的重定向算法，其中 VLM 作為渲染人形運動的視覺評審，識別失敗模式並觸發有針對性的任務空間 IK 修正。
Key Takeaway: Combining volumetric collision mitigation with VLM-guided refinement addresses the two key missing components — physical feasibility and embodiment-specific correction — for reliable humanoid sign language execution. 核心發現： 結合體積碰撞緩解與 VLM 引導精化解決了可靠人形機器人手語執行缺失的兩個關鍵組件——物理可行性和具身特定修正。
GLAM-SLAM: Real-time Gaussian Large-scale Mapping via Flow Densification and Spatial Decomposition
Authors: Panagiotis Mermigkas, Argyris Manetas, Petros Maragos | Submitted: 2026-07-23 | arXiv: 2607.21416
Categories: cs.RO, cs.CV
Research Background: Gaussian-splatting SLAM systems achieve high reconstruction quality but are limited to short sequences or require prohibitive GPU memory for long-horizon outdoor scenarios — critical limitations for mobile robot deployment. 研究背景： 高斯潑灑 SLAM 系統實現高重建品質，但對長序列受限或對長時戶外場景需要龐大 GPU 記憶體——對移動機器人部署的關鍵限制。
Technical Approach: GLAM-SLAM decouples tracking from mapping: a feature-based SLAM frontend handles lightweight tracking, while mapping uses a structured sparse anchor grid representation for scalable operation. A geometry-based flow-densification anchoring strategy using epipolar constraints satisfies the dense initialization requirement of 3DGS, and a scene-partitioning strategy with MLP initializations generates spatially localized Gaussians for large-scale coherence. 技術方法： GLAM-SLAM 將跟踪與建圖解耦：基於特徵的 SLAM 前端處理輕量跟踪，而建圖使用結構化稀疏錨格表示實現可擴展操作。基於對極約束的幾何流密化錨定策略滿足 3DGS 的密集初始化需求，場景分割策略配合 MLP 初始化生成空間局部化的高斯體以實現大規模一致性。
Key Takeaway: GLAM-SLAM achieves 15% better reconstruction quality than the second-best performer on challenging long-sequence KITTI, Oxford RobotCar, and Málaga datasets while maintaining real-time performance, with publicly available code. 核心發現： GLAM-SLAM 在具挑戰性的長序列 KITTI、Oxford RobotCar 和 Málaga 資料集上比第二名高出 15% 的重建品質，同時保持實時性能，並公開代碼。
Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training
Authors: Taewon Seo, Seonae Jeon, Giwon Lee et al. | Submitted: 2026-07-22 | arXiv: 2607.19971
Categories: cs.RO, cs.CV
Research Background: Unified models combining pedestrian motion prediction and ego-motion planning are attractive for resource-constrained social robot navigation, but compact shared encoders suffer from representational conflict when prediction and planning objectives compete for the same parameters. 研究背景： 結合行人運動預測與自我運動規劃的統一模型對資源受限的社交機器人導航很有吸引力，但當預測和規劃目標競爭相同參數時，緊湊共享編碼器面臨表示衝突。
Technical Approach: Disjoint Parameter Training (DPT) is a model-merging framework that first trains task-specific models, identifies distinct key parameter regions per task, then performs sparse merging — selectively integrating only the most influential parameters for each task rather than all task-specific parameters — to prevent interference while concentrating representational capacity. DPT is compatible with various merging methods and evaluated on JRDB and JTA crowd navigation benchmarks. 技術方法： 不相交參數訓練（DPT）是一個模型合併框架，首先訓練特定任務模型，識別每個任務的不同關鍵參數區域，然後執行稀疏合併——僅選擇性地整合每個任務最有影響力的參數而非全部——以防止干擾同時集中表示能力。DPT 與多種合併方法兼容，並在 JRDB 和 JTA 人群導航基準上評估。
Key Takeaway: DPT demonstrates superior performance on both crowd navigation benchmarks, validating that identifying and separating parameter regions before merging is a principled solution to multi-task conflicts in safety-critical edge robot deployments. 核心發現： DPT 在兩個人群導航基準上均表現優異，驗證了在合併前識別和分離參數區域是解決安全關鍵邊緣機器人部署中多任務衝突的原則性解決方案。
EA-Nav: Learning Safe Visual Navigation Policies with Embodiment Awareness
Authors: Jialu Zhang, Yong Du, Xianda Guo et al. | Submitted: 2026-07-22 | arXiv: 2607.19880
Categories: cs.RO, cs.CV
Research Background: Cross-embodiment visual navigation is challenging because the same visual observation implies different safe actions for different robot body geometries; existing imitation-learning approaches largely ignore this embodiment-action ambiguity, limiting scalable pre-training. 研究背景： 跨具身視覺導航具有挑戰性，因為相同的視覺觀察對不同機器人體型意味著不同的安全動作；現有的模仿學習方法在很大程度上忽視了這種具身-動作歧義，限制了可擴展的預訓練。
Technical Approach: EA-Nav is an imitation-learning framework with a modular multi-stage design: pre-training builds a cross-embodiment dataset from Internet videos with embodiment geometry as conditional tokens to resolve action ambiguity; fine-tuning introduces a decoupled architecture with trajectory augmentation for high-risk samples, training spatial perception and risk-aware correction separately while explicitly conditioning on embodiment geometry. 技術方法： EA-Nav 是一個具有模塊化多階段設計的模仿學習框架：預訓練從互聯網影片構建跨具身資料集，以具身幾何體作為條件 token 以解決動作歧義；微調引入了對高風險樣本進行軌跡增強的解耦架構，分別訓練空間感知和風險感知修正，同時顯式地以具身幾何為條件。
Key Takeaway: Incorporating embodiment geometry as conditional tokens significantly improves navigation performance and safety across different embodiment settings, opening a path to scalable imitation-based cross-embodiment navigation without RL reward engineering. 核心發現： 將具身幾何體作為條件 token 顯著提升了不同具身設置下的導航性能和安全性，為無需 RL 獎勵工程的可擴展模仿跨具身導航開闢了道路。
EgoRecovery: Acquiring Failure Recovery Ability Through Human Recovery Demonstration
Authors: Zuhao Ge, Yuchen Zhou, Weitao Zhou et al. | Submitted: 2026-07-22 | arXiv: 2607.19745
Categories: cs.RO, cs.CV
Research Background: Robust robot manipulation requires the ability to recover from failures, but collecting robot-teleoperated recovery demonstrations at scale is extremely difficult — inducing diverse failure states is time-consuming, and the high diversity of failure modes demands far more recovery data than success demonstrations. 研究背景： 穩健的機器人操作需要從失敗中恢復的能力，但大規模收集機器人遙操作恢復演示極為困難——誘導多樣化失敗狀態耗時，且失敗模式的高多樣性需要比成功演示多得多的恢復資料。
Technical Approach: EgoRecovery leverages egocentric human failure recovery video as a scalable data source (10× more valid data per hour than robot teleoperation). A co-training framework aligns human recovery demonstrations to a compact corrective-intent space shared with robot data, capturing correction timing and magnitude. A small number of robot demonstrations connect this intent to executable actions, and a learned recovery gate predicts when recovery is needed from robot observations. 技術方法： EgoRecovery 利用以自我為中心的人類失敗恢復影片作為可擴展資料來源（每小時比機器人遙操作多 10 倍有效資料）。協同訓練框架將人類恢復演示對齊到與機器人資料共享的緊湊修正意圖空間，捕獲修正時機和幅度。少量機器人演示將此意圖連接到可執行動作，學習的恢復門從機器人觀察中預測何時需要恢復。
Key Takeaway: EgoRecovery improves success from failure states over robot-only recovery, direct co-training, and direct intent-transfer baselines, establishing egocentric human video as a practical high-bandwidth source for failure recovery data collection. 核心發現： EgoRecovery 在從失敗狀態恢復的成功率上優於純機器人恢復、直接協同訓練和直接意圖遷移基線，確立了以自我為中心的人類影片作為失敗恢復資料收集的實用高帶寬來源。
From Distances to Trajectories: Real-Time Signed Distance Function Mapping and Distance-Accelerated Motion Planning for UAVs
Authors: Jason Stanley, Zhirui Dai, Qihao Qian et al. | Submitted: 2026-07-21 | arXiv: 2607.19306
Categories: cs.RO, cs.AI, cs.CV, eess.SY
Research Background: Autonomous UAV flight in cluttered environments requires real-time onboard mapping and trajectory planning, but treating these as separate stages with binary occupancy representation loses information about obstacle proximity critical for smooth and safe trajectory optimization. 研究背景： 在雜亂環境中自主無人機飛行需要實時機載建圖和軌跡規劃，但將這些作為使用二進制佔用表示的獨立階段處理，丟失了對平滑安全軌跡優化至關重要的障礙物距離信息。
Technical Approach: OREN (Octree REsidual Network) pairs an explicit octree prior with an implicit neural residual for online SDF reconstruction from point clouds, combining volumetric efficiency with neural accuracy. Bubble* is a search-based planner that grows maximal collision-free balls (bubbles) using SDF distance information to reduce collision checks vs. grid-based A*, returning a bubble sequence as a safe corridor for trajectory optimization. The integrated system is demonstrated onboard a quadrotor in real-time. 技術方法： OREN（八叉樹殘差網路）將顯式八叉樹先驗與隱式神經殘差結合，用於從點雲進行在線 SDF 重建，兼具體積效率和神經精度。Bubble* 是一個基於搜索的規劃器，利用 SDF 距離信息增長最大無碰撞球（泡泡），相比網格 A* 減少碰撞檢查，返回泡泡序列作為軌跡優化的安全走廊。集成系統在四旋翼上進行了實時機載演示。
Key Takeaway: OREN improves SDF estimation by 22% over baselines; Bubble* finds trajectories spanning ~90 m through cluttered environments in 1-3 seconds (vs. up to 10 seconds for baselines), demonstrating co-design of mapping and planning around a shared SDF as a practical onboard solution. 核心發現： OREN 比基線提升 22% 的 SDF 估計精度；Bubble* 在 1-3 秒內找到穿越雜亂環境約 90 米的軌跡（基線需長達 10 秒），展示了圍繞共享 SDF 協同設計建圖與規劃作為實用機載解決方案。
UniETP: Unifying Environments for Generalizable Embodied Task Planning
Authors: Peiran Xu, Jiaqi Zheng, Ziyou Wang et al. | Submitted: 2026-07-20 | arXiv: 2607.18062
Categories: cs.RO, cs.CV
Research Background: Embodied task planning research is fragmented across simulators with incompatible observation formats, action types, and task domains, complicating model comparison and hindering scalable data aggregation for training general-purpose planning agents. 研究背景： 具身任務規劃研究分散於具有不兼容觀察格式、動作類型和任務領域的各個模擬器中，使模型比較複雜化並阻礙了訓練通用規劃智能體的可擴展資料聚合。
Technical Approach: UniETP is a unified interface integrating four widely-used simulators (AI2-THOR, VirtualHome, Habitat, BEHAVIOR) into a consistent observation and action space with a shared evaluation system for complex task goals. It enhances task diversity across dimensions of task logic, instance grounding, and instruction understanding, and automatically constructs a dataset with varied difficulty levels. 技術方法： UniETP 是一個統一介面，將四個廣泛使用的模擬器（AI2-THOR、VirtualHome、Habitat、BEHAVIOR）整合到一致的觀察和動作空間中，具有用於複雜任務目標的共享評估系統。它增強了任務邏輯、實例接地和指令理解等維度的任務多樣性，並自動構建具有不同難度級別的資料集。
Key Takeaway: By unifying four simulators under a single standardized interface, UniETP enables comprehensive model comparison across diverse embodied planning tasks and provides a scalable pipeline for cross-simulator training data, directly addressing the field’s fragmentation problem. 核心發現： 通過在單一標準化介面下統一四個模擬器，UniETP 實現了跨多樣具身規劃任務的全面模型比較，並提供可擴展的跨模擬器訓練資料管線，直接解決了該領域的碎片化問題。
Masked Visual Actions for Unified World Modeling
Authors: Hadi Alzayer, Wenlong Huang, Haonan Chen et al. | Submitted: 2026-07-21 | arXiv: 2607.19343
Categories: cs.CV, cs.RO
Research Background: Video foundation models encode rich interaction priors, but communicating robot actions to such models in a visual-space-aligned form — enabling both forward dynamics prediction and inverse dynamics recovery — remains an open challenge. 研究背景： 視頻基礎模型編碼豐富的交互先驗，但以視覺空間對齊的形式向此類模型傳遞機器人動作——同時支持正向動力學預測和逆向動力學恢復——仍是一個開放挑戰。
Technical Approach: Masked Visual Actions (MVA) is a pixel-space control interface that expresses action as a partially revealed trajectory of an arbitrary entity in a video: revealing robot motion turns the model into a forward dynamics predictor for real-time consequences, while revealing desired object motion makes the same model recover consistent robot behavior. A single checkpoint is fine-tuned with only 15 hours of masked examples from real videos and simulation. 技術方法： 遮蔽視覺動作（MVA）是一個像素空間控制介面，將動作表示為影片中任意實體的部分揭示軌跡：揭示機器人運動使模型成為實時結果的正向動力學預測器，而揭示所需物體運動使相同模型恢復一致的機器人行為。單一檢查點僅用 15 小時真實影片和模擬中的遮蔽樣本進行微調。
Key Takeaway: A single MVA checkpoint achieves strong visual fidelity and controllability across diverse scenes and embodiments, and downstream it enables policy evaluation via imagined rollouts, model-based planning by ranking candidate futures, and inverse modeling from desired object motion. 核心發現： 單一 MVA 檢查點在多樣場景和具身形態中實現強大的視覺保真度和可控性，下游可用於通過想象展開進行策略評估、通過排名候選未來進行基於模型的規劃以及從所需物體運動進行逆向建模。
HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving
Authors: Quanfu Yu, Xian Wu, Hao Xu et al. | Submitted: 2026-07-23 | arXiv: 2607.20988
Categories: cs.CV, cs.AI
Research Background: VLA models augmented with world modeling show promise for end-to-end autonomous driving: pixel-level prediction enables fine-grained spatiotemporal reasoning but degrades under noise, while latent-based world models are more robust but lack pixel-level grounding — a trade-off neither approach resolves. 研究背景： 增強了世界建模的 VLA 模型在端到端自動駕駛中展示了潛力：像素級預測支持細粒度時空推理但在噪聲下降級，而潛在世界模型更穩健但缺乏像素級接地——兩種方法都無法解決的取捨。
Technical Approach: HyWorldVLA unifies pixel-level supervision and latent representation learning in two stages: pre-training predicts video latents encoded by a pre-trained video VAE while simultaneously reconstructing video frames for precise pixel-level grounding; co-fine-tuning exclusively predicts latent features fed into an action expert for trajectory generation. The authors also conduct the first comprehensive analysis of world model noise robustness in autonomous driving. 技術方法： HyWorldVLA 在兩個階段統一像素級監督和潛在表示學習：預訓練預測由預訓練視頻 VAE 編碼的視頻潛變量，同時重建視頻幀以進行精確的像素級接地；協同微調專門預測輸入動作專家生成軌跡的潛在特徵。作者還進行了自動駕駛中世界模型噪聲魯棒性的首個全面分析。
Key Takeaway: HyWorldVLA significantly outperforms both pixel-based and latent-based world model baselines on NAVSIM v1 and v2 benchmarks, establishing hybrid world modeling as a principled approach for noise-robust autonomous driving VLAs. 核心發現： HyWorldVLA 在 NAVSIM v1 和 v2 基準上顯著優於基於像素和基於潛在的世界模型基線，確立了混合世界建模作為噪聲魯棒自動駕駛 VLA 的原則性方法。
Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents
Authors: Suman Navaratnarajah, Taehyoung Kim, Jona Ruthardt et al. | Submitted: 2026-07-24 | arXiv: 2607.22014
Categories: cs.AI, cs.CL, cs.CV, cs.RO
Research Background: MLLMs are being deployed as reasoning cores for embodied aerial agents, but it is unclear how well general-purpose models handle long-horizon, multi-step missions requiring autonomous planning, navigation, and adaptive reasoning from egocentric observations alone — without aerial-specific fine-tuning. 研究背景： MLLM 正被部署為具身空中智能體的推理核心，但通用模型在僅從以自我為中心的觀察處理需要自主規劃、導航和自適應推理的長時域多步任務方面的能力尚不清楚——無需航空特定微調。
Technical Approach: MissionBench is a benchmark comprising 120 missions across five simulated 3D environments and four task families, evaluated across 22 open- and closed-source MLLMs with no aerial-specific training. Missions require autonomous planning, navigation, and outcome reporting using only egocentric observations and action history; analysis examines scaling behavior and capability bottlenecks. 技術方法： MissionBench 是一個基準，包含跨五個模擬 3D 環境和四個任務系列的 120 個任務，在 22 個開源和閉源 MLLM 上評估，無需航空特定訓練。任務需要僅使用以自我為中心的觀察和動作歷史進行自主規劃、導航和結果報告；分析檢查規模效應和能力瓶頸。
Key Takeaway: The strongest MLLM succeeds on fewer than 35% of missions versus 84.4% human performance, with gains from model scaling but no model reaching near-human capability — showing that mission-level embodied competence requires multi-capability coordination beyond what general scaling currently provides. 核心發現： 最強的 MLLM 在不到 35% 的任務上成功，而人類性能為 84.4%，模型規模帶來提升但無模型接近人類能力——顯示任務級具身能力需要超出當前通用規模所能提供的多能力協調。
No Training, Better Flights: Test-Time Scaled VLMs for UAV Navigation
Authors: Feinan Cheng, Dongliang Xu, Wenli Nong et al. | Submitted: 2026-07-21 | arXiv: 2607.19288
Categories: cs.CV, cs.RO
Research Background: VLM-based UAV vision-and-language navigation typically relies on single inference passes, producing suboptimal or unsafe trajectories in complex environments; test-time scaling offers a training-free path to improved reasoning but has not been explored for aerial navigation. 研究背景： 基於 VLM 的無人機視覺語言導航通常依賴單次推理，在複雜環境中產生次優或不安全的軌跡；測試時擴展提供了一條無需訓練的推理改進路徑，但尚未在空中導航中探索。
Technical Approach: An iterative refinement process first prompts the model to generate multiple parallel navigation candidates, then applies a self-correction step where the model re-evaluates its initial plan. A multi-criteria scoring function evaluates refined candidates on safety, goal alignment, and forward-progress to select the final trajectory, applied to a frozen UAV navigation VLM with no additional training. 技術方法： 迭代精化過程首先提示模型生成多個並行導航候選，然後應用自我修正步驟，模型重新評估其初始計劃。多標準評分函數根據安全性、目標對齊和前進進度評估精化候選以選擇最終軌跡，應用於無需額外訓練的凍結無人機導航 VLM。
Key Takeaway: Simple test-time scaling via parallel candidate generation and multi-criteria self-correction achieves state-of-the-art UAV navigation performance without any model modifications or fine-tuning, demonstrating that inference-time compute is a viable axis for improving aerial VLM agents. 核心發現： 通過並行候選生成和多標準自我修正的簡單測試時擴展在無需任何模型修改或微調的情況下實現了最先進的無人機導航性能，展示了推理時計算是改進空中 VLM 智能體的可行軸。
Recti-Q: Feature-Space Rectification for Out-of-Distribution-Robust Quantized Perception in Edge Robotics
Authors: Hamidreza Yaghoubi Araghi, Parastoo Pilevar, Ming C. Lin | Submitted: 2026-07-20 | arXiv: 2607.18540
Categories: cs.CV, cs.LG, cs.RO
Research Background: Post-training quantization (PTQ) is attractive for deploying large vision backbones on SWaP-constrained robot edge platforms, but while PTQ preserves clean in-distribution accuracy, it substantially degrades robustness under deployment-relevant distribution shifts (sensor noise, severe weather, novel environments) — a Quantization-Induced Robustness Gap. 研究背景： 後訓練量化（PTQ）對於在 SWaP 受限的機器人邊緣平台上部署大型視覺骨幹很有吸引力，但雖然 PTQ 保留了乾淨的分布內準確性，它在部署相關的分布偏移（傳感器噪聲、惡劣天氣、新環境）下大幅降低了魯棒性——量化誘導的魯棒性差距。
Technical Approach: Recti-Q is a lightweight feature-space rectification framework that freezes the quantized backbone and trains a small classifier-head LoRA adapter using only source data. The framework is architecture-agnostic across CNNs and Transformers, supports teacher-free training, adds less than 1% parameter overhead (as small as 6 KB), and enables low-bandwidth OTA resilience patching for deployed robot fleets. 技術方法： Recti-Q 是一個輕量的特徵空間整流框架，凍結量化骨幹並僅使用源數據訓練小型分類頭 LoRA 適配器。該框架對 CNN 和 Transformer 都是架構無關的，支持無教師訓練，增加不到 1% 的參數開銷（小至 6 KB），並使已部署機器人機隊能夠進行低帶寬 OTA 韌性修補。
Key Takeaway: Recti-Q recovers a significant portion of PTQ’s lost OOD robustness — in some cases matching or exceeding FP32 performance — while preserving over 99% of PTQ’s memory savings, providing a practical path to distributing robustness fixes to deployed edge robots. 核心發現： Recti-Q 在保留超過 99% 的 PTQ 記憶節省的同時，恢復了 PTQ 丟失的大部分 OOD 魯棒性——在某些情況下匹配或超過 FP32 性能，為向已部署邊緣機器人分發魯棒性修復提供了實用途徑。
Cognitive Dual-Process Planning for Autonomous Driving with Structured Scene Knowledge and Verifiable Reasoning-Action Consistency
Authors: Zhongyao Yang, Haoyu Li, Yu Yan et al. | Submitted: 2026-07-21 | arXiv: 2607.19194
Categories: cs.RO, cs.CV
Research Background: VLMs can make intermediate planning reasoning explicit for autonomous driving, but their use in deployed planners is constrained by costly structured supervision, unnecessary reasoning in routine scenes, and possible inconsistencies between generated rationales and final driving actions. 研究背景： VLM 可以為自動駕駛明確中間規劃推理，但其在已部署規劃器中的使用受到昂貴結構化監督、常規場景中不必要推理以及生成理由與最終駕駛動作之間可能不一致的限制。
Technical Approach: A cognitive dual-process framework represents scene knowledge in a machine-parsable structured chain-of-thought (S-CoT) schema. An automated data engine generates S-CoT supervision without manual annotation using perception foundation models and an expert VLM. A lightweight visual Arbiter routes inputs to fast meta-action prediction or slow structured reasoning based on estimated scene complexity; a rule-based validator checks S-CoT field consistency with the final action and provides verifiable GRPO rewards. 技術方法： 認知雙過程框架在機器可解析的結構化思維鏈（S-CoT）模式中表示場景知識。自動化數據引擎使用感知基礎模型和專家 VLM 生成 S-CoT 監督，無需手動標注。輕量視覺仲裁器根據估計的場景複雜度將輸入路由到快速元動作預測或慢速結構化推理；基於規則的驗證器檢查 S-CoT 字段與最終動作的一致性並提供可驗證的 GRPO 獎勵。
Key Takeaway: The framework achieves 80.14% planning accuracy and 97.20% logical consistency while reducing average latency by 17.39% vs. applying slow reasoning to every scene, showing that adaptive routing between fast and slow reasoning is both faster and more consistent than uniform slow-path processing. 核心發現： 該框架實現了 80.14% 的規劃準確率和 97.20% 的邏輯一致性，同時將平均延遲比對每個場景應用慢速推理降低 17.39%，顯示快慢推理之間的自適應路由比均勻慢路徑處理既更快又更一致。