Quartz 5

arXiv Digest — 2026-W18

Properties1
tagsarxiv-digest, robotics, hri, machine-learning, vla

69 min read

arXiv Weekly Digest — Week 18, 2026

Fetched: 2026-04-27 | Categories: cs.RO | Papers: 136 (from 206 candidates; 206 total fetched)

Note: Only cs.RO completed successfully this week — cs.LG timed out, cs.HC failed all retries (429), and cs.CV returned 429/503 errors. Papers scored ≥ 6 retained; score 9–10 = core, 7–8 = related, 6 = peripheral.

Core Papers (Score 9–10)

Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanisms

Authors: Qi Li, Bo Yin, Weiqi Huang, et al. | Submitted: 2026-04-26 | arXiv: 2604.23775 Categories: cs.RO

Research Background: VLA models are emerging as the unified substrate for embodied intelligence, but this shift raises a new class of safety challenges stemming from irreversible physical consequences, a multimodal attack surface across vision, language, and state, and real-time latency constraints on defense. 研究背景： VLA 模型正成為具身智能的統一基礎，但這引發了一類新的安全挑戰，包括不可逆的物理後果、跨視覺、語言和狀態的多模態攻擊面，以及防禦的即時延遲限制。

Technical Approach: This survey systematically categorizes threats to VLA systems (adversarial attacks, jailbreaking, distribution shifts, physical world adversarial patches), examines evaluation protocols, and surveys existing mechanisms for safety (input filtering, action monitors, conformal prediction, runtime verification) across the full VLA pipeline. 技術方法： 本綜述系統性地分類了對 VLA 系統的威脅（對抗攻擊、越獄、分佈偏移、物理對抗貼片），審視評估協議，並調查整個 VLA 流程中的現有安全機制（輸入過濾、動作監控、符合性預測、運行時驗證）。

Key Takeaway: VLA safety is a distinct and urgent research area requiring holistic solutions that span the perception-reasoning-action chain; existing NLP safety mechanisms are insufficient when actions can cause irreversible physical harm. 核心發現： VLA 安全是一個獨特且緊迫的研究領域，需要跨越感知-推理-動作鏈的整體解決方案；當動作可能造成不可逆物理傷害時，現有的 NLP 安全機制是不夠的。

RL Token: Bootstrapping Online RL with Vision-Language-Action Models

Authors: Charles Xu, Jost Tobias Springenberg, Michael Equi, et al. | Submitted: 2026-04-24 | arXiv: 2604.23073 Categories: cs.LG, cs.RO

Research Background: VLA models can learn diverse manipulation skills out of the box, but achieving real-world precision and speed requires further fine-tuning via RL. Standard RL fine-tuning of large models is sample-inefficient and requires expensive environment interaction. 研究背景： VLA 模型可以開箱即用地學習多樣化的操作技能，但實現真實世界精度和速度需要透過 RL 進一步微調。對大型模型的標準 RL 微調樣本效率低下，且需要昂貴的環境互動。

Technical Approach: RL Token introduces a lightweight “RL mode” token that switches the VLA between behavior-cloning mode and RL-fine-tuning mode, enabling the pretrained policy to serve as its own strong initialization. Sample efficiency is achieved by freezing most model parameters and only training the action head and RL token embeddings during real-world online RL. 技術方法： RL Token 引入一個輕量級「RL 模式」token，在行為克隆模式和 RL 微調模式之間切換 VLA，使預訓練策略能夠作為自身的強初始化。通過凍結大多數模型參數，只在真實世界在線 RL 期間訓練動作頭和 RL token 嵌入來實現樣本效率。

Key Takeaway: RL Token enables sample-efficient online RL fine-tuning of pretrained VLAs in just a few hours of real-world practice, yielding significant precision and speed improvements over the pretrained baseline. 核心發現： RL Token 使預訓練 VLA 的樣本高效在線 RL 微調僅需幾小時的真實世界練習，在精度和速度上相較預訓練基線有顯著提升。

Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulation

Authors: Haoming Xu, Lei Lei, Jie Gu, et al. | Submitted: 2026-04-26 | arXiv: 2604.23620 Categories: cs.RO

Research Background: Existing VLA policies treat manipulation as a monolithic task, conflating coarse approach movements with contact-critical fine manipulation. This forces the policy to handle heterogeneous behavioral regimes under one objective, reducing precision. 研究背景： 現有的 VLA 策略將操作視為整體任務，混淆了粗略接近移動和接觸關鍵的精細操作。這迫使策略在一個目標下處理異質行為模式，降低精度。

Technical Approach: Move-Then-Operate explicitly decouples manipulation into two phases: coarse relocation (move) and contact-critical interaction (operate). A dual-expert policy routed by a learnable phase selector directs the appropriate sub-policy for each phase, with different representations and loss weighting for each regime. 技術方法： Move-Then-Operate 明確將操作分解為兩個階段：粗略重新定位（移動）和接觸關鍵互動（操作）。由可學習相位選擇器路由的雙專家策略為每個階段指導適當的子策略，每個模式具有不同的表示和損失權重。

Key Takeaway: Explicit behavioral phasing yields significant performance gains on contact-critical manipulation benchmarks by allowing each sub-policy to specialize in its phase’s dynamics. 核心發現： 明確的行為分階通過允許每個子策略專注於其階段的動態，在接觸關鍵操作基準上取得顯著的性能提升。

Tube Diffusion Policy: Reactive Visual-Tactile Policy Learning for Contact-rich Manipulation

Authors: Teng Xue, Alberto Rigo, Bingjian Huang, et al. | Submitted: 2026-04-26 | arXiv: 2604.23609 Categories: cs.RO

Research Background: Contact-rich manipulation requires continuous adaptation to contact uncertainty and external disturbances through multi-modal perception. Most imitation learning approaches rely on action chunking, which limits reactive adaptation to unexpected contact events. 研究背景： 接觸豐富的操作需要通過多模態感知持續適應接觸不確定性和外部干擾。大多數模仿學習方法依賴動作分組，限制了對意外接觸事件的反應性適應。

Technical Approach: Tube Diffusion Policy generates a “tube” of trajectory distributions rather than a single trajectory chunk. The tube represents temporal uncertainty bounds, and visual-tactile feedback is used to reactively select within the tube at execution time, enabling smooth recovery from contact disturbances without requiring contact prediction. 技術方法： Tube Diffusion Policy 生成軌跡分佈的「管道」而非單一軌跡分組。管道表示時間不確定性界限，視覺-觸覺反饋用於在執行時在管道內進行反應性選擇，無需接觸預測即可從接觸干擾中平滑恢復。

Key Takeaway: Tube Diffusion Policy outperforms action-chunking diffusion baselines on contact-rich manipulation tasks requiring reactive adaptation to unexpected forces, with substantially lower failure rates on peg insertion and lid-opening tasks. 核心發現： Tube Diffusion Policy 在需要對意外力進行反應性適應的接觸豐富操作任務上優於動作分組擴散基線，在插銷和開蓋任務上大幅降低失敗率。

Learning from Demonstration with Failure Awareness for Safe Robot Navigation

Authors: Xianghui Wang, Siwei Cheng, Shanze Wang, et al. | Submitted: 2026-04-25 | arXiv: 2604.23360 Categories: cs.RO

Research Background: LfD for robot navigation suffers from a fundamental limitation: demonstrations consist predominantly of successful behaviors and provide limited coverage of unsafe states. This causes poor safety when encountering out-of-distribution scenarios. 研究背景： 機器人導航的示範學習存在根本性限制：示範主要由成功行為組成，對不安全狀態的覆蓋有限。這在遇到分佈外場景時導致安全性差。

Technical Approach: The method augments standard LfD with failure-aware demonstrations that explicitly include collision and near-miss experiences. A failure-conditioned policy learns to distinguish safe from unsafe states, and the learned failure model serves as a safety critic during deployment to reject actions predicted to lead to failure. 技術方法： 該方法通過失敗感知示範增強標準 LfD，明確包括碰撞和近碰體驗。失敗條件策略學習區分安全和不安全狀態，學習的失敗模型在部署期間作為安全批評者拒絕預測會導致失敗的動作。

Key Takeaway: Failure-aware LfD significantly improves navigation safety on out-of-distribution scenarios while maintaining task completion rates comparable to vanilla LfD on standard scenarios. 核心發現： 失敗感知 LfD 在分佈外場景上顯著提升導航安全性，同時在標準場景上保持與普通 LfD 相當的任務完成率。

Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Models

Authors: Jimin Lee, Huiwon Jang, Myungkyu Koo, et al. | Submitted: 2026-04-25 | arXiv: 2604.23272 Categories: cs.RO

Research Background: Humans interact with the world using diverse physical feedback beyond vision. Prior approaches to incorporating physical sensory signals into VLAs typically focus on a single signal type, failing to capture heterogeneous and complementary feedback. 研究背景： 人類利用視覺之外的多樣化物理反饋與世界互動。將物理感知信號整合到 VLA 的先前方法通常只關注單一信號類型，無法捕獲異質和互補的反饋。

Technical Approach: A modular sensory stream architecture adds separate encoders for each physical feedback modality (force, tactile, proprioception) and fuses them via cross-attention into the VLA token stream. Modularity enables adding new sensor types without retraining the full model, and each stream can be selectively activated based on task requirements. 技術方法： 模組化感知流架構為每種物理反饋模態（力、觸覺、本體感覺）添加獨立編碼器，並通過交叉注意力將其融合到 VLA token 流中。模組化使得無需重新訓練整個模型即可添加新型感測器，每個流可根據任務需求選擇性地激活。

Key Takeaway: Modular integration of heterogeneous physical feedback significantly improves performance on contact-rich tasks compared to vision-only VLAs, with each modality contributing complementary information. 核心發現： 相較於僅視覺 VLA，異質物理反饋的模組化整合顯著提升接觸豐富任務的性能，每種模態提供互補信息。

BridgeACT: Bridging Human Demonstrations to Robot Actions via Unified Tool-Target Affordances

Authors: Yifan Han, Jianxiang Liu, Haoyu Zhang, et al. | Submitted: 2026-04-25 | arXiv: 2604.23249 Categories: cs.RO

Research Background: Learning robot manipulation from human videos is appealing due to scale and diversity, but transferring demonstrations to executable robot behavior remains challenging. Prior work either relies on robot data for adaptation or learns affordance representations that remain at the perception level. 研究背景： 從人類影片學習機器人操作因其規模和多樣性而具有吸引力，但將示範轉移到可執行的機器人行為仍然具有挑戰性。先前工作要麼依賴機器人數據進行適應，要麼學習停留在感知層面的可用性表示。

Technical Approach: BridgeACT introduces unified tool-target affordances that jointly represent the tool being used and the target being acted upon in a geometrically consistent space. An affordance-conditioned policy generates robot actions from these unified representations, bridging the embodiment gap without requiring robot-specific demonstration data. 技術方法： BridgeACT 引入統一的工具-目標可用性，在幾何一致的空間中共同表示正在使用的工具和被操作的目標。可用性條件策略從這些統一表示生成機器人動作，無需機器人特定示範數據即可跨越具身差距。

Key Takeaway: BridgeACT achieves strong transfer from human demonstration videos to real robot execution without robot-specific fine-tuning, demonstrating generalization to novel objects and configurations. 核心發現： BridgeACT 無需機器人特定微調即可實現從人類示範影片到真實機器人執行的強轉移，展示了對新物體和配置的泛化能力。

Breaking Lock-In: Preserving Steerability under Low-Data VLA Post-Training

Authors: Suning Huang, Jiaqi Shao, Ke Wang, et al. | Submitted: 2026-04-25 | arXiv: 2604.23121 Categories: cs.RO, cs.CV

Research Background: Post-training a generalist VLA on a small demonstration dataset often causes it to stop responding to new instructions, becoming locked into behaviors observed during post-training. This “lock-in” problem limits the utility of fine-tuned VLAs. 研究背景： 在小型示範數據集上對通才 VLA 進行後訓練通常會導致它停止響應新指令，被鎖定在後訓練期間觀察到的行為中。這個「鎖定」問題限制了微調 VLA 的實用性。

Technical Approach: The paper identifies lock-in as a catastrophic forgetting of instruction-following conditioned on the post-training distribution. The solution applies steerability-preserving regularization and a diverse instruction augmentation strategy during fine-tuning to maintain the VLA’s generalized instruction-following while adapting to new tasks. 技術方法： 論文將鎖定識別為以後訓練分佈為條件的指令遵循的災難性遺忘。解決方案在微調期間應用可引導性保持正則化和多樣化指令增強策略，在適應新任務的同時保持 VLA 的廣泛指令遵循能力。

Key Takeaway: The proposed method preserves generalist steerability after low-data post-training, maintaining response to novel instructions while matching task-specific performance of lock-in fine-tuned baselines. 核心發現： 所提方法在低數據後訓練後保持通才可引導性，在保持任務特定性能的同時維持對新指令的響應，與鎖定微調基線相當。

Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines

Authors: Ziyao Wang, Bingying Wang, Hanrong Zhang, et al. | Submitted: 2026-04-24 | arXiv: 2604.23001 Categories: cs.RO, cs.AI

Research Background: Despite remarkable progress in VLA models, a central bottleneck remains underexamined: the data infrastructure underlying embodied learning. Future VLA advances will depend less on model architecture and more on co-design of high-fidelity data engines and structured evaluation protocols. 研究背景： 儘管 VLA 模型取得了顯著進展，但一個核心瓶頸尚未得到充分研究：具身學習的底層數據基礎設施。未來的 VLA 進步將不那麼依賴模型架構，而更多依賴高保真數據引擎和結構化評估協議的協同設計。

Technical Approach: A systematic, data-centric survey covering VLA datasets (real robot, simulation, human video, teleoperation), benchmarks (manipulation, navigation, long-horizon), and data engines (automatic annotation, simulation-to-real, generative augmentation). Taxonomy is provided for dataset provenance, modality, task type, and scale. 技術方法： 以數據為中心的系統性調查，涵蓋 VLA 數據集（真實機器人、模擬、人類影片、遠程操作）、基準測試（操作、導航、長時程）和數據引擎（自動標注、模擬到真實、生成增強）。提供了數據集來源、模態、任務類型和規模的分類法。

Key Takeaway: The field is bottlenecked by inconsistent evaluation protocols and data fragmentation; the survey identifies standardized data engines with automatic quality assessment as the most impactful next step. 核心發現： 該領域受到不一致評估協議和數據碎片化的瓶頸限制；調查確定具有自動質量評估的標準化數據引擎是最有影響力的下一步。

Learning from the Best: Smoothness-Driven Metrics for Data Quality in Imitation Learning

Authors: Soham Kulkarni, Raayan Dhar, Yuchen Cui | Submitted: 2026-04-24 | arXiv: 2604.23000 Categories: cs.RO

Research Background: In behavioral cloning, policy performance is fundamentally limited by demonstration data quality. Real-world datasets contain trajectories of varying quality due to operator skill differences and teleoperation artifacts, yet standard BC treats all demonstrations equally. 研究背景： 在行為克隆中，策略性能從根本上受示範數據品質的限制。真實世界數據集包含因操作員技能差異和遠程操作偽影而品質各異的軌跡，但標準 BC 平等對待所有示範。

Technical Approach: The paper proposes trajectory smoothness metrics (jerk, acceleration variance, velocity consistency) as cost-free proxies for demonstration quality. These metrics are used to automatically rank and filter demonstrations without requiring policy training in the loop or manual annotation. A smoothness-weighted BC loss further emphasizes high-quality demonstrations. 技術方法： 論文提出軌跡平滑度指標（急動度、加速度方差、速度一致性）作為示範品質的零成本代理。這些指標用於自動排名和過濾示範，無需在循環中進行策略訓練或手動標注。平滑度加權 BC 損失進一步強調高品質示範。

Key Takeaway: Smoothness-driven curation consistently outperforms uniform BC and matches or exceeds more expensive curation methods, providing a practical and scalable approach to improving IL performance from heterogeneous datasets. 核心發現： 平滑度驅動的篩選一貫優於均勻 BC，並匹配或超越更昂貴的篩選方法，為從異質數據集改善 IL 性能提供了實用且可擴展的方法。

GazeVLA: Learning Human Intention for Robotic Manipulation

Authors: Chengyang Li, Kaiyi Xiong, Yuan Xu, et al. | Submitted: 2026-04-24 | arXiv: 2604.22615 Categories: cs.RO

Research Background: Embodied foundation models depend heavily on large-scale robot demonstrations. While human data offers an alternative, extracting transferable knowledge is challenging due to the embodiment gap. Gaze signals in human demonstrations contain rich intention information that is typically discarded. 研究背景： 具身基礎模型嚴重依賴大規模機器人示範。雖然人類數據提供了替代方案，但由於具身差距，提取可轉移知識具有挑戰性。人類示範中的眼動信號包含豐富的意圖信息，通常被丟棄。

Technical Approach: GazeVLA extracts gaze patterns from human video demonstrations as explicit intention signals and conditions the VLA policy on predicted gaze attention maps. The gaze encoder is trained to predict attention regions from RGB frames, and gaze-conditioned tokens are injected into the VLA token stream alongside visual observations. 技術方法： GazeVLA 從人類影片示範中提取眼動模式作為明確的意圖信號，並以預測的注視注意力圖為條件訓練 VLA 策略。注視編碼器被訓練從 RGB 幀預測注意力區域，注視條件化 token 與視覺觀察一起注入 VLA token 流中。

Key Takeaway: Gaze-conditioned VLA policies achieve significantly better performance on manipulation tasks, especially for tasks requiring precise object localization, with gaze providing a strong prior for where to focus visual attention. 核心發現： 注視條件化 VLA 策略在操作任務上實現顯著更好的性能，尤其是需要精確物體定位的任務，注視為視覺注意力提供了強有力的先驗。

RedVLA: Physical Red Teaming for Vision-Language-Action Models

Authors: Yuhao Zhang, Borong Zhang, Jiaming Fan, et al. | Submitted: 2026-04-24 | arXiv: 2604.22591 Categories: cs.RO

Research Background: Real-world VLA deployment is limited by the risk of unpredictable and irreversible physical harm. Existing safety evaluation frameworks focus on language-only or digital settings and are inadequate for proactively detecting physical safety risks before deployment. 研究背景： 真實世界 VLA 部署受到不可預測和不可逆物理傷害風險的限制。現有安全評估框架側重於純語言或數字設置，不足以在部署前主動檢測物理安全風險。

Technical Approach: RedVLA is the first physical red teaming framework for VLA safety. It systematically generates adversarial physical scenarios (object placement, instruction variants, environmental perturbations) to probe VLA failure modes. A catalog of physical safety violation categories is defined, and an automated red teaming pipeline generates test cases targeting each category. 技術方法： RedVLA 是第一個用於 VLA 安全的物理紅隊框架。它系統性地生成對抗性物理場景（物體放置、指令變體、環境擾動）來探測 VLA 失敗模式。定義了物理安全違規類別目錄，自動紅隊流程生成針對每個類別的測試用例。

Key Takeaway: RedVLA reveals systematic physical safety vulnerabilities in state-of-the-art VLA models that are not detected by standard benchmarks, providing a practical methodology for pre-deployment safety certification. 核心發現： RedVLA 揭示了最先進 VLA 模型中的系統性物理安全漏洞，這些漏洞不被標準基準測試發現，為部署前安全認證提供了實用方法。

Adaptive vs. Static Robot-to-Human Handover: A Study on Orientation and Approach Direction

Authors: Federico Biagi, Dario Onfiani, Simone Silenzi, et al. | Submitted: 2026-04-24 | arXiv: 2604.22378 Categories: cs.RO

Research Background: Robot-to-human handovers often rely on static, open-loop strategies that do not consider how the object will be grasped by the human, requiring the user to adapt. Adaptive handover strategies that adjust delivery pose in real-time remain underexplored. 研究背景： 機器人到人類的交接通常依賴靜態的開環策略，不考慮人類如何抓握物體，要求用戶進行適應。實時調整交付姿態的自適應交接策略仍然未被充分探索。

Technical Approach: An adaptive framework dynamically adjusts the object’s delivery pose in real time based on the user’s hand pose and intended downstream grasp, using computer vision to estimate grasp intent and a reactive motion planner to modify the handover trajectory accordingly. A user study evaluates comfort, effort, and naturalness against static baselines. 技術方法： 自適應框架根據用戶的手部姿態和預期的下游抓握實時動態調整物體的交付姿態，使用計算機視覺估計抓握意圖，並使用反應性運動規劃器相應地修改交接軌跡。用戶研究評估與靜態基線相比的舒適度、努力程度和自然度。

Key Takeaway: Adaptive handover consistently outperforms static approaches in user preference and objective metrics, with orientation adaptation providing larger gains than approach direction adaptation. 核心發現： 自適應交接在用戶偏好和客觀指標上一貫優於靜態方法，方向適應比接近方向適應提供更大的收益。

CodeGraphVLP: Code-as-Planner Meets Semantic-Graph State for Non-Markovian VLA Models

Authors: Khoa Vo, Sieu Tran, Taisei Hanyu, et al. | Submitted: 2026-04-24 | arXiv: 2604.22238 Categories: cs.RO

Research Background: VLA models are typically trained as short-horizon policies assuming the latest observation suffices for action reasoning. This breaks in non-Markovian long-horizon tasks where task-relevant evidence appears only earlier in the trajectory or is occluded by distractors. 研究背景： VLA 模型通常被訓練為短時程策略，假設最新的觀察足以進行動作推理。這在非馬爾可夫長時程任務中會失效，其中任務相關證據只在軌跡早期出現或被干擾物遮擋。

Technical Approach: CodeGraphVLP combines code-as-planner (LLM generates Python task programs) with a semantic scene graph state that maintains persistent object-relationship memory across steps. The graph is updated from each observation and queried by the code planner to handle non-Markovian dependencies. The system does not require re-observing occluded objects. 技術方法： CodeGraphVLP 將代碼即規劃者（LLM 生成 Python 任務程序）與語義場景圖狀態相結合，跨步驟維護持久的物體關係記憶。圖從每次觀察更新並由代碼規劃者查詢，以處理非馬爾可夫依賴關係。系統不需要重新觀察被遮擋的物體。

Key Takeaway: CodeGraphVLP substantially outperforms baseline VLAs on non-Markovian manipulation benchmarks requiring history-dependent reasoning, with the graph state providing most of the benefit. 核心發現： CodeGraphVLP 在需要歷史依賴推理的非馬爾可夫操作基準上大幅優於基線 VLA，圖狀態提供了大部分收益。

Long-Horizon Manipulation via Trace-Conditioned VLA Planning

Authors: Isabella Liu, An-Chieh Cheng, Rui Yan, et al. | Submitted: 2026-04-23 | arXiv: 2604.21924 Categories: cs.RO

Research Background: Long-horizon manipulation remains challenging for VLA policies: real tasks are multi-step, progress-dependent, and brittle to compounding execution errors. Scaling short-horizon VLA execution to long-horizon tasks requires explicit task management. 研究背景： 長時程操作對 VLA 策略仍然具有挑戰性：真實任務是多步驟的、進度依賴的，且對於累積執行錯誤脆弱。將短時程 VLA 執行擴展到長時程任務需要明確的任務管理。

Technical Approach: LoHo-Manip is a modular framework with a dedicated task-management VLM decoupled from the executor VLA. The manager is invoked on a progress-based trigger to generate a trace — a structured plan with state checkpoints — that conditions the executor for the next subtask. Progress is assessed by comparing current observations against expected states. 技術方法： LoHo-Manip 是一個模組化框架，具有與執行器 VLA 解耦的專用任務管理 VLM。管理器根據進度觸發器被調用，生成一個跡——帶有狀態檢查點的結構化計劃——為下一個子任務條件化執行器。通過將當前觀察與預期狀態進行比較來評估進度。

Key Takeaway: Trace-conditioned planning significantly improves success rates on long-horizon household manipulation tasks by providing structured progress conditioning and enabling graceful error recovery between subtasks. 核心發現： 跡條件規劃通過提供結構化進度條件並在子任務之間實現優雅的錯誤恢復，顯著提高了長時程家庭操作任務的成功率。

Hi-WM: Human-in-the-World-Model for Scalable Robot Post-Training

Authors: Yaxuan Li, Zhongyi Zhou, Yefei Chen, et al. | Submitted: 2026-04-23 | arXiv: 2604.21741 Categories: cs.RO

Research Background: Post-training is essential for turning pretrained generalist robot policies into reliable task-specific controllers. Existing human-in-the-loop pipelines remain tied to physical execution: each correction requires robot time, scene setup, resets, and operator supervision in the real world. 研究背景： 後訓練對於將預訓練通才機器人策略轉化為可靠的任務特定控制器至關重要。現有的人在迴路管道與物理執行綁定：每次修正都需要機器人時間、場景設置、重置和真實世界中的操作員監督。

Technical Approach: Hi-WM uses an action-conditioned world model to simulate robot behavior in imagined environments. Human operators provide corrections and demonstrations within the world model’s generated videos rather than in the real world. The world model is conditioned on human inputs to generate plausible corrective trajectories, which are then used for offline policy post-training. 技術方法： Hi-WM 使用動作條件世界模型在想象環境中模擬機器人行為。人類操作員在世界模型生成的影片中提供修正和示範，而非在真實世界中。世界模型以人類輸入為條件生成合理的修正軌跡，然後用於離線策略後訓練。

Key Takeaway: Human-in-the-world-model post-training achieves comparable improvement to real-world human-in-the-loop post-training at a fraction of the cost, with no physical robot interaction required during the correction phase. 核心發現： 人在世界模型中的後訓練以極小的成本實現了與真實世界人在迴路後訓練相當的提升，在修正階段不需要物理機器人互動。

From Noise to Intent: Anchoring Generative VLA Policies with Residual Bridges

Authors: Yiming Zhong, Yaoyu He, Zemin Yang, et al. | Submitted: 2026-04-23 | arXiv: 2604.21391 Categories: cs.RO, cs.AI

Research Background: Generative VLA policies typically adopt a “generation-from-noise” paradigm that disregards the fundamental spatiotemporal scale mismatch between high-level semantic understanding and low-level physical control, leading to representation inefficiency and weak conditioning. 研究背景： 生成型 VLA 策略通常採用「從噪聲生成」範式，忽視了高層語義理解和低層物理控制之間的根本時空尺度不匹配，導致表示效率低下和弱條件化。

Technical Approach: Residual Bridges anchor the generative process by computing a semantic “bridge” from the language intent and current observation, then generating actions as residuals relative to this anchor rather than from pure noise. This constrains the generation to semantically consistent regions of action space and accelerates sampling convergence. 技術方法： 殘差橋接通過計算語言意圖和當前觀察的語義「橋接」來錨定生成過程，然後相對於此錨定而非純噪聲生成動作作為殘差。這將生成限制在語義一致的動作空間區域並加速採樣收斂。

Key Takeaway: Residual-bridged VLA generation achieves better task performance and faster inference than generation-from-noise baselines, with the anchor providing strong semantic conditioning that reduces exploration of physically infeasible action regions. 核心發現： 殘差橋接 VLA 生成實現了比從噪聲生成基線更好的任務性能和更快的推理，錨點提供了強有力的語義條件，減少了對物理不可行動作區域的探索。

FingerViP: Learning Real-World Dexterous Manipulation with Fingertip Visual Perception

Authors: Zhen Zhang, Weinan Wang, Hejia Sun, et al. | Submitted: 2026-04-23 | arXiv: 2604.21331 Categories: cs.RO

Research Background: Current dexterous manipulation relies primarily on a single wrist-mounted camera, which is often occluded during fine-grained manipulation. Multi-view perception is needed but existing fingertip camera approaches lack integrated learning frameworks. 研究背景： 目前的靈巧操作主要依賴單個腕部安裝相機，在精細操作期間通常被遮擋。需要多視角感知，但現有的指尖相機方法缺乏整合的學習框架。

Technical Approach: FingerViP attaches vision sensors to fingertips and trains a visuomotor policy using multi-view fusion. A vision-enhanced fingertip module processes egocentric fingertip views alongside the wrist view, with cross-view attention aggregating complementary spatial information. The system is trained end-to-end with real robot demonstrations. 技術方法： FingerViP 將視覺感測器附加到指尖，並使用多視角融合訓練視覺運動策略。視覺增強的指尖模組處理以指尖為中心的視角和腕部視角，跨視角注意力聚合互補的空間信息。系統使用真實機器人示範進行端到端訓練。

Key Takeaway: Fingertip visual perception significantly improves dexterous manipulation success rates on tasks requiring precise contact localization, with the fingertip views providing critical information during occlusion-heavy manipulation phases. 核心發現： 指尖視覺感知在需要精確接觸定位的任務上顯著提高靈巧操作成功率，指尖視角在遮擋嚴重的操作階段提供關鍵信息。

CorridorVLA: Explicit Spatial Constraints for Generative Action Heads via Sparse Anchors

Authors: Dachong Li, ZhuangZhuang Chen, Jin Zhang, Jianqiang Li | Submitted: 2026-04-23 | arXiv: 2604.21241 Categories: cs.RO, cs.AI

Research Background: VLA models often use intermediate representations to connect multimodal inputs with continuous control, yet spatial guidance is typically injected implicitly through latent features without explicit geometric constraints on the generated trajectories. 研究背景： VLA 模型通常使用中間表示連接多模態輸入與連續控制，但空間引導通常通過潛在特徵隱式注入，對生成的軌跡沒有明確的幾何約束。

Technical Approach: CorridorVLA predicts sparse spatial anchors as incremental physical changes (Δ-positions) and uses them to impose an explicit tolerance corridor in the training objective. The corridor constrains the generative action head to produce trajectories that pass through anchor-defined waypoints, converting soft semantic guidance into hard geometric bounds. 技術方法： CorridorVLA 將稀疏空間錨點預測為增量物理變化（Δ位置），並用它們在訓練目標中施加明確的容忍走廊。走廊將生成動作頭限制為產生通過錨點定義的路徑點的軌跡，將軟語義引導轉化為硬幾何邊界。

Key Takeaway: Explicit corridor constraints improve manipulation precision and reduce out-of-distribution trajectory generation, with sparse anchors providing enough geometric structure to substantially improve success rates on precision-critical tasks. 核心發現： 明確的走廊約束提高操作精度並減少分佈外軌跡生成，稀疏錨點提供足夠的幾何結構，大幅提高精度關鍵任務的成功率。

How VLAs (Really) Work In Open-World Environments

Authors: Amir Rasouli, Yangzheng Wu, Zhiyuan Li, et al. | Submitted: 2026-04-23 | arXiv: 2604.21192 Categories: cs.RO, cs.AI

Research Background: VLA models have been extensively evaluated on curated benchmarks with high success rates. Recent evidence suggests a systematic misalignment between benchmark success and true embodied reasoning, raising the question of whether high scores reflect genuine cognitive capability. 研究背景： VLA 模型已在精心策劃的基準上進行廣泛評估，成功率很高。近期證據表明基準成功與真正的具身推理之間存在系統性不一致，引發了關於高分是否反映真正認知能力的問題。

Technical Approach: A rigorous empirical investigation of VLA behavior in open-world environments (BEHAVIOR1K benchmark) using fine-grained analysis beyond success rate. The study examines where VLAs fail (spatial reasoning, object permanence, long-horizon planning), how failures cluster by task type, and whether success is correlated with task complexity or correlates with simpler shortcuts. 技術方法： 在開放世界環境（BEHAVIOR1K 基準）中對 VLA 行為進行嚴格的實證研究，使用成功率之外的細粒度分析。研究檢查 VLA 在哪裡失敗（空間推理、物體永久性、長時程規劃）、失敗如何按任務類型聚類，以及成功是否與任務複雜性相關或與更簡單的捷徑相關。

Key Takeaway: VLAs exhibit systematic failures in open-world environments driven by poor spatial grounding and object permanence, revealing that benchmark success rates substantially overestimate real-world reasoning capabilities. 核心發現： VLA 在開放世界環境中由於空間定位和物體永久性差而表現出系統性失敗，揭示了基準成功率大幅高估真實世界推理能力。

PokeVLA: Empowering Pocket-Sized VLA with Comprehensive World Knowledge Guidance

Authors: Yupeng Zheng, Xiang Li, Songen Gu, et al. | Submitted: 2026-04-22 | arXiv: 2604.20834 Categories: cs.RO

Research Background: Existing VLA methods exhibit limited efficiency and lack high-level knowledge and spatial awareness, requiring large model sizes for competitive performance. A compact yet capable VLA model that efficiently infuses world knowledge is needed. 研究背景： 現有的 VLA 方法表現出有限的效率，並且缺乏高層知識和空間感知，需要大型模型大小才能取得競爭性能。需要一種緊湊但功能強大的 VLA 模型，能夠有效地注入世界知識。

Technical Approach: PokeVLA is a lightweight foundation model that distills comprehensive world knowledge (spatial understanding, object affordances, physics priors) from a large teacher VLM into a compact student policy. Knowledge distillation focuses specifically on spatial and physical reasoning, with separate distillation objectives for geometric and semantic aspects. 技術方法： PokeVLA 是一個輕量級基礎模型，從大型教師 VLM 將全面的世界知識（空間理解、物體可用性、物理先驗）蒸餾到緊湊的學生策略中。知識蒸餾專門關注空間和物理推理，對幾何和語義方面具有獨立的蒸餾目標。

Key Takeaway: PokeVLA achieves competitive performance with larger VLA models while being significantly more efficient, demonstrating that targeted world knowledge distillation can compensate for reduced model capacity. 核心發現： PokeVLA 在顯著更高效的情況下實現了與較大 VLA 模型競爭的性能，表明有針對性的世界知識蒸餾可以補償降低的模型容量。

Temporal Difference Calibration in Sequential Tasks: Application to VLA Models

Authors: Shelly Francis-Meretzki, Mirco Mutti, Yaniv Romano, Aviv Tamar | Submitted: 2026-04-22 | arXiv: 2604.20472 Categories: cs.RO, cs.LG

Research Background: Reliable uncertainty quantification in VLA sequential tasks remains largely unexplored, especially when only partial trajectories are observed. Standard calibration methods assume i.i.d. data and fail in sequential settings where confidence should evolve with task progress. 研究背景： VLA 序列任務中可靠的不確定性量化在很大程度上尚未被探索，尤其是當只觀察到部分軌跡時。標準校正方法假設 i.i.d. 數據，在信心應隨任務進度演變的序列設置中失效。

Technical Approach: The paper formulates sequential calibration for episodic tasks where task-success confidence must be reliably estimated from partial trajectories. Temporal difference calibration borrows from TD learning to propagate calibration signals backward through the trajectory, producing confidence estimates that are calibrated at each step rather than only at episode completion. 技術方法： 論文制定了情節任務的序列校正，其中任務成功信心必須從部分軌跡中可靠估計。時間差分校正借鑒 TD 學習，通過軌跡向後傳播校正信號，在每個步驟而非僅在情節完成時產生校正的信心估計。

Key Takeaway: TD calibration produces significantly better-calibrated uncertainty estimates for VLA sequential tasks compared to post-hoc calibration, with particularly large gains for early trajectory steps where uncertainty is highest. 核心發現： 與事後校正相比，TD 校正為 VLA 序列任務產生顯著更好校正的不確定性估計，在不確定性最高的早期軌跡步驟中收益特別大。

VTouch++: A Multimodal Dataset with Vision-Based Tactile Enhancement for Bimanual Manipulation

Authors: Qianxi Hua, Xinyue Li, Zheng Yan, et al. | Submitted: 2026-04-22 | arXiv: 2604.20444 Categories: cs.RO, cs.AI

Research Background: Bimanual manipulation in contact-rich tasks remains challenging due to lack of datasets with rich physical interaction signals, systematic task organization, and sufficient scale. Vision-based tactile sensing offers a scalable path to capturing contact information. 研究背景： 接觸豐富任務中的雙手操作由於缺乏具有豐富物理互動信號、系統化任務組織和足夠規模的數據集而仍然具有挑戰性。基於視覺的觸覺感測提供了捕獲接觸信息的可擴展途徑。

Technical Approach: The VTOUCH dataset uses vision-based tactile sensors (GelSight-style) integrated into a bimanual robot setup to collect demonstrations of 100+ contact-rich household tasks. Each demonstration includes synchronized RGB, depth, wrist cameras, vision-tactile readings from both hands, and 6-DoF force-torque. A systematic task taxonomy organizes tasks by contact type and manipulation primitive. 技術方法： VTOUCH 數據集使用整合到雙手機器人設置中的基於視覺的觸覺感測器（GelSight 風格），收集 100+ 種接觸豐富家庭任務的示範。每個示範包括同步的 RGB、深度、腕部相機、雙手的視覺觸覺讀數和 6-DoF 力矩。系統化任務分類法按接觸類型和操作原語組織任務。

Key Takeaway: Policies trained with vision-tactile data significantly outperform vision-only baselines on contact-rich bimanual tasks, and the dataset’s scale and diversity enable generalization across novel objects and task variants. 核心發現： 使用視覺觸覺數據訓練的策略在接觸豐富的雙手任務上顯著優於僅視覺基線，數據集的規模和多樣性使其能夠泛化到新物體和任務變體。

Cortex 2.0: Grounding World Models in Real-World Industrial Deployment

Authors: Adriana Aida, Walid Amer, Katarina Bankovic, et al. | Submitted: 2026-04-22 | arXiv: 2604.20246 Categories: cs.RO, cs.AI

Research Background: Industrial robotic manipulation demands reliable long-horizon execution across embodiments, tasks, and changing object distributions. VLA models are fundamentally reactive — optimizing next action from current observation without evaluating potential futures — making them brittle to compounding failure modes. 研究背景： 工業機器人操作需要跨具身、任務和不斷變化的物體分佈進行可靠的長時程執行。VLA 模型從根本上是反應性的——從當前觀察優化下一個動作而不評估潛在未來——使它們容易受到累積失敗模式的影響。

Technical Approach: Cortex 2.0 augments reactive VLA policies with a grounded world model that predicts outcomes of candidate action sequences before execution. The world model is grounded in real-world industrial data (material properties, deformation, collision) and is used for look-ahead planning and anomaly detection during execution. A hierarchical architecture handles plan revision when the world model predicts failures. 技術方法： Cortex 2.0 通過在執行前預測候選動作序列結果的接地世界模型來增強反應性 VLA 策略。世界模型在真實世界工業數據（材料屬性、變形、碰撞）中接地，用於執行期間的前瞻規劃和異常檢測。層次化架構在世界模型預測失敗時處理計劃修訂。

Key Takeaway: World-model augmentation substantially reduces failure rates in real industrial deployment compared to reactive VLAs, with look-ahead planning providing the most benefit on tasks requiring careful material handling. 核心發現： 與反應性 VLA 相比，世界模型增強在真實工業部署中大幅降低失敗率，前瞻規劃在需要謹慎材料處理的任務上提供最大收益。

UniT: Toward a Unified Physical Language for Human-to-Humanoid Policy Learning

Authors: Boyu Chen, Yi Chen, Lu Qiu, et al. | Submitted: 2026-04-21 | arXiv: 2604.19734 Categories: cs.RO, cs.AI

Research Background: Scaling humanoid foundation models is bottlenecked by the scarcity of robotic data. Massive egocentric human data offers a scalable alternative, but bridging the cross-embodiment chasm due to kinematic mismatches remains a fundamental challenge. 研究背景： 人形機器人基礎模型的擴展受到機器人數據稀缺的瓶頸限制。大量以自我為中心的人類數據提供了一種可擴展的替代方案，但由於運動學不匹配，跨具身鴻溝的橋接仍然是一個根本性挑戰。

Technical Approach: UniT (Unified Latent Action Tokenizer via Visual Anchoring) establishes a unified physical language through visual anchoring: key visual keypoints shared across human and humanoid bodies serve as geometry-invariant anchors. Actions are represented as displacements of these anchor points, creating a representation that transfers across kinematic configurations without explicit retargeting. 技術方法： UniT（通過視覺錨定的統一潛在動作分詞器）通過視覺錨定建立統一的物理語言：人類和人形機器人身體共享的關鍵視覺關鍵點作為幾何不變錨點。動作被表示為這些錨點的位移，創建了一種無需明確重定向即可跨運動學配置轉移的表示。

Key Takeaway: UniT enables effective human-to-humanoid policy transfer by eliminating the need for explicit kinematic retargeting, with visual anchor representations providing sufficient cross-embodiment alignment for downstream policy learning. 核心發現： UniT 通過消除明確運動學重定向的需求實現有效的人類到人形機器人策略轉移，視覺錨點表示為下游策略學習提供了足夠的跨具身對齊。

VLA Foundry: A Unified Framework for Training Vision-Language-Action Models

Authors: Jean Mercat, Sedrick Keh, Kushal Arora, et al. | Submitted: 2026-04-21 | arXiv: 2604.19728 Categories: cs.RO, cs.AI, cs.CV, cs.LG, cs.SE

Research Background: Most open-source VLA efforts specialize on the action training stage, often stitching together incompatible pretraining pipelines. A unified training stack spanning LLM pretraining to action-expert fine-tuning is needed to enable reproducible, comparable VLA research. 研究背景： 大多數開源 VLA 工作專注於動作訓練階段，通常將不兼容的預訓練管道拼接在一起。需要從 LLM 預訓練到動作專家微調的統一訓練堆棧，以實現可重複的、可比較的 VLA 研究。

Technical Approach: VLA Foundry provides a shared training stack with end-to-end control, supporting LLM language pretraining, VLM visual pretraining, and VLA action fine-tuning in a single codebase. Modular configuration allows switching between architectures, action representations (chunking vs. flow matching vs. tokenization), and datasets, with consistent logging and evaluation. 技術方法： VLA Foundry 提供具有端到端控制的共享訓練堆棧，在單一代碼庫中支持 LLM 語言預訓練、VLM 視覺預訓練和 VLA 動作微調。模組化配置允許在架構、動作表示（分組 vs. 流匹配 vs. 分詞）和數據集之間切換，具有一致的日誌記錄和評估。

Key Takeaway: VLA Foundry enables full training reproducibility and architecture ablation studies across the entire VLA training pipeline, revealing important insights about how pretraining choices affect downstream action performance. 核心發現： VLA Foundry 在整個 VLA 訓練流程中實現完整的訓練可重複性和架構消融研究，揭示了預訓練選擇如何影響下游動作性能的重要見解。

Mask World Model: Predicting What Matters for Robust Robot Policy Learning

Authors: Yunfan Lou, Xiaowei Chi, Xiaojie Zhang, et al. | Submitted: 2026-04-21 | arXiv: 2604.19683 Categories: cs.RO

Research Background: World models derived from video generative pretraining often focus on high-fidelity RGB prediction, resulting in overfitting to irrelevant factors such as dynamic backgrounds and illumination changes that reduce generalization. 研究背景： 從影片生成預訓練衍生的世界模型通常關注高保真 RGB 預測，導致過擬合到動態背景和光照變化等不相關因素，降低泛化能力。

Technical Approach: The Mask World Model (MWM) uses predicted segmentation masks to focus video prediction on task-relevant object regions. A mask-conditioned prediction head is supervised only on masked regions, explicitly preventing the model from learning background dynamics. The masking policy is learned jointly with the world model using task-relevance signals. 技術方法： Mask World Model (MWM) 使用預測的分割遮罩將視頻預測聚焦在任務相關的物體區域。遮罩條件預測頭僅在遮罩區域上受監督，明確防止模型學習背景動態。遮罩策略與世界模型使用任務相關性信號聯合學習。

Key Takeaway: Mask-focused world model pretraining produces policies that generalize significantly better to scene appearance variations compared to full-scene video prediction, with the masking approach providing the dominant benefit over other distractors. 核心發現： 遮罩聚焦的世界模型預訓練產生的策略與完整場景視頻預測相比，對場景外觀變化的泛化能力顯著更好，遮罩方法提供了比其他干擾物更主要的收益。

SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergy

Authors: Wei Yao, Haohan Ma, Hongwen Zhang, et al. | Submitted: 2026-04-20 | arXiv: 2604.18557 Categories: cs.CV, cs.GR, cs.RO

Research Background: Cooperative humanoid manipulation faces severe data scarcity, complexity in multi-agent coordination, and limited generalization across objects. Generating physically plausible cooperative manipulation data at scale is a key bottleneck. 研究背景： 合作型人形機器人操作面臨嚴重的數據稀缺性、多代理協調的複雜性以及跨物體泛化有限的問題。大規模生成物理上合理的合作操作數據是一個關鍵瓶頸。

Technical Approach: SynAgent leverages a Solo-to-Cooperative Agent Synergy framework: solo manipulation demonstrations are collected from a single agent and then automatically converted to cooperative demonstrations using contact-aware trajectory splitting. The framework synthesizes paired solo-cooperative data and trains a generalizable cooperative policy with embodiment-agnostic representations. 技術方法： SynAgent 利用獨立到合作代理協同框架：從單個代理收集獨立操作示範，然後使用接觸感知軌跡分割自動轉換為合作示範。框架合成配對的獨立-合作數據，並使用具身無關表示訓練可泛化的合作策略。

Key Takeaway: SynAgent achieves strong generalization to unseen object categories in cooperative manipulation without requiring paired cooperative demonstrations, with the solo-to-cooperative synthesis providing effective data augmentation for multi-agent policies. 核心發現： SynAgent 在不需要配對合作示範的情況下實現了對未見物體類別的強泛化，獨立到合作合成為多代理策略提供了有效的數據增強。

Unmasking the Illusion of Embodied Reasoning in Vision-Language-Action Models

Authors: Haiweng Xu, Sipeng Zheng, Hao Luo, et al. | Submitted: 2026-04-20 | arXiv: 2604.18000 Categories: cs.RO

Research Background: Recent VLA models report impressive success rates on standard benchmarks, fueling optimism about general-purpose physical intelligence. However, evidence suggests a systematic misalignment between benchmark success and true embodied reasoning capability. 研究背景： 近期 VLA 模型在標準基準上報告了令人印象深刻的成功率，助長了對通用物理智能的樂觀情緒。然而，證據表明基準成功與真正的具身推理能力之間存在系統性不一致。

Technical Approach: A diagnostic benchmark is constructed with controlled task variations that systematically probe visual understanding, spatial reasoning, and causal inference independently. The study decomposes benchmark success into primitive reasoning subskills and tests whether VLA success rates are truly driven by reasoning or by surface-level pattern matching. 技術方法： 構建了一個診斷基準，具有受控的任務變體，系統性地獨立探測視覺理解、空間推理和因果推斷。研究將基準成功分解為原始推理子技能，並測試 VLA 成功率是否真的由推理或表面模式匹配驅動。

Key Takeaway: State-of-the-art VLAs systematically fail at novel primitive reasoning probes even when achieving high overall benchmark scores, confirming that reported success rates substantially overstate genuine embodied reasoning capability. 核心發現： 最先進的 VLA 在取得高整體基準分數的同時系統性地在新型原始推理探針上失敗，確認了報告的成功率大幅高估了真正的具身推理能力。

Can Explicit Physical Feasibility Benefit VLA Learning? An Empirical Study

Authors: Yubai Wei, Chen Wu, Hashem Haghbayan | Submitted: 2026-04-20 | arXiv: 2604.17896 Categories: cs.LG, cs.AI, cs.RO

Research Background: VLA models are trained via large-scale imitation learning without explicit supervision on physical constraints such as obstacle avoidance or kinematic feasibility, potentially producing geometrically inconsistent action sequences. 研究背景： VLA 模型通過大規模模仿學習訓練，對物理約束（如避障或運動學可行性）沒有明確的監督，可能產生幾何上不一致的動作序列。

Technical Approach: An empirical study adds explicit physical feasibility supervision to standard VLA training via constraint satisfaction losses (collision avoidance, joint limit, smoothness). The study ablates different constraint types and examines whether explicit feasibility supervision improves generalization, reduces constraint violations, or provides complementary information to the imitation signal. 技術方法： 實證研究通過約束滿足損失（避障、關節限制、平滑性）向標準 VLA 訓練添加明確的物理可行性監督。研究消融了不同的約束類型，並檢查明確可行性監督是否改善泛化、減少約束違規或為模仿信號提供互補信息。

Key Takeaway: Explicit physical feasibility supervision consistently improves VLA performance on out-of-distribution tasks and reduces constraint violations, with kinematic feasibility constraints providing the largest gains. 核心發現： 明確的物理可行性監督一貫改善 VLA 在分佈外任務上的性能並減少約束違規，運動學可行性約束提供最大收益。

ST-π: Structured SpatioTemporal VLA for Robotic Manipulation

Authors: Chuanhao Ma, Hanyu Zhou, Shihan Peng, et al. | Submitted: 2026-04-20 | arXiv: 2604.17880 Categories: cs.RO, cs.CV

Research Background: VLA models struggle with fine-grained spatiotemporal manipulation that requires simultaneously tracking object positions and predicting temporally consistent action sequences. Spatiotemporal knowledge is typically embedded implicitly without structured reasoning. 研究背景： VLA 模型在需要同時追蹤物體位置和預測時間一致動作序列的細粒度時空操作中掙扎。時空知識通常被隱式嵌入而沒有結構化推理。

Technical Approach: ST-π introduces structured spatiotemporal representations that explicitly encode 3D object locations as spatial tokens and temporal action dependencies as sequence-level attention masks. Spatial tokens anchor action predictions to physically grounded object positions, while the temporal attention structure enforces causal consistency across the action chunk. 技術方法： ST-π 引入結構化時空表示，將 3D 物體位置明確編碼為空間 token，將時間動作依賴關係編碼為序列級注意力遮罩。空間 token 將動作預測錨定到物理接地的物體位置，而時間注意力結構在動作分組中強制因果一致性。

Key Takeaway: Structured spatiotemporal representations significantly improve fine-grained manipulation precision and reduce temporal inconsistencies in action sequences, with spatial grounding providing the dominant benefit for precision-critical tasks. 核心發現： 結構化時空表示顯著提高細粒度操作精度並減少動作序列中的時間不一致，空間定位為精度關鍵任務提供主要收益。

ReFineVLA: Multimodal Reasoning-Aware Generalist Robotic Policies via Teacher-Guided Fine-Tuning

Authors: Tuan Van Vo, Tan Q. Nguyen, Khang Nguyen, et al. | Submitted: 2026-04-20 | arXiv: 2604.17800 Categories: cs.RO, cs.CV

Research Background: VLA models often overlook explicit reasoning, learning input-action mappings while omitting crucial logical steps. This is especially pronounced in interactive manipulation scenarios requiring multi-step causal reasoning. 研究背景： VLA 模型通常忽視明確推理，學習輸入-動作映射而省略關鍵邏輯步驟。這在需要多步驟因果推理的互動操作場景中尤為明顯。

Technical Approach: ReFineVLA uses a reasoning-aware teacher to generate chain-of-thought rationales for manipulation decisions, then distills these reasoning traces into the student VLA via teacher-guided fine-tuning. The distillation aligns the student’s latent representations with the teacher’s reasoning states, implicitly embedding logical structure without requiring explicit chain-of-thought at inference. 技術方法： ReFineVLA 使用推理感知教師為操作決策生成思維鏈原理，然後通過教師引導微調將這些推理跡蒸餾到學生 VLA 中。蒸餾將學生的潛在表示與教師的推理狀態對齊，在推理時不需要明確的思維鏈即可隱式嵌入邏輯結構。

Key Takeaway: Reasoning-aware distillation significantly improves VLA performance on tasks requiring multi-step logical reasoning, with the teacher’s rationales providing training signal that improves compositional generalization. 核心發現： 推理感知蒸餾顯著提升需要多步驟邏輯推理的任務上的 VLA 性能，教師的原理提供了改善組合泛化的訓練信號。

AnchorRefine: Trajectory Anchor and Residual Refinement for Vision-Language-Action Models

Authors: Tingzheng Jia, Kan Guo, Lanping Qian, et al. | Submitted: 2026-04-20 | arXiv: 2604.17787 Categories: cs.RO, cs.AI

Research Background: Precision-critical manipulation requires both global trajectory organization and local execution correction. Monolithic VLA policies generate actions in a single unified space, forcing macro-level transport and micro-level refinement to be optimized under the same objective. 研究背景： 精度關鍵操作需要全局軌跡組織和局部執行修正。整體 VLA 策略在單一統一空間中生成動作，迫使宏觀層面的傳輸和微觀層面的精煉在相同目標下優化。

Technical Approach: AnchorRefine introduces a two-stage prediction framework: a trajectory anchor module predicts coarse spatial waypoints defining the global manipulation intent, and a residual refinement module predicts fine-grained corrections relative to each anchor. The two objectives are trained independently and composed at inference for precision without sacrificing global trajectory quality. 技術方法： AnchorRefine 引入兩階段預測框架：軌跡錨點模組預測定義全局操作意圖的粗略空間路徑點，殘差精煉模組相對於每個錨點預測細粒度修正。兩個目標獨立訓練，並在推理時組合，在不犧牲全局軌跡質量的情況下實現精度。

Key Takeaway: Two-stage anchor-refinement significantly outperforms both monolithic policies and simple hierarchical decompositions on precision-critical tasks, with the residual objective enabling sub-millimeter accuracy without complex trajectory planning. 核心發現： 兩階段錨點-精煉在精度關鍵任務上顯著優於整體策略和簡單的層次化分解，殘差目標無需複雜軌跡規劃即可實現亞毫米精度。

OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RL

Authors: Haoxiang Jie, Yaoyuan Yan, Xiangyu Wei, et al. | Submitted: 2026-04-20 | arXiv: 2604.17706 Categories: cs.RO

Research Background: Existing VLA frameworks struggle with imprecise spatial perception, suboptimal multimodal fusion, and instability in RL fine-tuning. Bridging VLA pretraining with online RL requires addressing all three bottlenecks simultaneously. 研究背景： 現有的 VLA 框架在空間感知不精確、多模態融合次優以及 RL 微調不穩定方面存在困難。將 VLA 預訓練與在線 RL 橋接需要同時解決這三個瓶頸。

Technical Approach: OmniVLA-RL uses a Mix-of-Transformers (MoT) design that maintains separate transformer streams for reasoning, spatial understanding, and action prediction, fusing them through cross-stream attention. Spatial understanding uses depth-aware 3D representations, and online RL fine-tuning is stabilized through proximal policy constraint that prevents catastrophic forgetting of pretrained representations. 技術方法： OmniVLA-RL 使用 Mix-of-Transformers (MoT) 設計，為推理、空間理解和動作預測保持獨立的 transformer 流，通過跨流注意力融合它們。空間理解使用深度感知 3D 表示，在線 RL 微調通過近端策略約束穩定，防止預訓練表示的災難性遺忘。

Key Takeaway: The MoT architecture and 3D spatial representations enable significantly better spatial manipulation precision than baseline VLAs, and the RL fine-tuning stage further improves task-specific performance with stable convergence. 核心發現： MoT 架構和 3D 空間表示實現了比基線 VLA 顯著更好的空間操作精度，RL 微調階段進一步提高了具有穩定收斂的任務特定性能。

Score 8

Score 7

Peripheral Papers (Score 6)

Graph View