arXiv Weekly Digest — Week 28, 2026
Fetched: 2026-07-06 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 28
VLA-Corrector: Lightweight Detect-and-Correct Inference for Adaptive Action Horizon
Authors: Yi Pan, Miao Pan, Qi Lu et al. | Submitted: 2026-07-02 | arXiv: 2607.01804
Categories: cs.RO
Research Background: Generative robot policies use action chunking to reduce inference frequency, but executing a fixed sequence of future actions in open-loop leaves the system blind to unexpected perturbations — a critical weakness in contact-rich tasks where small disturbances compound quickly into failures. 研究背景： 生成式機器人策略透過動作分塊降低推論頻率，但以開放迴路方式執行固定的未來動作序列，使系統對突發干擾毫無反應——在接觸密集任務中，微小擾動會迅速累積放大為任務失敗。
Technical Approach: VLA-Corrector adds a lightweight Latent-space Vision Monitor (LVM) on top of a frozen backbone policy, which continuously measures the divergence between predicted and observed visual feature trajectories. When persistent deviation is detected, the system truncates the stale action chunk and triggers corrective replanning via Online Gradient Guidance (OGG), without updating any backbone weights. 技術方法： VLA-Corrector 在凍結的主幹策略之上，加入輕量級潛在空間視覺監視器（LVM），持續比對預測與實際視覺特徵軌跡之間的差異。一旦偵測到持續偏離，系統即截斷過時的動作序列，並透過線上梯度引導（OGG）觸發修正性重規劃，全程無需更新主幹模型權重。
Key Takeaway: The detect-and-correct mechanism yields an event-driven adaptive action horizon that naturally balances long-horizon efficiency with short-horizon closed-loop correction as execution conditions demand. 核心發現： 偵測-修正機制產生事件驅動的自適應動作時域，能依執行狀況自然平衡長時域效率與短時域閉環修正。
UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models
Authors: Xidong Zhang, Yichi Zhang, Jiaxin Shi et al. | Submitted: 2026-06-30 | arXiv: 2606.31723
Categories: cs.RO
Research Background: Despite strong results in many manipulation tasks, VLA models struggle with contact-rich dexterous manipulation because they lack access to direct force and contact information; existing tactile extensions treat touch signals as static auxiliary inputs rather than as dynamic interaction cues. 研究背景： 儘管 VLA 模型在多種操作任務中表現優異，但由於缺乏直接的接觸力資訊，在接觸密集的靈巧操作上仍有明顯不足；現有的觸覺延伸方法將觸覺信號視為靜態輔助輸入，而非動態互動線索。
Technical Approach: UniTacVLA builds a unified tactile latent space and jointly models current contact states and future contact changes through a tactile chain-of-thought reasoning process and a coarse-to-fine future tactile prediction module. The resulting dynamics-aware tactile prior drives a mixed controller that combines real-time and predicted tactile feedback to produce high-frequency corrections on top of low-frequency action chunks. 技術方法： UniTacVLA 建構統一的觸覺潛在空間，透過觸覺思維鏈推理與由粗到細的未來觸覺預測模組，聯合建模當前接觸狀態與未來接觸變化。所得的動態感知觸覺先驗驅動一個混合控制器，結合即時與預測觸覺回饋，對低頻動作分塊施以高頻修正。
Key Takeaway: Modeling tactile signals as predictive, dynamic interaction cues rather than passive sensor readings substantially improves performance in contact-rich dexterous manipulation. 核心發現： 將觸覺信號建模為預測性動態互動線索而非被動感測讀值，可顯著提升接觸密集靈巧操作的表現。
Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision
Authors: Haoyang Li, Guanlin Li, Youhe Feng et al. | Submitted: 2026-06-29 | arXiv: 2606.30552
Categories: cs.RO, cs.CV
Research Background: Cross-embodiment transfer in VLA models is fundamentally difficult because low-level action and state spaces differ across robot platforms, even though the high-level cognitive steps of manipulation — scene understanding, task planning, sub-task decomposition — are largely platform-agnostic. 研究背景： VLA 模型的跨本體遷移本質上困難，因為不同機器人平台的底層動作與狀態空間差異甚大，儘管操作所需的高層認知步驟——場景理解、任務規劃、子任務分解——在很大程度上是平台無關的。
Technical Approach: ZR-0 is a 2.6 billion parameter end-to-end VLA with a dual-stream architecture: a pretrained VLM (System 2) provides dense Embodied Chain-of-Thought (ECoT) reasoning supervision during training to align cross-embodiment representations, while a Diffusion Transformer action expert (System 1) generates continuous actions via flow matching. The two streams are coupled through cross-attention with a mask that lets ECoT generation be completely bypassed at inference without any performance degradation. 技術方法： ZR-0 是一個 26 億參數的端對端 VLA，採用雙流架構：預訓練 VLM（System 2）在訓練期間提供密集的具身思維鏈（ECoT）推理監督以對齊跨本體表示，而擴散 Transformer 動作專家（System 1）透過流匹配生成連續動作。兩個流透過交叉注意力耦合，並設有遮罩使推論時可完全跳過 ECoT 生成而不損失性能。
Key Takeaway: Dense ECoT supervision at training time effectively aligns representations across robot embodiments, and the architectural design allows zero inference overhead from that supervision at deployment. 核心發現： 訓練期間的密集 ECoT 監督能有效對齊不同機器人本體的表示，且架構設計使該監督在部署時不帶來任何推論額外開銷。
Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation
Authors: Chi Zhang, Penglin Cai, Ziheng Xi et al. | Submitted: 2026-07-01 | arXiv: 2607.01067
Categories: cs.RO, cs.CV
Research Background: Tactile sensing is essential for dexterous and contact-rich manipulation, yet robot tactile datasets remain small-scale and narrow in coverage due to hardware constraints; current VLA models that incorporate tactile modality are further limited by post-training approaches that ignore contact dynamics. 研究背景： 觸覺感測對靈巧與接觸密集操作至關重要，但受限於硬體條件，機器人觸覺資料集規模小且覆蓋有限；現有整合觸覺模態的 VLA 模型更因忽略接觸動態的後訓練方式而受到效能上限制約。
Technical Approach: H-Tac provides a large-scale dataset of 160 hours of egocentric human manipulation videos spanning over 300 tasks and 135k episodes. The Transferable Tactile Pre-Training (TTP) framework pre-trains on this human data using unified tactile and action spaces shared across pre-training and robot fine-tuning, with a dedicated tactile expert module that explicitly predicts future tactile states to model contact dynamics. 技術方法： H-Tac 提供大規模資料集，包含 160 小時以自我為中心的人類操作影片，涵蓋逾 300 項任務與 13.5 萬個片段。可遷移觸覺預訓練（TTP）框架在此人類資料上預訓練，預訓練與機器人微調階段共享統一的觸覺與動作空間，並透過專用觸覺專家模組明確預測未來觸覺狀態以建模接觸動態。
Key Takeaway: Pre-training on large-scale human tactile data with a shared representation space enables fine-grained contact dynamics modeling that transfers effectively to downstream robotic manipulation tasks. 核心發現： 在大規模人類觸覺資料上進行共享表示空間的預訓練，能建模精細的接觸動態，並有效遷移至下游機器人操作任務。
DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulation
Authors: Ziyu Shan, Zhenyu Wu, Xiaofeng Wang et al. | Submitted: 2026-06-30 | arXiv: 2606.32028
Categories: cs.RO
Research Background: Video-based world models for robotic manipulation must simultaneously capture fine-grained physical dynamics and synthesize high-resolution visual frames, but entangling these two objectives forces a trade-off between inference speed and prediction fidelity. 研究背景： 用於機器人操作的視訊世界模型必須同時捕捉精細的物理動態並合成高解析度視覺幀，但將這兩個目標耦合在一起，迫使推論速度與預測保真度之間做出取捨。
Technical Approach: DVG-WM explicitly separates world modeling into a dynamics learning stage and a visual synthesis stage. Given an initial observation and a language instruction, the model first uses flow matching to generate a plausible sequence of intermediate visual states representing the physical progression, then refines those states into high-fidelity video via a latent degradation mechanism that regenerates contact-rich details. 技術方法： DVG-WM 明確將世界建模分為動態學習與視覺合成兩個階段。給定初始觀測與語言指令，模型先透過流匹配生成代表物理演進的中間視覺狀態序列，再透過潛在退化機制將這些狀態精煉成高保真視訊，重新生成接觸密集的細節。
Key Takeaway: Disentangling dynamics from visual synthesis achieves up to 3.97x inference speedup while simultaneously improving video prediction quality over entangled baselines. 核心發現： 將動態與視覺合成解耦，在提升視訊預測品質的同時實現高達 3.97 倍的推論加速。
From Grasps to Dexterity: Large-Scale Grasp Pretraining for Dexterous Manipulation
Authors: Ying Yuan, Xinyu Liu, Sriram Krishna, David Held | Submitted: 2026-06-29 | arXiv: 2606.30749
Categories: cs.RO
Research Background: Large-scale dexterous grasp datasets encode rich priors about hand-object contact, but their utility has been confined almost entirely to grasp generation and simple pick-and-place; whether they can bootstrap functional tool-use dexterity — requiring sustained contact and actuation of moving parts — has not been established. 研究背景： 大規模靈巧抓取資料集編碼了豐富的手物接觸先驗，但其應用幾乎僅限於抓取生成與簡單取放；這些資料能否作為功能性工具使用靈巧度的基礎——需要持續接觸並操作活動部件——尚未得到驗證。
Technical Approach: The authors adapt a hierarchical imitation learning framework combining high-level hand sub-goal prediction with a low-level goal-conditioned controller, and pre-train it on a newly constructed 355k-trajectory dataset derived from large-scale dexterous grasp annotations. Evaluation is conducted on DexCraft, a new simulation benchmark covering six articulated tool-use tasks. 技術方法： 作者採用結合高層手部子目標預測與低層目標條件控制器的層次模仿學習框架，並在一個從大規模靈巧抓取標註衍生出的 35.5 萬條軌跡資料集上進行預訓練。評估在涵蓋六項關節工具使用任務的新型模擬基準 DexCraft 上進行。
Key Takeaway: Pretraining on large-scale grasp data transfers meaningfully to functional tool-use tasks, delivering a 33.3 percentage point improvement over the DP3 diffusion policy baseline in real-world full-task success. 核心發現： 在大規模抓取資料上的預訓練能有效遷移至功能性工具使用任務，在真實世界完整任務成功率上比 DP3 擴散策略基準提升 33.3 個百分點。
Sequential Planning via Anchored Robotic Keypoints
Authors: Bryce Grant, Aryeh Rothenberg, Logan Senning et al. | Submitted: 2026-06-29 | arXiv: 2606.30613
Categories: cs.RO
Research Background: Generalizing sequential manipulation across diverse tasks and robot platforms remains an open challenge; existing VLA and code-as-policy baselines struggle to compose reliable low-level control with robust object perception across multiple task cells. 研究背景： 在多樣任務與機器人平台上泛化序列操作仍是一項開放挑戰；現有的 VLA 與程式即策略基準難以將可靠的底層控制與跨多任務單元的穩健物件感知結合在一起。
Technical Approach: SPARK is a training-free neurosymbolic system where a single Gemini call composes a task plan as a typed behavior tree of reusable primitives, each encapsulating motion planning, grasping, and depth geometry. Object grounding uses a second Gemini call to generate three alternative text prompts per object, scores them with SAM3, and retains the highest-confidence detection; a recovery loop re-detects objects and retries any failed primitive. 技術方法： SPARK 是一個無需訓練的神經符號系統，單次 Gemini 呼叫將任務規劃組合為可重用基元的型別化行為樹，每個基元封裝運動規劃、抓取與深度幾何。物件定位透過第二次 Gemini 呼叫為每個物件生成三個候選文字提示，以 SAM3 評分並保留置信度最高的檢測結果；恢復迴圈在失敗時重新偵測物件並重試對應基元。
Key Takeaway: A training-free neurosymbolic approach combining LLM-composed behavior trees with multi-prompt visual grounding achieves 43.7% on LIBERO-PRO — more than doubling prior VLA baselines — and generalizes across three distinct robot families. 核心發現： 結合 LLM 組合行為樹與多提示視覺定位的無訓練神經符號方法，在 LIBERO-PRO 上達到 43.7%——超越先前 VLA 基準兩倍以上——並跨三種不同機器人家族實現泛化。
WorldSample: Closed-loop Real-robot RL with World Modelling
Authors: Yuquan Xue, Le Xu, Zeyi Liu et al. | Submitted: 2026-07-02 | arXiv: 2607.02431
Categories: cs.RO, cs.AI
Research Background: Reinforcement learning can extend robot skill acquisition beyond what imitation learning covers, but the high cost of physical interaction on real hardware makes RL deployment impractical at scale. 研究背景： 強化學習能讓機器人突破模仿學習的示範覆蓋限制，但在真實硬體上進行大量互動的成本極高，使得實機部署困難重重。
Technical Approach: WorldSample closes the loop between physical rollouts and synthetic data by using a post-trained world model to generate high-fidelity transitions, substantially reducing visual hallucinations. It also introduces Policy-Paced Learning (PPL), a curriculum that schedules which synthetic samples enter training to balance beneficial augmentation against value overestimation. 技術方法： WorldSample 透過一個後訓練的世界模型生成高品質合成轉移，在真實滾出與合成資料之間形成閉環，顯著降低視覺幻覺。此外，它引入「策略節奏學習」（PPL），透過樣本選擇與排程來平衡有效資料增強與價值過估。
Key Takeaway: On robot manipulation benchmarks, WorldSample raises policy success rate by 28% while cutting the required training steps by 59%. 核心發現： 在機械臂操作任務上，WorldSample 將策略成功率提升 28%，同時將所需訓練步數減少 59%。
ACID: Action Consistency via Inverse Dynamics for Planning with World Models
Authors: Gawon Seo, Dongwon Kim, Suha Kwak | Submitted: 2026-07-02 | arXiv: 2607.02403
Categories: cs.RO, cs.AI, cs.CV
Research Background: Decision-time planning with world models has become central to embodied control, yet standard planning objectives only evaluate how well a predicted final state matches the goal, ignoring whether the intermediate transitions are physically realizable. 研究背景： 以世界模型進行決策期規劃已成為具身控制的主流範式，然而標準規劃目標僅評估預測終態與目標的相近程度，忽略中間轉移是否在物理上可行。
Technical Approach: ACID introduces a cycle action consistency constraint: an inverse dynamics model should be able to reconstruct the original action from each predicted transition, and any residual is incorporated into the planning cost via a scale-invariant adaptive weight. This per-step check ensures intermediate rollouts remain grounded without requiring additional training of the world model. 技術方法： ACID 引入循環動作一致性約束：逆動力學模型應能從每個預測轉移重建原始動作，其殘差透過尺度不變的自適應權重整合至規劃成本。此逐步驗證確保中間推演保持可實現性，無需重新訓練世界模型。
Key Takeaway: Across four world models and six manipulation and navigation tasks, ACID consistently improves planning quality while matching baseline accuracy with significantly less compute. 核心發現： 在四個世界模型和六項操作與導航任務上，ACID 以更少的計算量持續提升規劃品質，並達到與基準相當的精確度。
Bridge-WA: Predicting Where and How the World Changes for Robotic Action
Authors: Yongjie Bai, Hanting Wang, Mingtong Dai et al. | Submitted: 2026-07-02 | arXiv: 2607.02195
Categories: cs.RO
Research Background: Vision-language-action models benefit from rich semantic priors, but successful manipulation additionally demands the ability to anticipate how task-relevant parts of a scene will change — something heavyweight generative world models handle at prohibitive cost. 研究背景： 視覺-語言-動作模型能利用豐富的語義先驗，但有效操作還需預判場景中與任務相關的部分如何改變，而現有大型生成式世界模型的計算成本過高。
Technical Approach: Bridge-WA distills a frozen future-change teacher model into three lightweight prior representations — future tokens capturing intended outcomes, change maps highlighting intervention regions, and motion-flow maps encoding local transition directions. A WorldBridge module conditions the action transformer on these priors through multi-source attention and spatiotemporal biases, and the teacher is discarded entirely at inference. 技術方法： Bridge-WA 將凍結的未來變化教師模型蒸餾為三種輕量先驗：編碼預期結果的未來詞元、標示介入區域的變化圖，以及編碼局部轉移方向的運動流圖。WorldBridge 模組透過多源注意力與時空偏置將這些先驗融入動作Transformer，推理時教師模型完全移除。
Key Takeaway: Bridge-WA improves task success, progress, and robustness — with the most pronounced gains when the robot encounters visual conditions that differ from training. 核心發現： Bridge-WA 提升了任務成功率、進度與魯棒性，在面對訓練分布外的視覺場景時增益尤為顯著。
Neuro-Symbolic Safety Guidance for Vision-Language-Action Models via Constrained Flow Matching
Authors: William English, Hao Zheng, Rickard Ewetz | Submitted: 2026-07-01 | arXiv: 2607.01378
Categories: cs.RO, eess.SY
Research Background: Despite strong generalization abilities, VLA models lack adequate safety guarantees for real-world deployment; existing collision avoidance approaches only react to the immediate next action rather than anticipating future hazards along a trajectory. 研究背景： 儘管 VLA 模型具備優秀的泛化能力，其現實部署仍缺乏安全保障；現有碰撞避免方法只針對下一步動作作出反應，無法預測軌跡中後續潛在的危險。
Technical Approach: The proposed method frames safety enforcement as a minimum-norm constrained optimization problem applied during the iterative denoising process of flow matching. By examining noisy intermediate trajectory predictions at each denoising step, the system identifies and corrects safety violations before they become irreversible, enabling look-ahead collision avoidance. 技術方法： 該方法將安全約束表述為最小範數約束優化問題，並在流匹配的迭代去噪過程中施加。透過在每個去噪步驟中分析含噪的中間軌跡預測，系統能在碰撞無法挽回之前提前識別並修正安全違規。
Key Takeaway: On the SafeLIBERO benchmark, the method achieves 82.8% collision avoidance and 81.6% task success, outperforming single-step reactive safety methods by 6.3% and 19.8% respectively. 核心發現： 在 SafeLIBERO 基準上，該方法達到 82.8% 碰撞規避率與 81.6% 任務成功率，分別比單步反應式安全方法提升 6.3% 與 19.8%。
FurnitureVLA: Learning Long-Horizon Bimanual Furniture Assembly with Vision-Language-Action Model
Authors: Chenyang Ma, Yue Yang, Radu Corcodel et al. | Submitted: 2026-07-01 | arXiv: 2607.01212
Categories: cs.RO, cs.AI
Research Background: Robotic furniture assembly research has been confined largely to toy-scale objects or single-arm setups, leaving real-scale bimanual assembly — a task demanding long-horizon coordination — largely unexplored. 研究背景： 機器人家具組裝研究多侷限於玩具尺度物件或單臂設置，真實尺度的雙臂組裝——一項需要長程協調的任務——目前仍缺乏系統性研究。
Technical Approach: FurnitureVLA establishes a complete pipeline including a scalable simulation environment for expert data generation and a VR teleoperation system for bimanual data collection. To handle sequences spanning up to 7 subtasks and 1,550 control steps, the authors augment a VLA with a joint action-progress prediction head that emits a continuous progress signal, enabling automatic subtask transitions without explicit segmentation. 技術方法： FurnitureVLA 建立了完整的研究管線，涵蓋可擴展的仿真環境（用於專家資料生成）與 VR 遠端操作系統（用於雙臂資料採集）。為應對多達 7 個子任務、1,550 步控制的長程序列，研究者在 VLA 中加入聯合動作-進度預測頭，輸出連續進度信號以自動完成子任務切換。
Key Takeaway: FurnitureVLA raises average simulation success across three furniture types from 48% to 80%, with the approach validated on a real Kinova Gen3 bimanual platform. 核心發現： FurnitureVLA 將三種家具類型的平均仿真成功率從 48% 提升至 80%，並在真實 Kinova Gen3 雙臂平台上完成驗證。
ABot-M0.5: Unified Mobility-and-Manipulation World Action Model
Authors: Ronghan Chen, Yandan Yang, Zuojin Tang et al. | Submitted: 2026-07-01 | arXiv: 2607.00678
Categories: cs.CV, cs.RO
Research Background: Mobile manipulation is essential for general-purpose robotics, but current VLA policies lack world modeling, and existing World Action Models are misaligned with the demands of mobile manipulation in terms of temporal resolution, action representation, and training consistency. 研究背景： 移動操作是通用機器人的核心能力，然而現有 VLA 策略缺乏世界建模，而現有世界動作模型在時間解析度、動作表示與訓練一致性方面均與移動操作的需求不符。
Technical Approach: ABot-M0.5 addresses alignment at three levels: it models fine-grained intermediate latent actions to capture local visual state transitions, uses a dual-level Mixture-of-Transformers architecture that disentangles navigation from arm control, and applies a dream-forcing training strategy that runs inverse dynamics on model-predicted videos to match autoregressive inference conditions. 技術方法： ABot-M0.5 從三個層面解決對齊問題：建模細粒度的中間潛在動作以捕捉局部視覺狀態轉移；採用雙層 Mixture-of-Transformers 架構將導航與手臂控制解耦；並引入「夢境強制」訓練策略，在模型預測的影片上執行逆動力學，使訓練條件與自迴歸推理一致。
Key Takeaway: Explicitly aligning temporal granularity, action space, and train-test conditions within a single architecture meaningfully advances the state of unified mobile manipulation world models. 核心發現： 在單一架構中同時對齊時間粒度、動作空間與訓練測試條件，顯著推進了統一移動操作世界模型的發展水準。
Human-as-Humanoid: Enabling Zero-Shot Humanoid Learning from Ego-Exo Human Videos with Human-Aligned Embodiments
Authors: Xiaopeng Lin, Ruoqi Yang, Shijie Lian et al. | Submitted: 2026-06-30 | arXiv: 2606.32009
Categories: cs.RO
Research Background: Training deployable VLA policies for high-DoF humanoids demands large volumes of paired observation-action data, yet collecting such data through teleoperation is slow and expensive, creating a critical bottleneck for humanoid learning at scale. 研究背景： 為高自由度人形機器人訓練可部署的 VLA 策略需要大量觀測-動作配對資料，然而透過遠端操作收集這類資料既緩慢又昂貴，成為人形機器人大規模學習的關鍵瓶頸。
Technical Approach: Built on PrimeU, a human-aligned 60-DoF upper-body humanoid, the framework synchronizes ego-exo video capture to pair deployment-compatible egocentric observations with exocentric motion recovery. Recovered human motions are retargeted to 60-DoF action chunks via staged inverse kinematics, and the VLA is trained with forward-kinematics-aware supervision to preserve embodiment fidelity. 技術方法： 基於人體對齊的 60 自由度上半身人形機器人 PrimeU，該框架同步採集第一/第三人稱視角影片，將部署兼容的自我中心觀測與第三人稱動作恢復配對。恢復的人體動作透過分階段逆運動學重定向為 60 自由度動作塊，VLA 則以正向運動學感知監督進行訓練以保持具身忠實度。
Key Takeaway: Converting human video into humanoid training data yields a 4.8–7.2x throughput gain over teleoperation, and policies trained solely on converted human labels successfully transfer to real-robot deployment. 核心發現： 將人類影片轉換為人形機器人訓練資料，相較於遠端操作可獲得 4.8 至 7.2 倍的資料吞吐量提升，且僅用轉換後的人類標籤訓練的策略能成功遷移至真實機器人部署。
RoboTacDex: A Dexterous Visual-Tactile-Action Dataset for Humanoid Manipulation
Authors: Xinyi Wang, Donghan Li, Zi’Ang Chen et al. | Submitted: 2026-06-30 | arXiv: 2606.31836
Categories: cs.RO, cs.AI
Research Background: Dexterous humanoid manipulation requires integrating vision, tactile sensing, and precise action sequences, but high-quality multimodal datasets for this purpose are scarce, hindering progress on contact-rich tasks where visual information alone is insufficient. 研究背景： 人形機器人的靈巧操作需要視覺、觸覺與運動控制的緊密協調，然而同時提供這三種模態的多模態資料集極為稀缺，阻礙了僅靠視覺資訊不足以完成的接觸密集型任務之研究進展。
Technical Approach: RoboTacDex collects 6,000 trajectories across 19 tasks using the Unitree G1 humanoid, with synchronized multi-view RGB, depth, dexterous-hand tactile feedback, and semantic annotations. An improved multi-camera synchronization system achieves millisecond-level temporal alignment across all modalities. 技術方法： RoboTacDex 使用 Unitree G1 人形機器人收集 6000 條軌跡，涵蓋 19 項任務，記錄同步多視角 RGB 與深度影像、靈巧手觸覺反饋及語意標注，改進的多相機同步系統實現跨模態毫秒級時間對齊。
Key Takeaway: Evaluations of three imitation learning baselines on RoboTacDex reveal that task category significantly affects model strengths, establishing a useful benchmark for future dexterous manipulation research. 核心發現： 三個基準模型在 RoboTacDex 上的評估顯示任務類別顯著影響模型優劣，為未來靈巧操作研究提供了有用的基準。
3D HAMSTER: Bridging Planning and Control in Hierarchical Vision Language Robot Systems
Authors: Dongyoon Hwang, Byungkun Lee, Dongjin Kim et al. | Submitted: 2026-06-30 | arXiv: 2606.31329
Categories: cs.RO, cs.AI
Research Background: Long-horizon manipulation tasks expose a fundamental tension in robotic systems: semantic planners are flexible but imprecise, while low-level controllers are precise but rigid. Connecting high-level language understanding to accurate motor execution in cluttered environments remains an open challenge. 研究背景： 長時域操作任務揭示了機器人系統的根本矛盾：語意規劃器靈活但不精確，而底層控制器精確但缺乏彈性。在雜亂的真實環境中，將高階語言理解與精確運動執行相連接仍是一個開放性挑戰。
Technical Approach: 3D HAMSTER augments a VLM planner with a dedicated depth encoder and dense depth reconstruction objective, enabling it to predict metrically reliable 3D waypoint sequences. These 3D trajectories are integrated into a point-cloud-based low-level policy through a structured guidance interface that preserves metric geometry. 技術方法： 3D HAMSTER 在 VLM 規劃器中加入專用深度編碼器與密集深度重建目標，使其能直接預測度量可靠的 3D 路點序列。這些 3D 軌跡透過保留下游控制器所需度量幾何的結構化引導接口，整合至基於點雲的低層策略。
Key Takeaway: 3D trajectory guidance consistently outperforms proprietary VLMs and 2D-guided baselines, with the largest gains under appearance-altering distribution shifts and unseen language, spatial, and visual conditions. 核心發現： 3D 軌跡引導在外觀分佈偏移及未見語言、空間與視覺條件下，持續超越專有 VLM 與 2D 引導基線，提升幅度尤為顯著。
SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models
Authors: Tengyue Jiang, Chunpu Xu, Jiayue Kang, Yao Mu | Submitted: 2026-06-29 | arXiv: 2606.30113
Categories: cs.RO, cs.AI
Research Background: Discrete action tokenization allows VLA policies to use compact autoregressive generation, but existing tokenizers decode each code to a fixed continuous action prototype regardless of the robot’s current joint configuration or contact state, causing large control errors in manipulation. 研究背景： 離散動作 tokenization 使 VLA 可用自迴歸方式生成動作，但現有 tokenizer 將每個離散碼解碼為固定連續動作原型，忽略機器人當前關節構型與接觸狀態，在需要精細控制的操作任務中造成顯著誤差。
Technical Approach: SA-VLA injects robot proprioceptive state into the action decoding stage via cross-attention between state and action features, and a lightweight state adapter that predicts per-action modulation factors. Each discrete token effectively represents a family of state-conditioned continuous actions, while remaining compatible with both autoregressive and parallel decoding. 技術方法： SA-VLA 透過狀態與動作特徵間的交叉注意力，以及預測每步動作調製因子的輕量狀態適配器，將機器人本體感知狀態注入動作解碼。每個離散 token 能表示一族與狀態相關的連續動作，同時兼容自迴歸與並行解碼。
Key Takeaway: State-conditioned decoding nearly doubles average manipulation success rate (0.29 to 0.56) and more than doubles zero-shot sim-to-real transfer performance (0.15 to 0.33). 核心發現： 狀態條件解碼將平均操作成功率從 0.29 提升至 0.56，並將零樣本 sim-to-real 遷移成功率從 0.15 提升至 0.33。
VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulation
Authors: Shuai Tian, Yupeng Zheng, Yuhang Zheng et al. | Submitted: 2026-07-02 | arXiv: 2607.02503
Categories: cs.RO
Research Background: Contact-rich manipulation depends on subtle tactile cues — deformation, pressure, slip, and friction — that are temporally sparse and largely invisible to cameras. Prior visual-tactile policies treat tactile signals as passive observations rather than modeling how they evolve dynamically during contact. 研究背景： 接觸密集型操作依賴細微的觸覺線索——形變、壓力、滑動和摩擦——這些線索在時間上稀疏且大多無法從攝影機觀測到。先前的視覺-觸覺策略將觸覺信號視為被動觀測，而非對接觸過程中的動態演化進行建模。
Technical Approach: VT-WAM unifies future visual prediction, tactile deformation prediction, and action prediction within a single flow matching framework. It introduces Asymmetric Mixture-of-Transformers attention to bridge a static visual anchor frame with temporal tactile dynamics, and a contact-gated AVTAG attention mechanism that steers action queries toward tactile evidence specifically during contact phases. 技術方法： VT-WAM 在單一流匹配框架內統一了未來視覺預測、觸覺形變預測與動作預測。它引入了非對稱混合專家 Transformer 注意力機制，將靜態視覺錨點幀與時序觸覺動態相橋接，並採用接觸門控的 AVTAG 注意力引導機制，在接觸階段將動作查詢引導至觸覺證據。
Key Takeaway: Across six real-world contact-rich tasks, VT-WAM reaches 71.67% average success rate, surpassing Fast-WAM by 26.67% and OmniVTLA by 35.84%. 核心發現： 在六項真實世界的接觸密集型任務中，VT-WAM 達到 71.67% 的平均成功率，分別比 Fast-WAM 高出 26.67%，比 OmniVTLA 高出 35.84%。
The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Camera Control
Authors: Jincheng Tang, Yilong Zhu, Zhengyuan Xie et al. | Submitted: 2026-07-02 | arXiv: 2607.02322
Categories: cs.RO, cs.CV
Research Background: VLA models trained with static camera perspectives fail to generalize when cameras move or scenes involve dynamic viewpoints during deployment, severely limiting practical robustness of learned manipulation policies. 研究背景： 以靜態相機配置訓練的 VLA 模型，在部署時相機位置改變或場景涉及移動視角時無法泛化，嚴重限制了學習到的操作策略的實際魯棒性。
Technical Approach: Using a dual-arm setup where one arm manipulates and the other serves as a mobile camera, the authors evaluate three data distribution strategies: fixed, multi-fixed, and moving views. The key finding is that a hybrid strategy combining continuous camera motion with diverse static viewpoints breaks spurious correlations while maintaining training stability. 技術方法： 以雙臂設置（一臂操作，另一臂作為移動相機）系統評估三種資料策略：固定視角、多固定視角與移動視角。研究發現，結合連續相機運動與多樣靜態視角的混合策略，能打破虛假相關性同時維持訓練穩定性。
Key Takeaway: The hybrid dynamic data collection strategy benefits all evaluated architectures (ACT, Diffusion Policy, Pi0, and GR00T), demonstrating viewpoint shortcut learning is a universal weakness across diverse VLA designs. 核心發現： 混合動態資料採集策略對所有評估架構（ACT、擴散策略、Pi0 與 GR00T）均有益，表明易受視角捷徑學習影響是不同 VLA 設計的普遍弱點。
Guided Action Flow: Q-Guided Inference for Flow-Matching Vision-Language-Action Models
Authors: Liuhaichen Yang, Zhuang Jiang, Chenchao Sheng, Zezhi Tang | Submitted: 2026-07-02 | arXiv: 2607.02092
Categories: cs.RO, cs.AI
Research Background: Flow matching has emerged as a powerful generative framework for VLA action generation, but its inference process is shaped entirely by behavioral cloning objectives with no awareness of task reward signals — a gap that Q-value guidance could address without retraining. 研究背景： 流匹配已成為 VLA 動作預測中具競爭力的生成方法，但其推理過程完全由行為克隆塑造，對任務獎勵訊號毫無感知——Q 值引導可在不重新訓練的前提下填補此空缺。
Technical Approach: Guided Action Flow keeps a pretrained SmolVLA policy frozen and trains a learned action-chunk critic from real success and failure rollouts. The critic conditions on task-description features and guides sampling purely through action gradients during the reverse-time flow, requiring no modification to the base policy weights. 技術方法： Guided Action Flow 保持預訓練 SmolVLA 策略凍結，從真實成功與失敗 rollout 訓練學習動作塊評論者。評論者以凍結語言路徑的任務描述特徵為條件，在反向流過程中純粹透過動作梯度引導採樣，無需修改基礎策略權重。
Key Takeaway: A single-task critic improves success from 68% to 82% on LIBERO tasks, confirming that Q-guided inference is feasible for frozen flow-matching VLAs, though critic generalization across task families remains a key bottleneck. 核心發現： 單任務評論者在 LIBERO 任務上將成功率從 68% 提升至 82%，確認 Q 引導推理對凍結流匹配 VLA 的可行性，但評論者跨任務族群的泛化仍是核心瓶頸。
PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation
Authors: Peng Yun, Shouwang Huang, Hao Li et al. | Submitted: 2026-07-01 | arXiv: 2607.01938
Categories: cs.RO, cs.AI
Research Background: Manipulating dynamic, deformable, or articulated objects requires robots to reason about physical properties like mass, friction, and deformability. Purely data-driven world models capture statistical patterns but lack structured physical understanding, limiting generalization to novel objects and interactions. 研究背景： 操作動態、可形變或關節式物件需要機器人推理物理屬性——質量、摩擦力、可形變性。純資料驅動的世界模型捕捉統計規律，但缺乏結構化的物理理解，限制了對新物件和新交互的泛化能力。
Technical Approach: PhysMani couples a physics-principled 3D Gaussian world model with a future-aware action policy. The world model learns a divergence-free Gaussian velocity field via online optimization, enabling fast physically grounded future dynamics prediction. The policy integrates predicted 3D scene dynamics through a learnable token-based cross-attention module. 技術方法： PhysMani 將物理基礎 3D 高斯世界模型與未來感知動作策略耦合。世界模型透過在線優化學習無散度高斯速度場，實現快速且物理基礎的未來動力學預測。策略透過可學習 token 基交叉注意力模組整合預測的 3D 場景未來動力學。
Key Takeaway: PhysMani introduces a 16-task dynamic manipulation benchmark (PhysMani-Bench) and demonstrates superior success rates over strong baselines on dynamically moving targets in both simulation and real-robot experiments. 核心發現： PhysMani 引入包含 16 項任務的動態操作基準（PhysMani-Bench），在動態移動目標的模擬與真實機器人實驗中均展現出優於強力基線的成功率。
Z-1: Efficient Reinforcement Learning for Vision-Language-Action Models
Authors: Lang Cao, Renhong Chen, Luyi Li et al. | Submitted: 2026-06-30 | arXiv: 2606.31846
Categories: cs.RO, cs.AI
Research Background: Behavior cloning has well-known limitations for robot learning, and RL fine-tuning of VLA models offers a path beyond them — but the computational cost and sample inefficiency of RL at large model scales have made it impractical outside well-resourced labs. 研究背景： 行為複製在機器人學習上有已知的局限性，強化學習微調 VLA 模型提供了突破途徑，但大規模模型的 RL 計算成本與樣本效率問題，使其在一般規模實驗室中難以落地。
Technical Approach: Z-1 applies task-wise Group Relative Policy Optimization (GRPO) to π₀.₅ across 24 RoboCasa tasks. Key efficiency techniques include shared-prefix rollout construction, tree-structured trajectory branching for diverse sampling, completion-aware reward calibration, and selective joint training of the VLM and action expert components. 技術方法： Z-1 在 24 個 RoboCasa 任務上對 π₀.₅ 應用任務級群體相對策略優化（GRPO）。關鍵效率技術包括共享前綴 rollout 構建、用於多樣採樣的樹狀軌跡分支、完成感知獎勵校準，以及 VLM 與動作專家的選擇性聯合訓練。
Key Takeaway: Systematic GRPO post-training raises the average success rate from 67.4% (SFT baseline) to 80.6% across all 24 RoboCasa tasks without any additional private demonstrations. 核心發現： 系統化 GRPO 後訓練在 24 個 RoboCasa 任務上將平均成功率從 SFT 基線的 67.4% 提升至 80.6%，且無需任何額外私有示範。
Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation
Authors: Fengnian Zhang, Tao Huang, Siyu Xu et al. | Submitted: 2026-06-30 | arXiv: 2606.31382
Categories: cs.RO
Research Background: Large VLA models are computationally expensive to deploy, and while parameter redundancy is known to exist, no systematic study has mapped which components of VLA architectures can be safely compressed versus which are essential for robot action generation. 研究背景： 大型 VLA 模型部署成本高昂，儘管參數冗餘的存在已被認知，但目前尚無系統性研究釐清 VLA 架構中哪些元件可安全壓縮、哪些對機器人動作生成至關重要。
Technical Approach: The authors conduct layer-wise and module-wise importance analysis across state-of-the-art VLA architectures, using controlled pruning as a diagnostic probe. They find that action head and cross-attention layers carry disproportionate importance, while many vision encoder layers tolerate aggressive pruning, leading to compression strategies that cut model size by 40%. 技術方法： 作者對最先進 VLA 架構進行逐層與逐模組的重要性分析，以受控剪枝作為診斷探針。研究發現動作頭與交叉注意力層的重要性不成比例地高，而視覺編碼器的許多層可承受大幅剪枝，由此衍生出可將模型縮小 40% 的壓縮策略。
Key Takeaway: Targeted pruning guided by component-level importance analysis can reduce VLA model size by 40% with under 2% performance loss on standard benchmarks — whereas existing criteria cause total collapse under the same constraints. 核心發現： 以元件層級重要性分析為依據的針對性剪枝，可在標準基準上損失不到 2% 效能的前提下，將 VLA 模型體積縮減 40%，而現有準則在相同約束下導致性能完全崩潰。
Unleashing More Actions via Action Compositional Training for VLA Models
Authors: Kai Peng, Jie Lu, Xiaojiang Peng | Submitted: 2026-07-01 | arXiv: 2607.00351
Categories: cs.RO
Research Background: VLA models trained on fixed demonstration datasets are constrained to recombinations of action primitives seen at training time, which limits their ability to handle novel task compositions without collecting additional costly human demonstrations. 研究背景： 在固定示範資料集上訓練的 VLA 模型，受限於訓練時所見的動作基元組合，無法在不蒐集額外昂貴人工示範的情況下處理新穎的任務組合。
Technical Approach: ACT-VLA exploits the model’s latent task representations to synthesize novel demonstrations by composing sub-skills from existing tasks without additional human teleoperation. The synthetic demonstrations are physically valid and expand the training distribution to cover out-of-distribution action combinations. 技術方法： ACT-VLA 利用模型的潛在任務表示，通過組合現有任務的子技能合成新演示，無需額外的人工遙控操作。合成演示在物理上有效，並擴展訓練分佈以覆蓋分佈外的動作組合。
Key Takeaway: Without any additional human demonstrations, Action Compositional Training substantially broadens a VLA model’s action repertoire and enables zero-shot execution of novel task compositions. 核心發現： 無需任何額外人工示範，動作組合訓練大幅擴展 VLA 模型的動作庫，並賦予其對新穎任務組合進行零樣本執行的能力。
Vision-Language-Action Models: Experimental Insights from a Real-World Evaluation
Authors: Mathilde Hochedel, Marc Lalonde | Submitted: 2026-06-29 | arXiv: 2606.30456
Categories: cs.RO, cs.CV
Research Background: VLA model development has accelerated rapidly, yet direct comparisons on standardized real-world tasks are rare, leaving practitioners without reliable guidance on which models perform best under authentic deployment conditions beyond simulation benchmarks. 研究背景： VLA 模型的發展快速，但在標準化真實世界任務上的直接比較卻十分罕見，使從業者缺乏在模擬基準以外、真實部署條件下可靠的模型選擇依據。
Technical Approach: Five state-of-the-art VLA models are evaluated side-by-side across twelve manipulation tasks that vary along axes of spatial precision, object diversity, and instruction complexity. The study uses consistent physical setups to isolate model-level differences and systematically catalogues recurring failure modes across models. 技術方法： 針對五個最先進 VLA 模型，在空間精度、物件多樣性與指令複雜度各異的十二項操作任務上進行並排評估，以一致的物理配置隔離模型層級差異，並系統性地整理跨模型反覆出現的失敗模式。
Key Takeaway: Real-world evaluation reveals consistent failure modes around spatial precision, appearance sensitivity, and long-horizon instruction following, and highlights that simulation-based rankings do not reliably predict real-world performance. 核心發現： 真實世界評估揭示了空間精度不足、外觀敏感性高，以及長時序指令跟隨困難等共同失敗模式，並指出基於模擬的排名無法可靠預測真實世界表現。
X-Morph: Human Motion Priors for Scalable Robot Learning Across Morphologies
Authors: Ritwik Sharma, Shivam Sood, Arhaan Jain et al. | Submitted: 2026-06-29 | arXiv: 2606.30290
Categories: cs.RO
Research Background: Deploying robot learning across platforms with different body configurations is hindered by the fact that action spaces, kinematics, and dynamics vary fundamentally between morphologies, preventing direct knowledge transfer and requiring expensive per-platform retraining. 研究背景： 跨具有不同肢體構型的平台部署機器人學習面臨挑戰，因為不同形態之間的動作空間、運動學與動力學存在根本差異，阻礙了直接的知識遷移，並需要昂貴的各別平台重新訓練。
Technical Approach: X-Morph uses human motion capture data as a morphology-agnostic prior, applying morphology-conditioned retargeting to map human movements onto different robot body configurations. A shared policy backbone then learns to translate retargeted human motion patterns into morphology-specific robot actions, evaluated on quadruped, hexapod, and quadruped-with-manipulator platforms. 技術方法： X-Morph 以人體動作捕捉資料作為形態無關的先驗，透過形態條件化的動作重定向，將人體動作映射至不同機器人肢體構型。共享策略主幹隨後學習將這些重定向的人體動作模式轉換為形態特定的機器人動作，並在四足、六足及配備機械臂的四足平台上評估。
Key Takeaway: Human motion priors enable faster adaptation to new robot morphologies and improve generalization to out-of-distribution body configurations, reducing the per-platform data burden. 核心發現： 人體動作先驗能加速對新機器人形態的適應，並改善對分佈外肢體構型的泛化能力，從而降低各平台的資料需求。
Learning to Move Before Learning to Do: Task-Agnostic Pretraining for VLAs
Authors: Junhao Shi, Siyin Wang, Xiaopeng Yu et al. | Submitted: 2026-07-02 | arXiv: 2607.02466
Categories: cs.RO, cs.AI
Research Background: VLA models are fundamentally bottlenecked by the scarcity of labeled expert demonstrations. The core insight is that standard training conflates two objectives — acquiring physical motor competence (how to move) and acquiring semantic alignment (what to do) — and only the latter requires language-annotated expert data. 研究背景： VLA 模型的根本瓶頸在於帶標注的專家示範稀缺且昂貴。核心洞見是：標準訓練混淆了兩個不同目標——習得物理動作能力（如何移動）與習得語意對齊（做什麼），而只有後者需要語言標注的專家資料。
Technical Approach: Task-Agnostic Pretraining (TAP) is a two-stage framework: Stage 1 learns transferable motor priors from cheap unlabeled interaction data — including discarded off-task trajectories and autonomous robot play — using a self-supervised Inverse Dynamics objective. Stage 2 then grounds these motor priors in language using minimal labeled expert data. 技術方法： 任務無關預訓練（TAP）是兩階段框架：第一階段使用自監督逆動力學目標，從廉價無標注交互資料（包括棄置的脫任務軌跡與機器人自主探索）學習可遷移動作先驗；第二階段利用少量帶標注專家資料將這些動作先驗與語言對齊。
Key Takeaway: TAP matches models trained on over 1M expert trajectories while using orders of magnitude less labeled data, and retains 25% success under camera perturbations where internet-scale baselines collapse to 0%. 核心發現： TAP 以少幾個數量級的標注資料媲美在百萬專家軌跡上訓練的模型，並在相機擾動下保持 25% 成功率，而互聯網規模基線則崩潰至 0%。
VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment
Authors: Guoyang Xia, Fengfa Li, Hongjin Ji et al. | Submitted: 2026-07-02 | arXiv: 2607.01586
Categories: cs.CV, cs.AI, cs.RO
Research Background: Training VLA models on heterogeneous robot data is difficult because existing systems conflate architectural choices, data sources, and training objectives, making it impossible to isolate which component drives performance across diverse robot corpora. 研究背景： 在異質機器人資料上訓練 VLA 模型極具挑戰性，因現有系統同時混用不同架構、資料來源與訓練目標，難以獨立評估各要素的影響。
Technical Approach: VLAFlow adopts a flow-matching architecture and tests four training paradigms — action-only, language co-training, future latent alignment, and their combination — under identical conditions on the OXEMix corpus (~5,000 hours). Language supervision and future latent representations act as complementary intermediate constraints that smooth heterogeneous action supervision. 技術方法： VLAFlow 採用 flow-matching 架構，在 OXEMix 語料庫（約 5,000 小時）的統一條件下測試四種訓練範式：純動作建模、語言協同訓練、未來潛在對齊及三者組合。語言監督與未來潛在表示視為互補的中間約束，平滑異質動作監督。
Key Takeaway: Combining language supervision with future latent alignment yields the most stable transfer across benchmarks, suggesting heterogeneous robot data is best handled through a meta-action space view rather than action prediction alone. 核心發現： 語言監督與未來潛在對齊的組合在各基準測試中遷移最為穩定，表明異質機器人資料最適合以元動作空間視角處理，而非單純動作預測。