arXiv Weekly Digest — Week 22, 2026
Fetched: 2026-06-02 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 88
From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model
Authors: Bing Hu, Zaijing Li, Rui Shao, et al. | Submitted: 2026-05-21 | arXiv: 2605.22671
Categories: cs.CV
Research Background: VLA models degrade under distribution shift because action-centric latents fragment over short horizons and align only statically.
研究背景: VLA 模型在分布偏移下退化,因為以動作為中心的潛在變數在短時域內碎裂且僅靜態對齊。
Technical Approach: BehaviorVLA learns a temporally extended behavioral representation that abstracts then instantiates behaviors, yielding consistent manipulation across varying environments.
技術方法: BehaviorVLA 學習時域延展的行為表徵,先抽象再實例化行為,在多變環境中維持一致操作。
Key Takeaway: Learning abstract-then-instantiated behavior representations improves VLA robustness under distribution shift.
核心發現: 學習先抽象後實例化的行為表徵能提升 VLA 在分布偏移下的穩健性。
GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation
Authors: Kaichen Zhou, Yuzhen Chen, Fangneng Zhan, et al. | Submitted: 2026-05-20 | arXiv: 2605.22882
Categories: cs.CV, cs.RO
Research Background: Video world models generate plausible futures but fail to keep physical points consistent over time, undermining reliable robot action execution.
研究背景: 影片世界模型能生成看似合理的未來,但無法在時間上維持物理點一致,難以支撐可靠的機器人動作。
Technical Approach: GEM-4D injects dense 4D correspondence supervision distilled from a pretrained geometry foundation model into the video generative backbone during training, grounding the predictions geometrically.
技術方法: GEM-4D 在訓練時將由幾何基礎模型蒸餾出的密集 4D 對應監督注入影片生成骨幹,使預測具備幾何基礎。
Key Takeaway: Geometry-grounded video world models produce physically consistent futures suitable for manipulation planning.
核心發現: 幾何基礎的影片世界模型能產生適合操作規劃的物理一致未來。
Agentic-VLA: Efficient Online Adaptation for Vision-Language-Action Models
Authors: Ruofan Jin, Zaixi Zhang | Submitted: 2026-05-21 | arXiv: 2605.22896
Categories: cs.RO, cs.AI, cs.LG
Research Background: VLA models generalize poorly to novel environments and need extensive demonstrations to train efficiently.
研究背景: VLA 模型對新環境泛化不佳,且需大量示範才能有效訓練。
Technical Approach: Agentic-VLA is an online adaptation framework with adaptive reward synthesis that dynamically generates and adjusts reward functions based on the VLA’s current capabilities, enabling efficient self-improvement.
技術方法: Agentic-VLA 是一個線上適應框架,透過自適應獎勵合成,依 VLA 當前能力動態生成並調整獎勵函數,達成高效自我提升。
Key Takeaway: Agentic online adaptation lets VLAs improve in new environments with far fewer demonstrations.
核心發現: 代理式線上適應讓 VLA 用更少示範就能在新環境中提升表現。
-EqM: Equilibrium Matching for Closed-Loop Vision-Language-Action Control
Authors: Huanming Liu, Congsheng Xu, Jianmin Ji, et al. | Submitted: 2026-05-22 | arXiv: 2605.23128
Categories: cs.RO
Research Background: VLA flow-matching action decoders use fixed sampling horizons, wasting state-dependent compute and ignoring temporal reuse.
研究背景: VLA 的流匹配動作解碼器使用固定取樣步數,浪費依狀態而異的計算並忽略時間重用。
Technical Approach: pi0-EqM replaces pi-0’s flow-matching expert with an Equilibrium Matching decoder while leaving the upstream stack unchanged, enabling adaptive closed-loop control.
技術方法: pi0-EqM 將 pi-0 的流匹配專家換成平衡匹配解碼器,上游堆疊保持不變,實現自適應閉環控制。
Key Takeaway: Equilibrium matching raises RoboTwin success markedly over flow matching at matched compute budgets.
核心發現: 在相同計算預算下,平衡匹配相比流匹配大幅提升 RoboTwin 成功率。
Semantically Structured Mixture-of-Experts for Compositional Robotic Manipulation
Authors: Chengyu Deng, Guanqi Chen, Yizhou Chen, et al. | Submitted: 2026-05-22 | arXiv: 2605.23477
Categories: cs.RO
Research Background: Diffusion manipulation policies are accurate but expensive, while lightweight MoE variants route on low-level statistics that fragment reusable behaviors.
研究背景: 擴散操作策略精準但昂貴,輕量化 MoE 變體依低階統計路由,導致可重用行為碎裂。
Technical Approach: This work proposes a semantically structured MoE whose routing respects the compositional structure of manipulation tasks, preserving reusable behavior modules.
技術方法: 本研究提出語意結構化的 MoE,其路由尊重操作任務的組合結構,保留可重用行為模組。
Key Takeaway: Semantic routing makes MoE diffusion policies both efficient and generalizable across multi-task manipulation.
核心發現: 語意路由讓 MoE 擴散策略在多任務操作中兼具效率與泛化。
TactileReflex: Noise-Statistics-Driven Vision-Tactile Reflex Control for Force-Sensitive Manipulation
Authors: Ziyan Feng, Yulong Fu, Zheng Li, et al. | Submitted: 2026-05-22 | arXiv: 2605.23568
Categories: cs.RO, eess.SY
Research Background: Manipulating fragile liquid-filled containers requires force adaptation within an extremely narrow margin.
研究背景: 操作裝有液體的易碎容器需在極窄的力裕度內調整握力。
Technical Approach: TactileReflex derives reflex controller parameters directly from a vision-tactile sensor’s intrinsic noise statistics via a brief static-hold-and-unload calibration.
技術方法: TactileReflex 透過短暫的靜握與卸載校準,直接由視覺觸覺感測器的內在雜訊統計推導反射控制器參數。
Key Takeaway: Noise-statistics-driven calibration enables force-sensitive manipulation without learned policies.
核心發現: 以雜訊統計驅動的校準可在不需學習策略下達成力敏感操作。
Direct Dynamic Retargeting for Humanoid Imitation Learning from Videos
Authors: Constant Roux, Ludovic De Matteïs, Armand Jordana, et al. | Submitted: 2026-05-22 | arXiv: 2605.23762
Categories: cs.RO
Research Background: Imitating human video on humanoids is hampered by morphological mismatch, and standard retargeting pipelines introduce geometric bias.
研究背景: 在人形機器人上模仿人類影片受形態差異所限,標準重定向流程引入幾何偏差。
Technical Approach: Direct Dynamic Retargeting (DDR) is a single-stage framework that skips intermediate kinematic projection, generating high-fidelity dynamic behaviors directly.
技術方法: DDR 是單階段框架,跳過中間運動學投影,直接生成高保真的動態行為。
Key Takeaway: Removing intermediate kinematic projection unlocks better dynamic humanoid imitation from monocular video.
核心發現: 移除中間運動學投影可從單目影片解鎖更佳的人形動態模仿。
Afford-VLA: Action-Aligned Visual Planning via Internalized Affordance
Authors: Runze Wang, Yuqian Fu, Yu Li, et al. | Submitted: 2026-05-22 | arXiv: 2605.24203
Categories: cs.RO
Research Background: VLA models lack spatial reasoning about where to interact in cluttered scenes.
研究背景: VLA 模型缺乏在雜亂場景中判斷何處互動的空間推理能力。
Technical Approach: Afford-VLA internalizes affordance into action-aligned visual planning, tightly coupling where-to-act predictions with downstream action generation rather than relying on external visual signals.
技術方法: Afford-VLA 將可操作性內化進與動作對齊的視覺規劃,緊密耦合「何處操作」預測與下游動作生成,而非依賴外部視覺訊號。
Key Takeaway: Internalized affordance-based visual planning improves VLA manipulation in complex scenes.
核心發現: 內化的可操作性視覺規劃提升 VLA 在複雜場景的操作表現。
PACT: Proactive Asking for Continual Task Assistance in Human-Robot Collaboration
Authors: Chengbo He, Sheng Li, Chenyang Ma, et al. | Submitted: 2026-05-23 | arXiv: 2605.24350
Categories: cs.RO, cs.HC
Research Background: Long-term robot assistants must act under partial observation while unknown human routines make passive infer-then-act assistance inefficient.
研究背景: 長期機器人助理須在部分可觀測下行動,而未知的人類習慣使被動的「先推論後行動」協助低效。
Technical Approach: PACT is an ask-or-act framework that decides whether to seek clarification before acting, leveraging cross-day interaction history for continual task assistance.
技術方法: PACT 是「詢問或行動」框架,行動前判斷是否需澄清,並利用跨日互動歷史進行持續任務協助。
Key Takeaway: Proactive asking outperforms passive inference for continual human-robot collaboration.
核心發現: 在持續人機協作中,主動詢問優於被動推論。
Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Models
Authors: Yurou Yang, Muyuan Lin, Roberto Martin-Martin, et al. | Submitted: 2026-05-23 | arXiv: 2605.24642
Categories: cs.CV, cs.RO
Research Background: It is unclear whether modern VLAs already possess enough geometric understanding, or how best to inject it from geometric foundation models.
研究背景: 目前不清楚現代 VLA 是否已具足夠幾何理解,或如何最佳地從幾何基礎模型注入幾何資訊。
Technical Approach: The paper provides a rigorous experimental analysis of geometric VLAs, examining VLM geometric sufficiency, injection architectures, and other design choices.
技術方法: 本文對幾何 VLA 進行嚴謹的實驗分析,檢視 VLM 的幾何充分性、注入架構與其他設計選擇。
Key Takeaway: Careful architectural choices, not raw geometry injection, determine when geometric foundation models help VLAs.
核心發現: 決定幾何基礎模型何時對 VLA 有益的是審慎的架構選擇,而非單純注入幾何。
QuoVLA: Quotient Space for Vision-Language-Action Models
Authors: Xuan Wang, Yinan Wu, Haoran Duan, et al. | Submitted: 2026-05-24 | arXiv: 2605.24890
Categories: cs.CV
Research Background: Existing VLAs assume pretrained VLM latents lack usable action information or should be shielded from action signals.
研究背景: 既有 VLA 假設預訓練 VLM 潛在表徵缺乏可用動作資訊,或應與動作訊號隔離。
Technical Approach: QuoVLA’s Quotient Theory shows VLM latents are action-sufficient, and uses a quotient-space formulation to surface the control information they already contain.
技術方法: QuoVLA 的商空間理論證明 VLM 潛在表徵已具動作充分性,並以商空間構造揭露其中既有的控制資訊。
Key Takeaway: Pretrained VLM latents already encode the information needed for control; the challenge is extracting it.
核心發現: 預訓練 VLM 潛在表徵已編碼控制所需資訊,挑戰在於如何萃取。
HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos
Authors: Zhi Wang, Botao He, Kelin Yu, et al. | Submitted: 2026-05-24 | arXiv: 2605.24934
Categories: cs.RO, cs.AI, cs.CV, cs.LG
Research Background: Human egocentric video offers abundant manipulation demonstrations without robot hardware, but the embodiment gap blocks direct transfer.
研究背景: 人類第一人稱影片提供大量無需機器人硬體的操作示範,但形體差距阻礙直接遷移。
Technical Approach: HumanEgo lifts each demonstration to an entity-level hand-object interaction representation and trains a flow-matching policy with dense auxiliary objectives, robot-data-free and zero-shot.
技術方法: HumanEgo 將每段示範提升為實體級的手-物互動表徵,並以密集輔助目標訓練流匹配策略,無需機器人資料且零樣本。
Key Takeaway: Minutes of human egocentric video can yield zero-shot, hardware-agnostic robot manipulation policies.
核心發現: 數分鐘的人類第一人稱影片即可產生零樣本、硬體無關的機器人操作策略。
X-DiffVLA: X-Embodied Diffusion Action Heads for Vision-Language-Action Models
Authors: Boyu Li, Chaoyi Xu, Haoqi Yuan, et al. | Submitted: 2026-05-24 | arXiv: 2605.25044
Categories: cs.RO
Research Background: VLA models pretrained on diverse data still need embodiment-specific fine-tuning, blocking cross-embodiment knowledge transfer.
研究背景: 在多樣資料上預訓練的 VLA 仍需針對特定形體微調,阻礙跨形體知識遷移。
Technical Approach: X-DiffVLA introduces X-embodied diffusion action heads for robots sharing a base but with heterogeneous end-effectors, enabling transfer across similar tasks.
技術方法: X-DiffVLA 為共享基座但末端執行器異質的機器人引入跨形體擴散動作頭,實現相似任務間的遷移。
Key Takeaway: Embodiment-aware diffusion heads enable VLA transfer across robots with different end-effectors.
核心發現: 形體感知的擴散頭讓 VLA 能在末端執行器不同的機器人間遷移。
From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
Authors: Zhiyuan Feng, Qixiu Li, Huizhi Liang, et al. | Submitted: 2026-05-18 | arXiv: 2606.00054
Categories: cs.RO, cs.AI, cs.CV
Research Background: VLA models are usually trained on costly, embodiment-specific robot demonstrations, limiting their scalability.
研究背景: VLA 模型通常依賴昂貴且綁定特定形體的機器人示範資料,限制了可擴展性。
Technical Approach: This survey unifies the rapidly growing body of work on learning manipulation from abundant human videos, organizing methods by how they extract semantic and physical cues and bridge the human-robot embodiment gap.
技術方法: 本綜述統整了從大量人類影片學習操作的研究,依其如何萃取語意與物理線索、以及如何跨越人機形體差距來分類方法。
Key Takeaway: Human-centric data offers a scalable path to generalist VLA manipulation if the embodiment gap can be systematically addressed.
核心發現: 若能系統性解決形體差距,人類中心資料可成為通用 VLA 操作的可擴展途徑。
CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models
Authors: Zhi Liu | Submitted: 2026-05-21 | arXiv: 2605.21854
Categories: cs.CV, cs.AI
Research Background: DPO-style preference alignment has been studied almost only on autoregressive VLAs, not on flow-matching backbones.
研究背景: DPO 式偏好對齊幾乎只在自迴歸 VLA 上研究,未涵蓋流匹配骨幹。
Technical Approach: CrossVLA introduces a surrogate flow-matching log-probability estimator that lets DPO operate on continuous-action VLAs, with cross-paradigm post-training and inference optimization.
技術方法: CrossVLA 引入替代的流匹配對數機率估計器,使 DPO 能用於連續動作 VLA,並提供跨範式的後訓練與推論最佳化。
Key Takeaway: Preference optimization can be extended to flow-matching VLAs via a surrogate log-probability estimator.
核心發現: 透過替代對數機率估計器,偏好最佳化可延伸至流匹配 VLA。
SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-based Humanoid Control
Authors: Jingyan Zhang, Han Liang, Ruichi Zhang, et al. | Submitted: 2026-05-21 | arXiv: 2605.22894
Categories: cs.GR, cs.LG, cs.RO
Research Background: Language-controlled physics-based humanoids struggle to balance semantic expressiveness with physical feasibility over long horizons.
研究背景: 以語言控制的物理人形機器人難以在長時域中平衡語意表達力與物理可行性。
Technical Approach: SCRIPT uses a Joint Action-State-Text Diffusion Transformer with multi-stage training to scale language-driven humanoid control.
技術方法: SCRIPT 採用聯合動作-狀態-文字擴散 Transformer 與多階段訓練,擴展語言驅動的人形控制。
Key Takeaway: Joint action-state-text diffusion enables faithful, physically stable language-driven humanoid control.
核心發現: 聯合動作-狀態-文字擴散實現忠實且物理穩定的語言驅動人形控制。
Robots That Know What to Ask: Recovering Misaligned Rewards through Targeted Explanations
Authors: Helena Merker, Nick Walker, Andreea Bobu | Submitted: 2026-05-21 | arXiv: 2605.22986
Categories: cs.RO, cs.AI, cs.HC, cs.LG
Research Background: Reward learning from demonstrations assumes all features are well supervised, but imperfect demos underspecify some features, causing reward misalignment.
研究背景: 從示範學習獎勵假設所有特徵皆受充分監督,但不完美示範會使部分特徵欠定,導致獎勵失準。
Technical Approach: The framework detects underspecified reward features and actively asks targeted explanatory questions to recover the true reward.
技術方法: 此框架偵測欠定的獎勵特徵,並主動提出針對性的解釋問題以還原真實獎勵。
Key Takeaway: Targeted clarification questions recover misaligned rewards left ambiguous by imperfect demonstrations.
核心發現: 針對性的澄清問題能還原因不完美示範而模糊失準的獎勵。
IntentionNav: A Benchmark for Intent-Driven Object Navigation from Implicit Human Instruction
Authors: Lin Qian, Shijie Li, Sihao Lin, et al. | Submitted: 2026-05-22 | arXiv: 2605.23187
Categories: cs.CV, cs.RO
Research Background: Object navigation benchmarks specify explicit categories, but humans give indirect intents like ‘something to warm food.‘
研究背景: 物件導航基準直接指定類別,但人類常給間接意圖,如「能加熱食物的東西」。
Technical Approach: IntentionNav is a diagnostic benchmark for intent-driven object navigation where the agent must infer the satisfying object, find a grounded instance, and judge goal completion.
技術方法: IntentionNav 是意圖驅動物件導航的診斷基準,代理須推論能滿足需求的物件、找到場景中的實例並判斷是否達成目標。
Key Takeaway: Intent-driven navigation from implicit human instructions is a distinct, harder challenge than category-based search.
核心發現: 從隱含人類指令的意圖驅動導航是比類別搜尋更難的獨立挑戰。
ChainFlow-VLA: Causal Flow Planning with Vision-Language Models
Authors: Xiyang Wang, Xinlin Wang, Tingguang Zhou, et al. | Submitted: 2026-05-22 | arXiv: 2605.23270
Categories: cs.CV, cs.AI, cs.RO
Research Background: End-to-end driving faces a mismatch between causal temporal reasoning (AR models) and global trajectory consistency (diffusion models).
研究背景: 端到端駕駛面臨因果時序推理(自迴歸)與全域軌跡一致性(擴散)之間的矛盾。
Technical Approach: ChainFlow-VLA unifies causal factorization with global flow planning, using vision-language models to combine interaction-aware temporal reasoning with consistent trajectories.
技術方法: ChainFlow-VLA 將因果分解與全域流規劃統一,藉視覺語言模型結合互動感知的時序推理與一致軌跡。
Key Takeaway: Combining causal reasoning with global flow planning yields safer, more consistent driving trajectories.
核心發現: 結合因果推理與全域流規劃可產生更安全、更一致的駕駛軌跡。
Any2Any: Efficient Cross-Embodiment Transfer for Humanoid Whole-Body Tracking
Authors: Ming Yang, Tao Yu, Feng Li, et al. | Submitted: 2026-05-22 | arXiv: 2605.23733
Categories: cs.RO, cs.AI
Research Background: Whole-body tracking models for humanoids are costly to train from scratch on each new platform.
研究背景: 人形機器人的全身追蹤模型在每個新平台從零訓練成本高昂。
Technical Approach: Any2Any transfers a pretrained whole-body tracking specialist to a new humanoid embodiment with minimal data and compute via kinematic adaptation.
技術方法: Any2Any 透過運動學適應,以極少資料與計算將預訓練的全身追蹤專家遷移到新人形形體。
Key Takeaway: Pretrained whole-body tracking models can transfer across humanoid embodiments with minimal adaptation.
核心發現: 預訓練的全身追蹤模型能以極少適應跨人形形體遷移。
Instrumentation for Imitation Learning: Enhancing Training Datasets for Clothes Hanger Insertion
Authors: Remko Proesmans, Thomas Lips, Francis wyffels | Submitted: 2026-05-22 | arXiv: 2605.23847
Categories: cs.RO
Research Background: Robotic manipulation lacks the data-driven revolution of VLMs due to prohibitive demonstration requirements.
研究背景: 機器人操作因示範資料需求過高,尚未出現如 VLM 般的資料驅動革命。
Technical Approach: The paper instruments target objects with embedded sensors, showing that 180 teleoperated demos with instrumentation train better diffusion policies for clothes-hanger insertion.
技術方法: 本文在目標物件嵌入感測器,顯示 180 段含儀器化資料的遙操作示範能訓練出更佳的衣架插入擴散策略。
Key Takeaway: Embedding sensors in manipulated objects enables more data-efficient imitation learning.
核心發現: 在被操作物件中嵌入感測器可實現更省資料的模仿學習。
ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models
Authors: Arash Akbari, Arman Akbari, Masih Eskandar, et al. | Submitted: 2026-05-19 | arXiv: 2605.24011
Categories: cs.CV, cs.AI
Research Background: VLA models are too compute-heavy for edge deployment, and aggressive sub-4-bit quantization severely degrades them.
研究背景: VLA 模型計算過重難以邊緣部署,而激進的 sub-4-bit 量化會嚴重損害效能。
Technical Approach: ActQuant is an action-guided mixed-precision PTQ framework that allocates bit-widths per weight matrix according to its contribution to action prediction.
技術方法: ActQuant 是動作引導的混合精度 PTQ 框架,依各權重矩陣對動作預測的貢獻分配位元寬。
Key Takeaway: Action-aware bit allocation makes sub-4-bit VLA quantization practical for edge deployment.
核心發現: 動作感知的位元分配使 sub-4-bit VLA 量化在邊緣部署上可行。
RoboHitch: Learning Visual Affordance from Disordered Keypoints for Hitch Knots Tying
Authors: Jiahui Zuo, Boyang Zhang, Fumin Zhang | Submitted: 2026-05-23 | arXiv: 2605.24394
Categories: cs.RO
Research Background: Robotic knot tying with deformable linear objects fails when topological tracking drifts under repeated bending and occlusion.
研究背景: 以可變形線狀物綁結時,反覆彎折與遮擋使拓樸追蹤漂移而失敗。
Technical Approach: RoboHitch learns visual affordance from disordered 3D keypoints from human demonstrations, avoiding reliance on ordered keypoints and explicit edge connectivity.
技術方法: RoboHitch 從人類示範的無序 3D 關鍵點學習視覺可操作性,避免依賴有序關鍵點與顯式邊連接。
Key Takeaway: Learning from disordered keypoints makes knot tying robust to tracking drift and topology mismatch.
核心發現: 從無序關鍵點學習使綁結對追蹤漂移與拓樸不符具穩健性。
MuGen: Multi-Skill Generative Locomotion Controller for Humanoid Robots
Authors: Yusen Feng, Xiang Wang, Heyuan Yao, et al. | Submitted: 2026-05-23 | arXiv: 2605.24592
Categories: cs.RO
Research Background: Humanoids need expressive, human-like multi-skill locomotion learned from heterogeneous human motion data.
研究背景: 人形機器人需從異質人類動作資料學習富表現力、類人的多技能運動。
Technical Approach: MuGen trains VQ-VAEs with model-based RL to build a generative locomotion representation, then distills it via teacher-student learning for deployment.
技術方法: MuGen 以基於模型的 RL 訓練 VQ-VAE 建立生成式運動表徵,再透過師生學習蒸餾以部署。
Key Takeaway: Generative VQ-VAE representations enable expressive multi-skill humanoid locomotion from human motion data.
核心發現: 生成式 VQ-VAE 表徵能從人類動作資料實現富表現力的多技能人形運動。
DexSIM: Real-time Dexterous Simulation with Unified Causal Video Diffusion
Authors: Adam Lee | Submitted: 2026-05-23 | arXiv: 2605.24630
Categories: cs.CV
Research Background: Video-diffusion world simulation has largely ignored real-time dexterous hand-object interaction.
研究背景: 影片擴散世界模擬大多忽略即時的靈巧手-物互動。
Technical Approach: DexSIM is a unified causal video diffusion framework for real-time dexterous manipulation simulation, supporting interactive experiences and synthetic data generation.
技術方法: DexSIM 是統一的因果影片擴散框架,用於即時靈巧操作模擬,支援互動體驗與合成資料生成。
Key Takeaway: Causal video diffusion enables real-time, interactive dexterous manipulation simulation for synthetic data.
核心發現: 因果影片擴散實現即時、互動的靈巧操作模擬以產生合成資料。
AtlasVA: Self-Evolving Visual Skill Memory for Teacher-Free VLM Agents
Authors: Pan Wang, Yihao Hu, Xiujin Liu, et al. | Submitted: 2026-05-18 | arXiv: 2605.17933
Categories: cs.CV
Research Background: VLM agents store memory as lossy text and depend on proprietary teacher models, poorly matching spatial decision making.
研究背景: VLM 代理以失真的文字儲存記憶並依賴專有教師模型,與空間決策不相符。
Technical Approach: AtlasVA keeps reusable experience visually grounded as a self-evolving visual skill memory, removing the need for teacher models.
技術方法: AtlasVA 將可重用經驗以視覺基礎形式保存為自我演進的視覺技能記憶,免除對教師模型的依賴。
Key Takeaway: Visually grounded skill memory enables teacher-free, self-improving VLM agents for spatial tasks.
核心發現: 視覺基礎的技能記憶實現無需教師、可自我提升的空間任務 VLM 代理。
Seeing Together: Multi-Robot Cooperative Egocentric Spatial Reasoning with Multimodal Large Language Models
Authors: Kunyu Peng, Zhikun Zhou, Kailun Yang, et al. | Submitted: 2026-05-18 | arXiv: 2605.18431
Categories: cs.CV
Research Background: MLLMs handle single-view egocentric video well but cannot reason cooperatively across multiple embodied viewpoints.
研究背景: MLLM 擅長單視角第一人稱影片,卻無法跨多個具身視角協同推理。
Technical Approach: The paper introduces CoopSR benchmark and EgoTeam dataset for multi-robot cooperative spatial reasoning from synchronized egocentric videos.
技術方法: 本文提出 CoopSR 基準與 EgoTeam 資料集,用於從同步第一人稱影片進行多機器人協同空間推理。
Key Takeaway: Cooperative multi-viewpoint spatial reasoning is a largely unsolved capability for MLLMs.
核心發現: 協同多視角空間推理是 MLLM 大致尚未解決的能力。
SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution
Authors: Yiren Song, Yihan Wang, Xiyao Deng, et al. | Submitted: 2026-05-19 | arXiv: 2605.19319
Categories: cs.CV
Research Background: Dense video generation for embodied control is expensive and often unnecessary for tasks summarizable by a few states.
研究背景: 用於具身控制的密集影片生成成本高,對能以少數狀態概括的任務通常並非必要。
Technical Approach: SWEET uses image editing models as sparse visual world models, predicting task-relevant future states without dense video rollout.
技術方法: SWEET 將影像編輯模型用作稀疏視覺世界模型,預測任務相關的未來狀態而不需密集影片展開。
Key Takeaway: Image-editing models can serve as efficient sparse world models for manipulation.
核心發現: 影像編輯模型可作為操作任務的高效稀疏世界模型。
Spatially Prompted Visual Trajectory Prediction for Egocentric Manipulation
Authors: Yifan Li, Xinyu Zhou, Yunhao Ge, et al. | Submitted: 2026-05-19 | arXiv: 2605.20085
Categories: cs.CV
Research Background: Language or task-ID specification is ambiguous in cluttered scenes with similar objects.
研究背景: 在含相似物件的雜亂場景中,語言或任務 ID 的指定具有歧義。
Technical Approach: SP-VTP uses initial spatial prompts (boxes or points) to define objectives, forecasting future end-effector trajectories from egocentric views.
技術方法: SP-VTP 以初始空間提示(框或點)定義目標,從第一人稱視角預測未來末端執行器軌跡。
Key Takeaway: Spatial prompts disambiguate manipulation goals better than language in cluttered scenes.
核心發現: 在雜亂場景中,空間提示比語言更能消除操作目標的歧義。
DriveMA: Rethinking Language Interfaces in Driving VLAs with One-Step Meta-Actions
Authors: Weicheng Zheng, Yixin Huang, Qiao Sun, et al. | Submitted: 2026-05-20 | arXiv: 2605.21273
Categories: cs.CV
Research Background: Driving VLAs use verbose language reasoning interfaces that are hard to annotate, slow, and challenging for compact models.
研究背景: 駕駛 VLA 使用冗長的語言推理介面,難以標註、推論慢且對小模型困難。
Technical Approach: DriveMA replaces long reasoning chains with concise one-step meta-actions as the language interface for end-to-end planning.
技術方法: DriveMA 以簡潔的單步元動作取代長推理鏈,作為端到端規劃的語言介面。
Key Takeaway: Concise meta-actions match or beat verbose reasoning in driving VLAs at lower latency.
核心發現: 在駕駛 VLA 中,簡潔元動作以更低延遲達到甚至優於冗長推理的效果。
LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model
Authors: Xiaodong Mei, Diankun Zhang, Hongwei Xie, et al. | Submitted: 2026-05-21 | arXiv: 2605.22089
Categories: cs.CV, cs.AI
Research Background: Driving VLAs rely on sparse action supervision that underuses their scene-understanding capabilities.
研究背景: 駕駛 VLA 依賴稀疏動作監督,未充分利用其場景理解能力。
Technical Approach: LVDrive adds future-scene latent visual representation learning to enhance VLA driving, avoiding overemphasis on pixel reconstruction.
技術方法: LVDrive 加入未來場景潛在視覺表徵學習以增強 VLA 駕駛,避免過度強調像素重建。
Key Takeaway: Dense latent scene supervision improves VLA driving beyond sparse action labels.
核心發現: 密集的潛在場景監督讓 VLA 駕駛超越稀疏動作標籤的表現。
Remote Teleoperation of Endovascular Intervention Robots: A Systematic Review
Authors: Xingyu Chen, Yinchao Yang, Nikola Fischer, et al. | Submitted: 2026-05-21 | arXiv: 2605.22889
Categories: cs.RO
Research Background: Teleoperated endovascular robots could cut clinician radiation exposure and extend care, yet remain underexplored for time-sensitive interventions.
研究背景: 遙操作血管內機器人可降低臨床醫師輻射暴露並擴展醫療可及性,但對時效性介入仍研究不足。
Technical Approach: This systematic review surveys teleoperated endovascular robotic systems across technical feasibility, communication infrastructure, and clinical outcomes.
技術方法: 本系統性回顧檢視遙操作血管內機器人系統的技術可行性、通訊基礎建設與臨床結果。
Key Takeaway: Remote endovascular teleoperation is technically feasible but clinically underexplored for stroke interventions.
核心發現: 遠端血管內遙操作技術上可行,但在中風介入的臨床應用仍不足。
Four Simple Proprioceptive Estimators for Legged Robots
Authors: Frank Dellaert, Chiyun Noh, Varun Agrawal, et al. | Submitted: 2026-05-21 | arXiv: 2605.23100
Categories: cs.RO
Research Background: Legged robots’ consumer-grade IMUs drift, but intermittent foot contacts can mitigate this.
研究背景: 足式機器人的消費級 IMU 會漂移,但間歇的足部接觸可緩解。
Technical Approach: The report develops four increasingly expressive proprioceptive state estimators building on the contact-aided invariant EKF for legged robots.
技術方法: 本報告以接觸輔助不變 EKF 為基礎,發展四個逐步增強的足式機器人本體感知狀態估計器。
Key Takeaway: Foot-contact-aided estimators progressively reduce inertial drift for legged robot state estimation.
核心發現: 接觸輔助估計器逐步降低足式機器人狀態估計的慣性漂移。
Semantic-Aware Guided Drone Exploration for Language-Conditioned 3D Indoor Mapping
Authors: Nitin Vegesna, Avideh Zakhor | Submitted: 2026-05-22 | arXiv: 2605.23160
Categories: cs.RO, cs.CV
Research Background: Open-vocabulary indoor exploration must balance coverage with language-conditioned semantic priorities.
研究背景: 開放詞彙的室內探索須在覆蓋率與語言條件化的語意優先之間取得平衡。
Technical Approach: SAGE integrates CLIP into the FALCON explorer via object-centric embeddings, a temporal cache, object frontiers, and a unified semantic-geometric planning cost.
技術方法: SAGE 透過物件中心嵌入、時間快取、物件前沿與統一的語意-幾何規劃成本,將 CLIP 整合進 FALCON 探索器。
Key Takeaway: CLIP-guided frontier reprioritization adds open-vocabulary semantics to coverage-oriented exploration.
核心發現: CLIP 引導的前沿重排序為覆蓋導向的探索加入開放詞彙語意。
Autonomous Frontier-Based Exploration with VLM Guidance
Authors: Aarush Aitha, Avideh Zakhor | Submitted: 2026-05-22 | arXiv: 2605.23165
Categories: cs.RO, cs.AI, cs.CL
Research Background: Autonomous exploration of unknown hazardous environments relies on simple geometric frontier heuristics.
研究背景: 未知危險環境的自主探索依賴簡單的幾何前沿啟發式。
Technical Approach: A VLM performs high-level frontier selection from multimodal map-plus-imagery prompts, guiding a conventional low-level control stack.
技術方法: VLM 從含地圖與影像的多模態提示進行高階前沿選擇,引導傳統的低階控制堆疊。
Key Takeaway: VLM-guided frontier selection improves exploration over purely geometric heuristics.
核心發現: VLM 引導的前沿選擇相比純幾何啟發式能改善探索。
Sparse Compositional Flow Matching by geometric assembly from motion primitives
Authors: Yan Tang, Yuanbo Tang, Tingyu Cao, et al. | Submitted: 2026-05-22 | arXiv: 2605.23341
Categories: cs.RO, cs.AI
Research Background: Generative models treat embodied trajectories as dense monolithic signals, ignoring shared motion structure and wasting samples.
研究背景: 生成模型將具身軌跡視為密集單體訊號,忽略共享運動結構並浪費樣本。
Technical Approach: The method uses sparse compositional flow matching, assembling trajectories geometrically from reusable motion primitives.
技術方法: 此方法採用稀疏組合流匹配,從可重用運動基元以幾何方式組裝軌跡。
Key Takeaway: Compositional motion primitives improve sample efficiency for generating embodied robot trajectories.
核心發現: 組合式運動基元提升生成具身機器人軌跡的樣本效率。
ComPose: When to Trust Hands for Object Pose Tracking
Authors: Jisu Shin, Junoh Lee, JunGyu Lee, et al. | Submitted: 2026-05-22 | arXiv: 2605.23523
Categories: cs.CV
Research Background: Object pose tracking from video is vital for manipulation but breaks under hand-grasp occlusions.
研究背景: 從影片追蹤物件姿態對操作至關重要,但在手抓握遮擋下會失效。
Technical Approach: ComPose treats the hand as a complementary cue rather than an occluder, enabling hand-aware 6DoF object pose tracking from RGB video.
技術方法: ComPose 將手視為互補線索而非遮擋物,實現從 RGB 影片進行手感知的 6DoF 物件姿態追蹤。
Key Takeaway: Treating hands as complementary cues improves object pose tracking under grasp occlusion.
核心發現: 將手作為互補線索能改善抓握遮擋下的物件姿態追蹤。
Vision-Based Agile Landing on Turbulent Waters
Authors: Dimosthenis Angelis, Leonard Bauersfeld, Davide Scaramuzza, et al. | Submitted: 2026-05-22 | arXiv: 2605.23717
Categories: cs.RO
Research Background: Autonomous UAV landing on maritime vessels is hard due to coupled vehicle-platform motion in open seas.
研究背景: 無人機在海上船舶自主降落困難,因外海中載具與平台運動耦合。
Technical Approach: The method uses RL with multirotor state and local visual keypoints to predict attitude and thrust without explicit platform-state information.
技術方法: 此方法以 RL 結合多旋翼狀態與局部視覺關鍵點,在無顯式平台狀態下預測姿態與推力。
Key Takeaway: Vision-based RL enables agile UAV landing on moving maritime platforms without platform state.
核心發現: 基於視覺的 RL 可在不需平台狀態下實現無人機在移動海上平台的敏捷降落。
Point Tracking Improves World Action Models
Authors: Jiarui Guan, Wenshuai Zhao, Yue Pei, et al. | Submitted: 2026-05-22 | arXiv: 2605.23856
Categories: cs.RO
Research Background: Pixel-level world-action models entangle dynamics with nuisance factors like lighting and texture.
研究背景: 像素級世界-動作模型將動態與光照、紋理等干擾因子糾纏在一起。
Technical Approach: JOPAT jointly predicts latent observations, 2D point tracks with visibility, and actions in one diffusion transformer, using tracks as explicit motion representation.
技術方法: JOPAT 在單一擴散 Transformer 中聯合預測潛在觀測、含可見性的 2D 點軌跡與動作,以軌跡作為顯式運動表徵。
Key Takeaway: Point tracks provide occlusion-robust motion supervision that improves world-action models for robot policies.
核心發現: 點軌跡提供對遮擋穩健的運動監督,提升機器人策略的世界-動作模型。
Robotic Strawberry Harvesting with Robust Vision and Deep Reinforcement Learning based Sim-to-Real Control
Authors: Al Bashir, Shao-Yang Chang, Partho Ghose, et al. | Submitted: 2026-05-22 | arXiv: 2605.23863
Categories: cs.RO
Research Background: Robotic strawberry harvesting requires robust perception and control in cluttered, occluded scenes.
研究背景: 機器人草莓採收需在雜亂、遮擋的場景中具備穩健感知與控制。
Technical Approach: The system pairs a modified YOLO26-seg perception module with a sim-trained PPO policy in Isaac Lab, executed on a real ROS robot.
技術方法: 系統結合改良的 YOLO26-seg 感知模組與在 Isaac Lab 模擬訓練的 PPO 策略,並在真實 ROS 機器人上執行。
Key Takeaway: Combining robust segmentation with sim-to-real RL enables closed-loop strawberry harvesting.
核心發現: 結合穩健分割與 sim-to-real RL 可實現閉環草莓採收。
MASt3R-Nav: WayPixel Navigation in Relative 3D Maps
Authors: Vansh Garg, Rohit Jayanti, Krish Pandya, et al. | Submitted: 2026-05-22 | arXiv: 2605.24111
Categories: cs.RO, cs.AI
Research Background: Classical 3D maps need global consistency, while topological graphs sacrifice navigation capability.
研究背景: 傳統 3D 地圖需全域一致,而拓樸圖則犧牲導航能力。
Technical Approach: MASt3R-Nav proposes a pixel-relative connectivity map that is geometrically accurate without requiring global consistency, inspired by 3D-grounded image matching.
技術方法: MASt3R-Nav 提出像素相對連通性地圖,受 3D 基礎影像匹配啟發,幾何精確且不需全域一致。
Key Takeaway: Pixel-relative maps offer geometric accuracy for navigation without global consistency constraints.
核心發現: 像素相對地圖在不需全域一致下提供導航所需的幾何精確度。
ECo-MoE: Embodiment-Conditioned Mixture of Experts Increases the Evolvability of Robots
Authors: Yibin Wang, Muhan Li, Zihan Guo, et al. | Submitted: 2026-05-22 | arXiv: 2605.24225
Categories: cs.RO
Research Background: Robot co-design either trains a policy per robot (inefficient) or one universal controller (overly conservative).
研究背景: 機器人協同設計要嘛為每個機器人訓練策略(低效),要嘛用單一通用控制器(過於保守)。
Technical Approach: ECo-MoE co-optimizes a distribution of latent design genotypes and a mixture of control experts gated by decoded design coordinates.
技術方法: ECo-MoE 協同最佳化潛在設計基因型的分布與由解碼設計座標閘控的控制專家混合。
Key Takeaway: Embodiment-conditioned MoE balances per-robot specialization and shared control to increase robot evolvability.
核心發現: 形體條件化 MoE 平衡個體專精與共享控制,提升機器人的可演化性。
AcroRL: Learning Aggressive Quadrotor Inversion using Bidirectional Thrust
Authors: Gabriel Rodriguez, Henri Sayag, Abhishek Rathod, et al. | Submitted: 2026-05-23 | arXiv: 2605.24301
Categories: cs.RO
Research Background: Bidirectional-thrust quadrotors enable aggressive inverted maneuvers but suffer actuator saturation and motor-reversal delays.
研究背景: 雙向推力四旋翼能做激進的倒飛機動,但受致動器飽和與電機反轉延遲所限。
Technical Approach: AcroRL learns to modulate a constant reference trajectory, avoiding heuristic thrust scheduling for aggressive inversion.
技術方法: AcroRL 學習調變恆定參考軌跡,免除激進倒飛所需的啟發式推力排程。
Key Takeaway: Learning-based reference modulation handles bidirectional-thrust quadrotor inversion robustly.
核心發現: 基於學習的參考調變能穩健處理雙向推力四旋翼倒飛。
IsaacIPC: Coupling High-Fidelity Simulation and Realistic Rendering for Contact-Rich Robotic Systems
Authors: Qixin Liang, Zhongqing Han | Submitted: 2026-05-23 | arXiv: 2605.24339
Categories: cs.RO
Research Background: High-fidelity contact-rich robotic simulation must couple accurate physics with realistic rendering for data and policy evaluation.
研究背景: 高保真的接觸密集機器人模擬須結合精確物理與真實渲染,以供資料收集與策略評估。
Technical Approach: IsaacIPC couples GPU-accelerated incremental potential contact with IsaacSim/Lab and adds a geometric mortar contact potential for tactile sensing.
技術方法: IsaacIPC 將 GPU 加速的增量勢接觸與 IsaacSim/Lab 耦合,並加入幾何砂漿接觸勢以支援觸覺感測。
Key Takeaway: Coupling IPC physics with IsaacSim enables real-time, realistic contact-rich simulation for robotics.
核心發現: 將 IPC 物理與 IsaacSim 耦合,實現即時、真實的接觸密集機器人模擬。
Smoother Action Chunking Flow Policy via Prior-Corrected Orthogonal Trust-Region Guidance
Authors: Kai Fang, Hailong Pei, Xuemin Chi | Submitted: 2026-05-23 | arXiv: 2605.24433
Categories: cs.RO, cs.LG
Research Background: Flow-matching action chunking causes discontinuous transitions at chunk boundaries.
研究背景: 流匹配的動作分塊在塊邊界造成不連續的動作轉換。
Technical Approach: POTR adds a data-prior scale to the guidance weight and constrains correction to an orthogonal trust region, smoothing chunk transitions.
技術方法: POTR 在引導權重加入資料先驗尺度,並將修正限制在正交信賴域,平滑塊間轉換。
Key Takeaway: Prior-corrected orthogonal trust-region guidance yields smoother flow-policy action chunking.
核心發現: 先驗修正的正交信賴域引導使流策略的動作分塊更平滑。
Vision-Guided Outdoor Flight and Obstacle Evasion via Reinforcement Learning
Authors: Shiladitya Dutta, Aayush Gupta, Varun Saran, et al. | Submitted: 2026-05-23 | arXiv: 2605.24449
Categories: cs.RO, cs.LG
Research Background: Quadcopters need autonomous obstacle navigation in GNSS- and telemetry-denied environments.
研究背景: 四旋翼需在 GNSS 與遙測受限環境中自主避障導航。
Technical Approach: The sensorimotor policy uses stereo-vision depth and VIO with a pretrained autoencoder perception head and an LSTM planner outputting velocity commands.
技術方法: 此感覺運動策略結合立體視覺深度與 VIO,以預訓練自編碼器感知頭與 LSTM 規劃器輸出速度指令。
Key Takeaway: Vision-only RL enables outdoor obstacle evasion without GNSS or telemetry.
核心發現: 純視覺 RL 可在無 GNSS 或遙測下實現戶外避障。
Polymander II: an amphibious salamander-inspired robot with contact and flow sensors
Authors: Qiyuan Fu, Sudong Lee, Andrea Grillo, et al. | Submitted: 2026-05-23 | arXiv: 2605.24465
Categories: cs.RO
Research Background: Few amphibious robots can sense interactions with both terrestrial and aquatic environments.
研究背景: 少有兩棲機器人能同時感知陸地與水中環境的互動。
Technical Approach: Polymander II uses Hall-effect sensors to measure foot contact and lateral hydrodynamic forces at over 500 Hz on a salamander-inspired robot.
技術方法: Polymander II 在仿蠑螈機器人上以霍爾感測器於超過 500 Hz 量測足部接觸與側向水動力。
Key Takeaway: Dual contact-and-flow sensing enables amphibious robots to adapt across terrestrial and aquatic terrains.
核心發現: 接觸與水流雙重感測讓兩棲機器人能跨陸地與水中地形適應。
Towards Low-Gravity Planetary Exploration using Reinforcement Learning for Walking, Jumping, and In-flight Attitude Control
Authors: Jørgen Anker Olsen, Kostas Alexis | Submitted: 2026-05-23 | arXiv: 2605.24643
Categories: cs.RO, eess.SY
Research Background: Planetary rovers need dynamic locomotion that handles low gravity and obstacles larger than themselves.
研究背景: 行星探測車需要能應對低重力與大於自身障礙的動態運動。
Technical Approach: RL policies are trained for walking, vertical and forward jumping, and in-flight attitude control on a 5-bar-leg quadruped tailored to Mars gravity, with sim-to-real on Olympus.
技術方法: 在針對火星重力調校的五連桿腿四足機器人上訓練行走、垂直與前向跳躍及空中姿態控制的 RL 策略,並在 Olympus 上做 sim-to-real。
Key Takeaway: RL enables jumping-plus-attitude-control locomotion for obstacle traversal in low-gravity exploration.
核心發現: RL 實現結合跳躍與姿態控制的運動,可在低重力探索中跨越障礙。
Sum of Costs Diffusion with Dynamic Guidance for Motion Planning
Authors: Aysu Aylin Kaplan, Özgür Erkent | Submitted: 2026-05-23 | arXiv: 2605.24690
Categories: cs.RO, cs.LG
Research Background: Motion planning for manipulation via learning struggles to generalize across diverse settings.
研究背景: 以學習進行操作的運動規劃難以跨多樣設定泛化。
Technical Approach: The method generates collision-free trajectories with diffusion models guided by the gradient of total collision cost, with a dynamic guidance start step.
技術方法: 此方法以擴散模型生成無碰撞軌跡,由總碰撞成本梯度引導,並採用動態的引導起始步。
Key Takeaway: Sum-of-costs gradient guidance with dynamic scheduling improves diffusion-based motion planning generalization.
核心發現: 具動態排程的代價總和梯度引導提升擴散運動規劃的泛化能力。
Manifold-Constrained MPPI: Real-Time Sampling-Based Control Under Hard Constraints
Authors: Seulchan Lee, Sanghyun Kim | Submitted: 2026-05-24 | arXiv: 2605.24813
Categories: cs.RO, eess.SY
Research Background: Sampling-based MPPI uses soft penalties that cannot guarantee hard-constraint satisfaction in highly constrained tasks.
研究背景: 基於取樣的 MPPI 使用軟懲罰,無法在高度受限任務中保證硬約束滿足。
Technical Approach: MC-MPPI enforces manifold-based equality constraints while preserving MPPI’s derivative-free, real-time advantages.
技術方法: MC-MPPI 在保留 MPPI 無導數、即時優勢的同時強制流形等式約束。
Key Takeaway: Manifold-constrained MPPI guarantees hard constraints for tasks like closed-chain manipulation.
核心發現: 流形約束 MPPI 可為閉鏈操作等任務保證硬約束。
Learning Transferable Motor Skills for Geometry-Aware Robotic Surface Tasks
Authors: Miroslav David, Karla Stepanova, Robert Babuska | Submitted: 2026-05-24 | arXiv: 2605.24881
Categories: cs.RO
Research Background: Surface-interaction tasks need geometric planning plus expert motor patterns, but learning from demonstration overfits to training geometry.
研究背景: 表面互動任務需幾何規劃加上專家運動模式,但從示範學習易過擬合於訓練幾何。
Technical Approach: The modular framework decouples geometric motion planning from execution, representing expert behavior as a vocabulary of interpretable atomic motor rules.
技術方法: 此模組化框架將幾何運動規劃與執行解耦,將專家行為表示為可解釋的原子運動規則詞彙。
Key Takeaway: Decoupling planning from learned motor rules transfers expert surface-task skills across geometries.
核心發現: 將規劃與學得的運動規則解耦,可跨幾何遷移專家的表面任務技能。
X-Foresight: A Joint Vision-Action Causal Forecasting Network via Predictive World Modeling
Authors: Baolu Li, Jingyu Qian, Rui Guo, et al. | Submitted: 2026-05-24 | arXiv: 2605.24892
Categories: cs.CV
Research Background: Equipping VLAs with physical world knowledge from video is hard: video tokens are redundant and dense prediction has a temporal dilemma.
研究背景: 以影片為 VLA 注入物理世界知識困難:影片 token 冗餘且密集預測有時序兩難。
Technical Approach: X-Foresight is a joint vision-action causal forecasting network that uses predictive world modeling to internalize physical dynamics and long-term causality.
技術方法: X-Foresight 是聯合視覺-動作因果預測網路,藉預測式世界建模內化物理動態與長期因果。
Key Takeaway: Joint vision-action causal forecasting helps VLAs internalize physical dynamics for safer planning.
核心發現: 聯合視覺-動作因果預測幫助 VLA 內化物理動態以更安全地規劃。
Dynamic Neural Koopman Distillation for Real-Time Robot Control Using Diffusion Models
Authors: Lei Zheng, Peiqi Yu, Zengqi Peng, et al. | Submitted: 2026-05-24 | arXiv: 2605.24924
Categories: cs.RO
Research Background: Diffusion policies generate multimodal trajectories but their iterative denoising is too slow for high-frequency control.
研究背景: 擴散策略能生成多模態軌跡,但其迭代去噪對高頻控制過慢。
Technical Approach: Dynamic Neural Koopman Distillation distills multistep diffusion into a single forward pass via a factorized dynamic Koopman layer, retaining multimodality.
技術方法: 動態神經 Koopman 蒸餾透過分解式動態 Koopman 層,將多步擴散蒸餾為單次前向傳遞並保留多模態性。
Key Takeaway: Koopman distillation enables single-step, multimodal diffusion control at high frequency.
核心發現: Koopman 蒸餾實現單步、多模態的高頻擴散控制。
Learning High-Frequency Continuous Action Chunks in Latent Space
Authors: Kunyun Wang, Yuhang Zheng, Yupeng Zheng, et al. | Submitted: 2026-05-24 | arXiv: 2605.24931
Categories: cs.RO
Research Background: Action chunking maintains temporal consistency but breaks down at high action frequencies like 60 Hz.
研究背景: 動作分塊能維持時序一致,但在 60 Hz 等高動作頻率下失效。
Technical Approach: The method shifts high-frequency action learning from action space to a VAE latent space, improving temporal and spatial consistency.
技術方法: 此方法將高頻動作學習從動作空間轉移到 VAE 潛在空間,提升時序與空間一致性。
Key Takeaway: Learning action chunks in latent space enables smooth, consistent high-frequency robot control.
核心發現: 在潛在空間學習動作分塊可實現平滑、一致的高頻機器人控制。
Bridging the Gap: Enabling Soft Actor Critic for High Performance Legged Locomotion
Authors: Gianluca Sabatini, Chenhao Li, Marco Hutter | Submitted: 2026-05-24 | arXiv: 2605.24975
Categories: cs.RO, cs.AI, cs.LG
Research Background: PPO dominates legged-robot training but is sample-inefficient, blocking on-hardware fine-tuning.
研究背景: PPO 主導足式機器人訓練但樣本效率低,阻礙硬體上的微調。
Technical Approach: The paper adapts off-policy Soft Actor-Critic to achieve high-performance legged locomotion, enabling a single algorithm for both sim and real online learning.
技術方法: 本文調整 off-policy 的 Soft Actor-Critic 以達成高性能足式運動,讓同一演算法可用於模擬與真實線上學習。
Key Takeaway: Off-policy SAC matches PPO on legged locomotion while enabling sample-efficient real-hardware fine-tuning.
核心發現: off-policy 的 SAC 在足式運動上媲美 PPO,同時實現樣本高效的真實硬體微調。
InvariantCloud: A Globally Invariant, Uniquely Indexed Point Cloud Framework for Robust 6-DoF Tactile Pose Tracking
Authors: Pengfei Ye, Yuxiang Ma, Yi Zhou, et al. | Submitted: 2026-05-24 | arXiv: 2605.25216
Categories: cs.RO
Research Background: High-fidelity 6-DoF tactile pose estimation underpins precise manipulation but suffers drift, especially in yaw.
研究背景: 高保真 6-DoF 觸覺姿態估計支撐精準操作,但易漂移,尤其在偏航軸。
Technical Approach: InvariantCloud exploits global invariance of surface marker constellations for one-shot globally invariant point-cloud registration, suppressing cumulative drift.
技術方法: InvariantCloud 利用表面標記星座的全域不變性進行單次全域不變點雲配準,抑制累積漂移。
Key Takeaway: Globally invariant marker registration improves robust 6-DoF tactile pose tracking, including yaw.
核心發現: 全域不變的標記配準提升穩健的 6-DoF 觸覺姿態追蹤,包含偏航。
From Demonstrations to Rewards: Test-Time Prompt Optimization for VLM Reward Models
Authors: Christian Gumbsch, Leonardo Barcellona, Lennard Schünemann, et al. | Submitted: 2026-05-22 | arXiv: 2606.00083
Categories: cs.LG, cs.AI, cs.RO
Research Background: RL needs accurate rewards, often unavailable in robotics; VLM zero-shot reward models give noisy, prompt-sensitive signals.
研究背景: RL 需準確獎勵,但機器人中常缺;VLM 零樣本獎勵模型訊號雜訊大且對提示敏感。
Technical Approach: The method performs test-time prompt optimization for VLM reward models, using available expert demonstrations to reduce false-positive rewards.
技術方法: 此方法對 VLM 獎勵模型進行測試時提示最佳化,利用既有專家示範減少假陽性獎勵。
Key Takeaway: Test-time prompt optimization on demonstrations yields more reliable VLM reward models for robot RL.
核心發現: 以示範進行測試時提示最佳化,可為機器人 RL 產生更可靠的 VLM 獎勵模型。
Whole-Body Inverse Kinematics with Graph Diffusion
Authors: Helong Huang, Kai Tan, Feng Wen, et al. | Submitted: 2026-05-23 | arXiv: 2606.00086
Categories: cs.RO
Research Background: Inverse kinematics methods struggle to generalize across robot morphologies and model IK’s multi-modality.
研究背景: 逆運動學方法難以跨機器人形態泛化並建模 IK 的多模態性。
Technical Approach: GraphDiff-IK represents the robot as a kinematic graph from its URDF and uses structure-aware graph diffusion to generate joint configurations.
技術方法: GraphDiff-IK 由 URDF 將機器人表示為運動學圖,並以結構感知的圖擴散生成關節配置。
Key Takeaway: Graph diffusion over kinematic structure generalizes IK across diverse, branched robot morphologies.
核心發現: 基於運動學結構的圖擴散讓 IK 能跨多樣、分支的機器人形態泛化。
Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems
Authors: Barak Or | Submitted: 2026-05-23 | arXiv: 2606.00090
Categories: cs.RO, cs.AI
Research Background: Physical AI maps observations and instructions into consequential actions, but black-box models can issue confident yet wrong actions.
研究背景: 物理 AI 將觀測與指令映射為有實體後果的動作,但黑箱模型可能發出自信卻錯誤的動作。
Technical Approach: This literature review surveys runtime action authorization for autonomous systems, framing ‘silent failures’ beyond classical safety and content moderation.
技術方法: 本文獻回顧檢視自主系統的執行期動作授權,將「靜默失效」定位於傳統安全與內容審核之外。
Key Takeaway: Runtime action authorization is an underaddressed safety layer for VLA and robot foundation models.
核心發現: 執行期動作授權是 VLA 與機器人基礎模型尚未充分處理的安全層。
StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video
Authors: Huajian Zeng, Chaohua Yao, Yuantai Zhang, et al. | Submitted: 2026-05-18 | arXiv: 2605.18553
Categories: cs.CV, cs.AI
Research Background: Recovering world-space 4D dual-hand motion from egocentric video supervises robot policy learning but suffers view loss and occlusion.
研究背景: 從第一人稱影片恢復世界空間 4D 雙手運動可監督機器人策略學習,但受視野喪失與遮擋所擾。
Technical Approach: StableHand uses quality-aware flow matching that accounts for per-frame observation reliability when estimating dual-hand motion.
技術方法: StableHand 採用品質感知的流匹配,在估計雙手運動時納入逐幀觀測可靠度。
Key Takeaway: Quality-aware flow matching robustly recovers dual-hand motion for robot policy supervision.
核心發現: 品質感知的流匹配能穩健恢復雙手運動以監督機器人策略。
P2DNav: Panorama-to-Downview Reasoning for Zero-shot Vision-and-Language Navigation
Authors: Kai Sheng, Liuyi Wang, Haojie Dai, et al. | Submitted: 2026-05-19 | arXiv: 2605.19634
Categories: cs.CV, cs.AI
Research Background: Zero-shot VLN methods entangle high-level directional reasoning with fine-grained local grounding via waypoint modules.
研究背景: 零樣本 VLN 方法透過路點模組將高階方向推理與細粒度局部對位糾纏在一起。
Technical Approach: P2DNav is a hierarchical framework with Panorama-to-Downview reasoning and a sliding-window dialogue memory to separate these concerns.
技術方法: P2DNav 是分層框架,以全景到俯視推理與滑動視窗對話記憶來分離這些關注點。
Key Takeaway: Separating directional reasoning from local grounding improves zero-shot vision-and-language navigation.
核心發現: 將方向推理與局部對位分離可改善零樣本視覺語言導航。
Aero-World: Action-Conditioned Aerial Video Generation from Inertial Controls
Authors: Abdul Mohaimen Al Radi, Kunyang Li, Yuzhang Shang, et al. | Submitted: 2026-05-19 | arXiv: 2605.19728
Categories: cs.CV
Research Background: Foundation video models are trained on language, not low-level control, limiting aerial embodied use where small errors cause large drift.
研究背景: 基礎影片模型以語言而非低階控制訓練,限制了空中具身應用,因小誤差會造成大漂移。
Technical Approach: Aero-World generates action-conditioned aerial video from fine-grained inertial controls as a controllable proxy for training and evaluating aerial agents.
技術方法: Aero-World 從細粒度慣性控制生成動作條件化的空中影片,作為訓練與評估空中代理的可控代理環境。
Key Takeaway: Inertial-action-conditioned video generation enables scalable training proxies for aerial agents.
核心發現: 慣性動作條件化的影片生成為空中代理提供可擴展的訓練代理環境。
GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation
Authors: Jiahao Yang, Zihan Wang, Xiangyang Li, et al. | Submitted: 2026-05-21 | arXiv: 2605.22036
Categories: cs.CV, cs.AI
Research Background: VLN approaches rely on dense RGB videos producing excessive tokens and lacking explicit spatial structure.
研究背景: VLN 方法依賴密集 RGB 影片,產生過多 token 且缺乏顯式空間結構。
Technical Approach: GA-VLN introduces a compact geometry-aware BEV representation built from RGB-D inputs, integrating geometric cues into MLLM-based navigation.
技術方法: GA-VLN 引入由 RGB-D 構建的緊湊幾何感知 BEV 表徵,將幾何線索整合進基於 MLLM 的導航。
Key Takeaway: Geometry-aware BEV representations make MLLM navigation more efficient and spatially grounded.
核心發現: 幾何感知的 BEV 表徵讓 MLLM 導航更高效且具空間基礎。
Extending Deep Event Visual Odometry with Sparse Point-Cloud Export
Authors: Alireza Safdari, Sajad Ashraf | Submitted: 2026-05-21 | arXiv: 2605.22890
Categories: cs.RO, cs.CV
Research Background: Event cameras suit high-speed, challenging-lighting visual odometry; DEVO showed strong monocular event-only odometry.
研究背景: 事件相機適合高速、困難光照的視覺里程計;DEVO 展現了強大的單目純事件里程計。
Technical Approach: This work extends DEVO with a sparse point-cloud export pipeline exposing internal 3D structure without altering the core odometry.
技術方法: 本工作以稀疏點雲匯出管線擴展 DEVO,在不改動核心里程計下暴露內部 3D 結構。
Key Takeaway: DEVO can export sparse point clouds for mapping without modifying its core odometry formulation.
核心發現: DEVO 可在不改動核心里程計下匯出稀疏點雲以供建圖。
Verified Task-Space Motion Planning Under Joint-Space Constraints
Authors: Hanjiang Hu, Changliu Liu, Yebin Wang | Submitted: 2026-05-21 | arXiv: 2605.22991
Categories: cs.RO
Research Background: Reactive task-space planners use fixed Cartesian steps unaware of joint limits, causing tracking drift near singularities.
研究背景: 反應式任務空間規劃器使用固定笛卡兒步長且不知關節限制,在奇異點附近造成追蹤漂移。
Technical Approach: The method computes, per step, the largest Cartesian hyperrectangle certifiably reachable under joint displacement bounds via a second-order IK approximation.
技術方法: 此方法以二階 IK 近似,逐步計算在關節位移界限下可證可達的最大笛卡兒超矩形。
Key Takeaway: Certifiably reachable Cartesian regions prevent joint-limit-induced tracking failures in task-space planning.
核心發現: 可證可達的笛卡兒區域能防止任務空間規劃中關節限制引起的追蹤失敗。
Dreaming Smoothly and Sample Efficiently with Gradient Penalized Latent Dynamics
Authors: Romil V. Sonigra, P. R. Kumar | Submitted: 2026-05-21 | arXiv: 2605.23089
Categories: cs.LG, cs.AI
Research Background: Latent world models like DreamerV3 do not enforce local smoothness in learned transition dynamics.
研究背景: DreamerV3 等潛在世界模型未對學得的轉移動態強制局部平滑。
Technical Approach: GPLD adds a row-wise Jacobian penalty on the posterior latent to encourage locally smooth transitions in model-based RL.
技術方法: GPLD 對後驗潛在加入逐列 Jacobian 懲罰,鼓勵基於模型 RL 中的局部平滑轉移。
Key Takeaway: Gradient-penalized latent dynamics improves smoothness and sample efficiency of model-based RL.
核心發現: 梯度懲罰的潛在動態提升基於模型 RL 的平滑度與樣本效率。
Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation
Authors: Zixuan Hu, Xuantuo Huang, Yancheng Li, et al. | Submitted: 2026-05-22 | arXiv: 2605.23257
Categories: cs.RO, cs.CV
Research Background: VLN test-time adaptation methods treat updates as transient, causing catastrophic forgetting and negative transfer.
研究背景: VLN 測試時適應方法將更新視為短暫,造成災難性遺忘與負遷移。
Technical Approach: IDEA accumulates and composes soft-prompt ‘assets’ via Fisher-guided weighting to retain useful cross-domain adaptation.
技術方法: IDEA 透過 Fisher 引導加權累積並組合軟提示「資產」,保留有用的跨域適應。
Key Takeaway: Treating adaptation as accumulable assets prevents forgetting in online vision-language navigation.
核心發現: 將適應視為可累積資產可防止線上視覺語言導航中的遺忘。
Multi-Floor Exploration for Ground Robots via an Incremental Reachable Graph and Structural Priors
Authors: Zhiwen Zhu, Jiaqi Chen, Xiangyi Huang, et al. | Submitted: 2026-05-22 | arXiv: 2605.23350
Categories: cs.RO
Research Background: 2D and 2.5D maps cannot represent overlapping traversable surfaces like stairs for ground-robot multi-floor exploration.
研究背景: 2D 與 2.5D 地圖無法表示樓梯等重疊可行表面,阻礙地面機器人的多樓層探索。
Technical Approach: The framework builds an incremental reachable graph over support surfaces with structural priors for stable, physically reachable frontier detection.
技術方法: 此框架在支撐面上構建增量可達圖並結合結構先驗,以穩定、物理可達的方式偵測前沿。
Key Takeaway: Incremental reachable graphs enable robust multi-floor exploration across stairs and ramps.
核心發現: 增量可達圖實現跨樓梯與坡道的穩健多樓層探索。
Score-Based One-step MeanFlow Policy Optimization
Authors: Kyungyoon Kim, Donghyeon Ki, Hee-Jun Ahn, et al. | Submitted: 2026-05-22 | arXiv: 2605.23365
Categories: cs.LG, cs.AI
Research Background: Diffusion and flow-matching RL policies need multi-step denoising, costly for online RL.
研究背景: 擴散與流匹配的 RL 策略需多步去噪,對線上 RL 成本高。
Technical Approach: SOM applies MeanFlow’s single-step average velocity field to policy optimization, deriving targets without target-distribution samples unavailable online.
技術方法: SOM 將 MeanFlow 的單步平均速度場用於策略最佳化,在無法取得目標分布樣本的線上情境下推導目標。
Key Takeaway: Score-based one-step MeanFlow enables efficient single-evaluation policy optimization in online RL.
核心發現: 基於分數的單步 MeanFlow 實現線上 RL 中單次評估的高效策略最佳化。
How Many Training Samples Are Needed for the Inverse Kinematics Solutions by Artificial Neural Networks
Authors: Dong-Won Lim | Submitted: 2026-05-22 | arXiv: 2605.23583
Categories: cs.RO, cs.LG
Research Background: ANNs approximate inverse kinematics efficiently, but the required number of training samples is unclear.
研究背景: ANN 能高效近似逆運動學,但所需訓練樣本數不明。
Technical Approach: The paper empirically studies how many end-effector samples are needed for accurate ANN-based IK solutions.
技術方法: 本文以實證研究基於 ANN 的 IK 解需要多少末端執行器樣本才能準確。
Key Takeaway: There is a quantifiable sample threshold for accurate neural-network inverse kinematics.
核心發現: 準確的神經網路逆運動學存在可量化的樣本門檻。
Learning a Particle Dynamics Model with Real-world Videos
Authors: Chanho Kim, Suhas V. Sumukh, Li Fuxin | Submitted: 2026-05-22 | arXiv: 2605.23845
Categories: cs.CV
Research Background: World models for physics are usually trained in simulation because real-world perfect state and correspondences are hard to get.
研究背景: 物理世界模型通常在模擬中訓練,因真實世界難以取得完美狀態與對應。
Technical Approach: The method learns a particle dynamics model directly from real-world videos, relaxing the need for perfect state supervision.
技術方法: 此方法直接從真實世界影片學習粒子動態模型,放寬對完美狀態監督的需求。
Key Takeaway: Particle dynamics models can be learned from real videos, bridging sim-trained world models to reality.
核心發現: 粒子動態模型可從真實影片學習,使模擬訓練的世界模型銜接現實。
Reason—Imagine—Act: Closed-Loop LLM Decision Making with World Models for Autonomous Driving
Authors: Zhengqi Sun, Yiwen Sun, Boxuan Liu, et al. | Submitted: 2026-05-19 | arXiv: 2605.24004
Categories: cs.AI, cs.CV, cs.LG, cs.RO
Research Background: LLM-only driving policies can be physically unsafe, and existing methods leave a gap between semantic intent and physical feasibility at decision time.
研究背景: 純 LLM 的駕駛策略可能物理上不安全,現有方法在決策時於語意意圖與物理可行性間留有落差。
Technical Approach: RIA couples an LLM reasoner with an action-conditioned world model that verifies proposed action templates for safety in a closed loop.
技術方法: RIA 將 LLM 推理器與動作條件化世界模型耦合,在閉環中驗證所提動作樣板的安全性。
Key Takeaway: Closed-loop world-model verification grounds LLM driving decisions in physical feasibility.
核心發現: 閉環的世界模型驗證使 LLM 駕駛決策具備物理可行性基礎。
RED: Adaptive Real-Time DAG Scheduling for Robotic Inference under Environmental Dynamics
Authors: Zexin Li, Tao Ren, Johnathan Liu, et al. | Submitted: 2026-05-21 | arXiv: 2605.24044
Categories: cs.RO, cs.SE, eess.SY
Research Background: Robots in dynamic environments face shifting computation graphs that degrade multi-task inference under tight real-time budgets.
研究背景: 動態環境中的機器人面臨變動的計算圖,在緊迫即時預算下損害多任務推論。
Technical Approach: RED is a real-time DAG scheduling framework for multi-task DNN workloads that adapts to environmental dynamics while preserving timing guarantees.
技術方法: RED 是針對多任務 DNN 工作負載的即時 DAG 排程框架,能適應環境動態並保持時序保證。
Key Takeaway: Adaptive DAG scheduling sustains real-time guarantees for robotic inference under changing workloads.
核心發現: 自適應 DAG 排程在變動工作負載下維持機器人推論的即時保證。
WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation
Authors: Ilia Indyk, Ignat Penshin, Ivan Sosin, et al. | Submitted: 2026-05-22 | arXiv: 2605.24074
Categories: cs.CV, cs.RO
Research Background: Fisheye cameras are increasingly used in robotics, but accurate indoor depth benchmarks are missing.
研究背景: 魚眼相機在機器人中日益普及,但缺乏準確的室內深度基準。
Technical Approach: WideDepth is the first indoor fisheye depth dataset with millimeter ground truth across varying fields of view and baselines, plus a depth estimation method.
技術方法: WideDepth 是首個含毫米級真值、涵蓋不同視場與基線的室內魚眼深度資料集,並附深度估計方法。
Key Takeaway: A millimeter-accurate fisheye benchmark unblocks near-field depth estimation for robotics.
核心發現: 毫米級準確的魚眼基準為機器人近場深度估計解除瓶頸。
Anisotropic Diffusion-Driven Ergodic Coverage in Multi-Robot Systems
Authors: Thales C. Silva, Anoop Kiran, Nora Ayanian | Submitted: 2026-05-22 | arXiv: 2605.24125
Categories: cs.RO
Research Background: Heat-equation ergodic search diffuses coverage error isotropically, ignoring directional changes in the target distribution.
研究背景: 熱方程式遍歷搜尋以各向同性擴散覆蓋誤差,忽略目標分布的方向變化。
Technical Approach: The paper introduces an anisotropic diffusion formulation of ergodic coverage for multi-robot systems, combined with potential fields.
技術方法: 本文為多機器人系統引入遍歷覆蓋的各向異性擴散構造,並與勢場結合。
Key Takeaway: Anisotropic diffusion improves multi-robot ergodic coverage by respecting distribution directionality.
核心發現: 各向異性擴散藉尊重分布方向性改善多機器人遍歷覆蓋。
Terrain-Adaptive Grouser Wheel for Optimal Planetary Exploration: Design and Experimental Investigation
Authors: Vincent Griffo, Yashwanth Kumar Nakka | Submitted: 2026-05-23 | arXiv: 2605.24311
Categories: cs.RO
Research Background: Planetary rovers face mobility challenges from varying terrain gradient and granularity.
研究背景: 行星探測車面臨地形坡度與顆粒度變化帶來的移動挑戰。
Technical Approach: The paper introduces a terrain-adaptive grouser wheel with adjustable grouser height, with experimental investigation of performance on granular terrain.
技術方法: 本文提出可調抓地齒高的地形自適應抓地輪,並實驗探究其在顆粒地形上的表現。
Key Takeaway: Actuating grouser height improves rover mobility across diverse planetary terrains.
核心發現: 致動抓地齒高度可改善探測車在多樣行星地形上的移動性。
Unified 3D Scene Understanding Through Physical World Modeling
Authors: Wanhee Lee, Klemen Kotar, Rahul Mysore Venkatesh, et al. | Submitted: 2026-05-23 | arXiv: 2605.24321
Categories: cs.CV
Research Background: 3D scene tasks like depth, view synthesis, and manipulation are usually solved in isolation without a shared representation.
研究背景: 深度、視圖合成與操作等 3D 場景任務通常各自獨立解決,缺乏共享表徵。
Technical Approach: The work unifies diverse 3D understanding tasks into a single physical-world-modeling model where tasks become different prompts.
技術方法: 本工作將多樣的 3D 理解任務統一進單一物理世界建模模型,任務轉化為不同提示。
Key Takeaway: A unified physical world model lets diverse 3D scene tasks share representations and transfer knowledge.
核心發現: 統一的物理世界模型讓多樣 3D 場景任務共享表徵並遷移知識。
EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchy
Authors: Jinzhao Li, Yinuo Chen, Dongxu Piao, et al. | Submitted: 2026-05-23 | arXiv: 2605.24456
Categories: cs.CV
Research Background: Humans constantly reason about 3D proximity to guide perception and action, but whether MLLMs can do such embodied reasoning is unclear.
研究背景: 人類不斷推理 3D 距離以引導感知與行動,但 MLLM 是否能做此類具身推理尚不明確。
Technical Approach: EgoProx is a benchmark for egocentric 3D proximity reasoning organized along a cognitive chain of intention, exploration, exploitation, and chain-of-actions, with an agent-based data engine.
技術方法: EgoProx 是依意圖、探索、利用與動作鏈的認知鏈組織的第一人稱 3D 距離推理基準,並配有基於代理的資料引擎。
Key Takeaway: EgoProx exposes the limits of current MLLMs on embodied 3D proximity reasoning.
核心發現: EgoProx 揭露現有 MLLM 在具身 3D 距離推理上的侷限。
Elevator-LIO: Robust LiDAR-Inertial Odometry for Multi-Floor Navigation under Elevator-Induced Non-Inertial Motion
Authors: Yifan Zhang, Yudong Huang, Yuchong Zhang, et al. | Submitted: 2026-05-23 | arXiv: 2605.24495
Categories: cs.RO
Research Background: Elevator travel induces non-inertial motion that breaks LiDAR-inertial odometry for cross-floor robots.
研究背景: 電梯移動引入非慣性運動,破壞跨樓層機器人的 LiDAR-慣性里程計。
Technical Approach: Elevator-LIO decouples robot-relative-to-elevator and elevator motion in a mode-dependent iterated error-state Kalman filter, degenerating to standard LIO indoors.
技術方法: Elevator-LIO 在模式相依的迭代誤差狀態 Kalman 濾波中解耦機器人相對電梯與電梯本身的運動,在室內退化為標準 LIO。
Key Takeaway: Decoupled state estimation enables continuous localization through elevator-induced non-inertial motion.
核心發現: 解耦狀態估計實現在電梯非慣性運動中的連續定位。
Passivity-based Semi-autonomous Rotational Motion Navigation for Rigid-body Networks: Stability and Human Passivity Analysis
Authors: Reiji Terunuma, Yuta Nakamura, Takeshi Hatanaka | Submitted: 2026-05-23 | arXiv: 2605.24731
Categories: eess.SY, cs.RO
Research Background: Ensuring stability of human-in-the-loop attitude control on the SO(3) manifold is largely unsolved.
研究背景: 確保人在迴路的姿態控制在 SO(3) 流形上的穩定性大致尚未解決。
Technical Approach: The paper proposes a passivity-based semi-autonomous SO(3) attitude framework with stealthy control preserving averaged feedback invariance for the human operator.
技術方法: 本文提出基於被動性的半自主 SO(3) 姿態框架,以隱形控制為人類操作者保持平均回饋的不變性。
Key Takeaway: Passivity-based stealthy control stabilizes human-in-the-loop rotational navigation on SO(3).
核心發現: 基於被動性的隱形控制可穩定 SO(3) 上人在迴路的旋轉導航。
Convex-Neural RRT*: Fast and Reliable Learning-Guided Sampling for High-Quality Robot Path Planning
Authors: Hichem Cheriet, Badra Khellat Kihel, Samira Chouraqui, et al. | Submitted: 2026-05-24 | arXiv: 2605.25006
Categories: cs.RO, cs.LG, cs.NE
Research Background: Sampling-based path planners need many iterations to reach high-quality solutions.
研究背景: 基於取樣的路徑規劃器需大量迭代才能達到高品質解。
Technical Approach: Convex-Neural RRT* uses neural guidance to predict informative waypoint regions and extracts convex candidate regions to concentrate exploration.
技術方法: Convex-Neural RRT* 以神經引導預測有資訊的路點區域,並提取凸候選區域以集中探索。
Key Takeaway: Neural-guided convex region sampling speeds high-quality robot path planning.
核心發現: 神經引導的凸區域取樣加速高品質機器人路徑規劃。
A Decentralized LiDAR-SLAM System with Certifiably Optimal Pose Graph Optimization
Authors: Baoshan Song, Feng Huang, Li-Ta Hsu | Submitted: 2026-05-24 | arXiv: 2605.25051
Categories: cs.RO
Research Background: Decentralized multi-robot LiDAR-SLAM struggles to maintain global consistency in large or degenerate environments.
研究背景: 分散式多機器人 LiDAR-SLAM 難以在大規模或退化環境中維持全域一致。
Technical Approach: The system integrates a certifiably optimal pose graph optimization backend using Riemannian block coordinate methods.
技術方法: 此系統整合採用黎曼塊座標方法的可證最優位姿圖最佳化後端。
Key Takeaway: Certifiably optimal PGO gives decentralized LiDAR-SLAM robust global consistency.
核心發現: 可證最優的 PGO 賦予分散式 LiDAR-SLAM 穩健的全域一致性。
VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understanding
Authors: Ruoyu Wang, Yong Liu, Sheng Tao, et al. | Submitted: 2026-05-24 | arXiv: 2605.25059
Categories: cs.CV
Research Background: Gaussian-centric online occupancy methods struggle with boundary fidelity and rely on scene-size priors.
研究背景: 以高斯為中心的線上佔據方法在邊界保真上吃力且依賴場景尺寸先驗。
Technical Approach: VEOcc is a voxel-centric recursive perception-and-assimilation framework that eliminates initial scale estimation for open-ended map expansion.
技術方法: VEOcc 是以體素為中心的遞迴感知與同化框架,免除初始尺度估計以實現開放式地圖擴展。
Key Takeaway: Voxel-centric recursive occupancy enables scalable online mapping for embodied exploration.
核心發現: 以體素為中心的遞迴佔據實現具身探索的可擴展線上建圖。
WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models
Authors: Bohai Gu, Taiyi Wu, Yueyang Yuan, et al. | Submitted: 2026-05-24 | arXiv: 2605.25077
Categories: cs.CV
Research Background: Interactive video world models let users navigate viewpoints but cannot act on individual objects.
研究背景: 互動式影片世界模型讓使用者導航視角,卻無法對個別物件施加動作。
Technical Approach: WorldCraft expands these models from camera navigation to object-level trajectory actions from a user click.
技術方法: WorldCraft 將這類模型從相機導航擴展到由使用者點擊驅動的物件級軌跡動作。
Key Takeaway: Object-level actions turn passive video world models into manipulable interactive environments.
核心發現: 物件級動作將被動的影片世界模型轉為可操作的互動環境。
Soft Pneumatic Actuators for Soft Robotics: A Motion-Based Review of Actuation Mechanisms and Performance Trade-offs
Authors: Mohammed Abboodi | Submitted: 2026-05-24 | arXiv: 2605.25109
Categories: cs.RO
Research Background: Soft pneumatic actuator performance depends on complex design factors beyond pressure, making mechanism selection hard.
研究背景: 軟氣動致動器的性能取決於壓力以外的複雜設計因素,使機制選擇困難。
Technical Approach: This motion-based review organizes actuation mechanisms and performance trade-offs by chamber shape, reinforcement, folds, and material stiffness.
技術方法: 本綜述以運動為基礎,依腔室形狀、加強件、摺疊與材料剛度整理致動機制與性能取捨。
Key Takeaway: A motion-based taxonomy clarifies which soft pneumatic actuation mechanism suits a given task.
核心發現: 以運動為基礎的分類釐清哪種軟氣動致動機制適合特定任務。
FusionCore: A 23-State Unscented Kalman Filter for IMU, Wheel Encoder, GPS, and Visual SLAM Fusion in ROS 2
Authors: Manan Kharwar | Submitted: 2026-05-24 | arXiv: 2605.25239
Categories: cs.RO, eess.SP
Research Background: Robots need a single robust odometry stream fusing IMU, wheel encoders, GPS, and Visual SLAM.
研究背景: 機器人需要融合 IMU、輪式編碼器、GPS 與 Visual SLAM 的單一穩健里程計流。
Technical Approach: FusionCore is an open-source ROS 2 package using a 23-state UKF that online-estimates wheel-encoder yaw bias and sensor biases.
技術方法: FusionCore 是開源 ROS 2 套件,採 23 狀態 UKF 線上估計輪式編碼器偏航偏差與感測器偏差。
Key Takeaway: A 23-state UKF with online bias estimation reduces heading drift during GPS blackouts.
核心發現: 具線上偏差估計的 23 狀態 UKF 可降低 GPS 中斷期間的航向漂移。
Differentiable Model Predictive Safety for Heterogeneous Mobility at Urban Intersections
Authors: Wenzhe Song, Hao Zhang | Submitted: 2026-05-19 | arXiv: 2605.27418
Categories: cs.MA, cs.RO
Research Background: Coordinating autonomous vehicles and mobile robots with disparate dynamics at unregulated intersections is a key safety challenge.
研究背景: 在無管制路口協調動態各異的自駕車與移動機器人是關鍵安全挑戰。
Technical Approach: DMPS embeds model-predictive foresight into an end-to-end RL architecture, learning a latent dynamics model to predict trajectories for safe coordination.
技術方法: DMPS 將模型預測的前瞻嵌入端到端 RL 架構,學習潛在動態模型以預測軌跡達成安全協調。
Key Takeaway: Differentiable MPC-in-RL enables safe coordination of heterogeneous mobile agents at intersections.
核心發現: 可微分的 MPC 嵌入 RL 可在路口安全協調異質移動代理。
Emergent Semantic Representations in World Models through Physical Interaction without Linguistic Supervision
Authors: Jiayi Fang | Submitted: 2026-05-22 | arXiv: 2605.28865
Categories: cs.LG, cs.AI
Research Background: It is unknown what a world model learns from physical exploration without linguistic supervision.
研究背景: 尚不清楚世界模型在無語言監督下從物理探索學到什麼。
Technical Approach: Training a VAE world model on random embodied exploration shows its latent space develops spatial semantic structure mirroring physical geometry.
技術方法: 在隨機具身探索上訓練 VAE 世界模型,顯示其潛在空間發展出鏡映物理幾何的空間語意結構。
Key Takeaway: World models acquire geometry-organized semantic structure from physical interaction alone, no language needed.
核心發現: 世界模型僅憑物理互動即可獲得以幾何組織的語意結構,無需語言。