arXiv Weekly Digest — Week 23, 2026

Fetched: 2026-05-26 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 381

A Factory-Floor Deployment Case Study of VLA Pipelines for Industrial Packaging Task: Workflow, Failures, and Lessons

Authors: Brian Zhu, Philipp Schmitt, Philine Meister et al. | Submitted: 2026-05-25 | arXiv: 2605.27461 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) policies have shown promising manipulation capabilities, yet their practical impact is often limited by the reliability demands of real-world deployment. We present a deployment study of an industrial packaging task at Siemens Factory (GWE, Erlangen, Germany), where a robot must pick a transparent accessory bag from a cluttered pile, insert it into the remaining cav…
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) policies have shown promising manipulation capabilities, yet their practical impact is often limited by the reliability demands of real-world deploymen

Technical Approach: We present a deployment study of an industrial packaging task at Siemens Factory (GWE, Erlangen, Germany), where a robot must pick a transparent accessory bag from a cluttered pile, insert it into the remaining cavity of a cardboard package, and ensure that the bag and its contents remain below the closing plane. In this paper, we contribute an empirical account of a factory-floor VLA deployment, highlighting recurring failure modes and lessons that inform how to improve the deployment workflow.
技術方法： 本文提出的方法：We present a deployment study of an industrial packaging task at Siemens Factory (GWE, Erlangen, Germany), where a robot must pick a transparent accessory bag from a cluttered pile, insert it into the remaining cavity of a cardboard package, and ensu

Key Takeaway: In this paper, we contribute an empirical account of a factory-floor VLA deployment, highlighting recurring failure modes and lessons that inform how to improve the deployment workflow.
核心發現： 核心結果：In this paper, we contribute an empirical account of a factory-floor VLA deployment, highlighting recurring failure modes and lessons that inform how to improve the deployment workflow.

OASIS: Observation-Action Space Alignment via SE(3) Trajectory Prediction for Robotic Manipulation

Authors: Xinzhe Chen, Sihua Ren, Liqi Huang et al. | Submitted: 2026-05-25 | arXiv: 2605.25829 Categories: cs.RO, cs.AI

Research Background: Recent vision-language-action (VLA) models and world action models (WAMs) advance robotic manipulation by enriching intermediate representations with auxiliary spatial features or future visual-state prediction. However, these representations largely remain within the observation space and do not share the rigid-body geometry of the action space, forcing the action decoder to implicitly recover…
研究背景： 在機器人學習領域，Recent vision-language-action (VLA) models and world action models (WAMs) advance robotic manipulation by enriching intermediate representations with auxiliary spatial features or

Technical Approach: We propose OASIS, a visuomotor policy that aligns the intermediate representation with the action space via $S E (3)$ end-effector trajectory prediction.
技術方法： 本文提出的方法：We propose OASIS, a visuomotor policy that aligns the intermediate representation with the action space via $S E (3)$ end-effector trajectory prediction.

Key Takeaway: Across simulation and real-world experiments, OASIS outperforms VLA and WAM baselines in success rate and out-of-distribution generalization.
核心發現： 核心結果：Across simulation and real-world experiments, OASIS outperforms VLA and WAM baselines in success rate and out-of-distribution generalization.

EXPO-FT: Sample-Efficient Reinforcement Learning Finetuning for Vision-Language-Action Models

Authors: Perry Dong, Kuo-Han Hung, Tian Gao et al. | Submitted: 2026-05-25 | arXiv: 2605.25477 Categories: cs.RO, cs.AI

Research Background: The ability to efficiently and reliably learn new tasks has been a foundational challenge in robotics. Vision-Language-Action (VLA) models have demonstrated strong generalization across diverse manipulation tasks, yet pretrained policies consistently fall short of the reliability required for real-world deployment.
研究背景： 在機器人學習領域，The ability to efficiently and reliably learn new tasks has been a foundational challenge in robotics. Vision-Language-Action (VLA) models have demonstrated strong generalization a

Technical Approach: We present EXPO-FT, a system for stable, sample-efficient RL finetuning of pretrained VLA policies that closes this gap. Our system solves a suite of challenging manipulation tasks, including routing string lights and inserting the plug to light it up, striking a pool ball into a pocket, and inserting a flower into a wine bottle, each requiring combinations of high precision, dynamic actions, and robustness to varied initial states. Our system achieves perfect task performance (30/30 successe…
技術方法： 本文提出的方法：We present EXPO-FT, a system for stable, sample-efficient RL finetuning of pretrained VLA policies that closes this gap. Our system solves a suite of challenging manipulation tasks, including routing string lights and inserting the plug to light it u

Key Takeaway: Our system achieves perfect task performance (30/30 successes) across all evaluated tasks within an average of 19.1 minutes of online robot data, outperforming both prior RL-from-scratch and VLA finetuning approaches.
核心發現： 核心結果：Our system achieves perfect task performance (30/30 successes) across all evaluated tasks within an average of 19.1 minutes of online robot data, outperforming both prior RL-from-scratch and VLA finet

How to Mitigate the Distribution Shift Problem in Robotics Control: A Robust and Adaptive Approach Based on Offline to Online Imitation Learning

Authors: Hyung-Suk Yoon, Seung-Woo Seo | Submitted: 2026-05-25 | arXiv: 2605.25414 Categories: cs.RO

Research Background: Distribution shift in imitation learning refers to the problem that the agent cannot plan proper actions for a state that has not been visited during the training. This problem can be largely attributed to the inherently narrow state-action coverage provided by expert demonstrations over the full environment.
研究背景： 在機器人學習領域，Distribution shift in imitation learning refers to the problem that the agent cannot plan proper actions for a state that has not been visited during the training. This problem can

Technical Approach: In this paper, we propose a robust offline to adaptive online imitation learning framework that handles the distribution shift problem in a lifelong, multi-phase scheme. In the subsequent online inference phase, our framework detects the occurrence of distribution shift and conducts self-supervised imitation learning from online experiences to adapt the policy to the online environments. Through extensive evaluations in MuJoCo environments, we demonstrate that our method exhibits better robus…
技術方法： 本文提出的方法：In this paper, we propose a robust offline to adaptive online imitation learning framework that handles the distribution shift problem in a lifelong, multi-phase scheme. In the subsequent online inference phase, our framework detects the occurrence o

Key Takeaway: Through extensive evaluations in MuJoCo environments, we demonstrate that our method exhibits better robustness to distribution shift and better adaptation performance to online environments than the baseline algorithms, which indicates superior performance of our framework against the distributi…
核心發現： 核心結果：Through extensive evaluations in MuJoCo environments, we demonstrate that our method exhibits better robustness to distribution shift and better adaptation performance to online environments than the

Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models

Authors: Jianwei Tai | Submitted: 2026-05-25 | arXiv: 2605.25889 Categories: cs.CR, cs.LG

Research Background: Vision-Language-Action (VLA) models reach high success rates on clean inputs but collapse under small adversarial perturbations: a $16/255$ PGD attack drops OpenVLA-7B’s LIBERO success from $95%$ to under $5%$ . Whether this trade-off has a theoretical floor was open.
研究背景： 在機器人 AI領域，Vision-Language-Action (VLA) models reach high success rates on clean inputs but collapse under small adversarial perturbations: a $16/255$ PGD attack drops OpenVLA-7B’s LIBERO suc

Technical Approach: The pixel-level bound is loose by $\sim 1 0^{3}$ nats and serves as a ceiling guarantee; an encoder-specific corollary tightens it by over an order of magnitude, into a regime where realized capability already consumes $5$ — $9%$ of the budget. We validate Theorem~\ref{thm:main} with zero violations across $308$ cells: $252$ closed-form Gaussian-VLA, $48$ OpenVLA-7B $+$ LIBERO $+$ PGD ( $4$ suites $\times$ $4$ $\eps$ $\times$ $3$ seeds), $4$ Square-Attack, and $4$ multi-step ( $T = 10$ ).
技術方法： 本文提出的方法：The pixel-level bound is loose by $\sim 1 0^{3}$ nats and serves as a ceiling guarantee; an encoder-specific corollary tightens it by over an order of magnitude, into a regime where realized capability already consumes $5$ — $9%$ of the budget. We valid

Key Takeaway: Together these provide the cross-setting axis defense and architecture comparisons currently lack.
核心發現： 核心結果：Together these provide the cross-setting axis defense and architecture comparisons currently lack.

SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learning

Authors: Zhongling Xu, Shunan Zheng, Wei Wang | Submitted: 2026-05-25 | arXiv: 2605.25424 Categories: cs.LG, cs.AI

Research Background: Existing LLM routing frameworks treat queries as independent events, neglecting the sequential nature of real-world user sessions constrained by global computational budgets. This mismatch inevitably leads to budget bankruptcy: myopic routing policies exhaust resources on early interactions, forcing subsequent and often more complex queries onto inadequate models.
研究背景： 在機器學習與機器人領域，Existing LLM routing frameworks treat queries as independent events, neglecting the sequential nature of real-world user sessions constrained by global computational budgets. This

Technical Approach: We introduce SeqRoute, a framework that formulates multi-turn routing as a finite-horizon Markov Decision Process and solves it via offline reinforcement learning. To overcome data starvation, we propose Hindsight Budget Relabeling (HBR).
技術方法： 本文提出的方法：We introduce SeqRoute, a framework that formulates multi-turn routing as a finite-horizon Markov Decision Process and solves it via offline reinforcement learning. To overcome data starvation, we propose Hindsight Budget Relabeling (HBR).

Key Takeaway: Extensive evaluations demonstrate that SeqRoute reduces operational costs by 6.0-73.5% while maintaining or improving quality, and suppresses bankruptcy rates to under 1%, strictly dominating behavior cloning, budget-aware heuristics, and static baselines across the entire Pareto frontier.
核心發現： 核心結果：Extensive evaluations demonstrate that SeqRoute reduces operational costs by 6.0-73.5% while maintaining or improving quality, and suppresses bankruptcy rates to under 1%, strictly dominating behavior

Rethinking VLM Representation for VLA Initialization

Authors: Weifeng Lin, Siyuan Huang, Hao Li et al. | Submitted: 2026-05-25 | arXiv: 2605.25802 Categories: cs.CV

Research Background: Vision-Language-Action (VLA) models widely adopt pretrained Vision-Language Models (VLMs) as policy backbones, yet it remains unclear what kind of pretrained VLM representation is useful as a VLA initialization. In this paper, we study VLA initialization as a controlled representation-design problem along three axes: capability-level embodied VQA supervision, parameter-update strategy, and robo…
研究背景： 在電腦視覺與機器人領域，Vision-Language-Action (VLA) models widely adopt pretrained Vision-Language Models (VLMs) as policy backbones, yet it remains unclear what kind of pretrained VLM representation is

Technical Approach: In this paper, we study VLA initialization as a controlled representation-design problem along three axes: capability-level embodied VQA supervision, parameter-update strategy, and robot-data pretraining.
技術方法： 本文提出的方法：In this paper, we study VLA initialization as a controlled representation-design problem along three axes: capability-level embodied VQA supervision, parameter-update strategy, and robot-data pretraining.

Key Takeaway: Robot-data pretraining further improves VLA initialization, with the strongest variant obtained by staged LoRA-based training.
核心發現： 核心結果：Robot-data pretraining further improves VLA initialization, with the strongest variant obtained by staged LoRA-based training.

Colosseum V2: Benchmarking Generalization for Vision Language Action Models

Authors: Jeremy Morgan, Prajwal Vijay, Hyeonho Oh et al. | Submitted: 2026-05-26 | arXiv: 2605.27759 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models demonstrate promising generalization in robotic manipulation, driven by advances in large-scale vision and language pre-training. This progress can be misleading.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models demonstrate promising generalization in robotic manipulation, driven by advances in large-scale vision and language pre-training. This progress

Technical Approach: To systematically study this gap, we introduce Colosseum V2, a large-scale simulation benchmark for evaluating VLA generalization in robot learning across diverse conditions.
技術方法： 本文提出的方法：To systematically study this gap, we introduce Colosseum V2, a large-scale simulation benchmark for evaluating VLA generalization in robot learning across diverse conditions.

Key Takeaway: By standardizing tasks, metrics, and evaluation protocols within a unified benchmark, Colosseum V2 enables reproducible and fair comparisons, reduced evaluation overhead, and accelerated progress toward general-purpose robot policies.
核心發現： 核心結果：By standardizing tasks, metrics, and evaluation protocols within a unified benchmark, Colosseum V2 enables reproducible and fair comparisons, reduced evaluation overhead, and accelerated progress towa

HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning

Authors: Kevin Lin, Ajay Mandlekar, Caelan Reed Garrett et al. | Submitted: 2026-05-26 | arXiv: 2605.27724 Categories: cs.RO, cs.AI

Research Background: Imitation learning is a promising approach for training humanoid robots to both walk and manipulate, but it requires a large number of demonstrations, which are time-intensive and difficult to collect via teleoperation. Existing data-generation algorithms can automatically synthesize demonstrations for manipulators, but they are ineffective on humanoids because their high-dimensional composite …
研究背景： 在機器人學習領域，Imitation learning is a promising approach for training humanoid robots to both walk and manipulate, but it requires a large number of demonstrations, which are time-intensive and

Technical Approach: We present HumanoidMimicGen, a method for generating humanoid legged loco-manipulation data. Our method adapts contact-rich whole-body skills from a handful of source demonstrations to new states, generalizing across changes in object pose. To evaluate our approach, we introduce a new simulated loco-manipulation benchmark containing nine diverse tasks that test humanoid loco-manipulation capabilities.
技術方法： 本文提出的方法：We present HumanoidMimicGen, a method for generating humanoid legged loco-manipulation data. Our method adapts contact-rich whole-body skills from a handful of source demonstrations to new states, generalizing across changes in object pose. To evalua

Key Takeaway: We show that whole-body visuomotor policies co-trained with data generated by HumanoidMimicGen outperform those trained only on real-world data by 20%.
核心發現： 核心結果：We show that whole-body visuomotor policies co-trained with data generated by HumanoidMimicGen outperform those trained only on real-world data by 20%.

Authors: Hongyu Ding, Sizhuo Zhang, Ziming Xu et al. | Submitted: 2026-05-26 | arXiv: 2605.27582 Categories: cs.RO, cs.CV

Research Background: Embodied navigation requires an agent to map language and visual observations to a stream of spatial actions that drive a real robot through environments it has never seen. The dominant approach has been to scale vision-language-action (VLA) foundation models on ever-larger collections of robot trajectories.
研究背景： 在機器人學習領域，Embodied navigation requires an agent to map language and visual observations to a stream of spatial actions that drive a real robot through environments it has never seen. The dom

Technical Approach: This paper argues that, for navigation specifically, generality can be obtained structurally, not only through data scale. Therefore, we present Uni-LaViRA, a unified agentic architecture that extends the same insight to four task families (VLN-CE, ObjectNav, EQA, and Aerial-VLN) and to four heterogeneous real robots (Wheeled, Quadruped, Humanoid robot, and a self-built UAV) in a zero-shot manner.
技術方法： 本文提出的方法：This paper argues that, for navigation specifically, generality can be obtained structurally, not only through data scale. Therefore, we present Uni-LaViRA, a unified agentic architecture that extends the same insight to four task families (VLN-CE, O

Key Takeaway: With zero training effort, Uni-LaViRA reaches 60.7% SR on VLN-CE R2R, 51.3% on VLN-CE RxR, 77.7% on HM3D-v2, 60.0% on HM3D-OVON, 54.7% on MP3D-EQA, and 40.0% on OpenUAV, matching or even surpassing recent training navigation foundation models that consume millions of samples and thousands of GPU-…
核心發現： 核心結果：With zero training effort, Uni-LaViRA reaches 60.7% SR on VLN-CE R2R, 51.3% on VLN-CE RxR, 77.7% on HM3D-v2, 60.0% on HM3D-OVON, 54.7% on MP3D-EQA, and 40.0% on OpenUAV, matching or even surpassing re

Riding the Shifting Potential: When Reactive Control Suffices for Multi-Goal Behavior

Authors: Vito Mengers, Oliver Brock | Submitted: 2026-05-26 | arXiv: 2605.27314 Categories: cs.RO, eess.SY

Research Background: Reactive control is often considered insufficient for multi-objective tasks because conflicting objectives give rise to local minima. We argue this limitation is not inherent but arises from static encodings that fail to reflect how objectives currently interact.
研究背景： 在機器人學習領域，Reactive control is often considered insufficient for multi-objective tasks because conflicting objectives give rise to local minima. We argue this limitation is not inherent but a

Technical Approach: We demonstrate this in two domains where conflicts between objectives are central: navigation around non-convex obstacles, where static potential fields fundamentally fail, and planar pushing of non-convex objects, where our method achieves $100%$ success across one-hundred configurations versus $0%$ for the steepest-descent baseline and $\sim 55%$ for diffusion policy, without demonstrations or retraining.
技術方法： 本文提出的方法：We demonstrate this in two domains where conflicts between objectives are central: navigation around non-convex obstacles, where static potential fields fundamentally fail, and planar pushing of non-convex objects, where our method achieves $100%$ s

Key Takeaway: We demonstrate this in two domains where conflicts between objectives are central: navigation around non-convex obstacles, where static potential fields fundamentally fail, and planar pushing of non-convex objects, where our method achieves $100%$ success across one-hundred configurations versus…
核心發現： 核心結果：We demonstrate this in two domains where conflicts between objectives are central: navigation around non-convex obstacles, where static potential fields fundamentally fail, and planar pushing of non-c

FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies

Authors: Xintong Hu, Xuhong Huang, Jinyu Zhang et al. | Submitted: 2026-05-26 | arXiv: 2605.27284 Categories: cs.RO, cs.AI

Research Background: Vision-Language-Action (VLA) models are increasingly expected to not only complete robot tasks, but also follow human instructions about how those tasks should be executed. However, existing robot datasets usually pair trajectories with coarse goal-level language, leaving execution-critical details such as active arm, approach direction, and contact region unspecified.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models are increasingly expected to not only complete robot tasks, but also follow human instructions about how those tasks should be executed. However

Technical Approach: We introduce FineVLA, an open framework for action-aligned fine-grained VLA supervision.
技術方法： 本文提出的方法：We introduce FineVLA, an open framework for action-aligned fine-grained VLA supervision.

Key Takeaway: Overall, fine-grained language should augment goal-level instructions: specifying how to execute alongside what to achieve.
核心發現： 核心結果：Overall, fine-grained language should augment goal-level instructions: specifying how to execute alongside what to achieve.

GE-Sim 2.0: A Roadmap Towards Comprehensive Closed-loop Video World Simulators for Robotic Manipulation

Authors: Boxiang Qiu, Liliang Chen, Yue Liao et al. | Submitted: 2026-05-26 | arXiv: 2605.27491 Categories: cs.RO

Research Background: We introduce GE-Sim 2.0 (Genie Envisioner World Simulator 2.0), a closed-loop video world simulator for robotic manipulation. Building on the action-conditioned video generation framework of Genie Envisioner, GE-Sim 2.0 is re-trained on thousands of hours of real-world robot data spanning teleoperation, contact-rich interaction, and on-robot policy deployment, substantially improving action-fol…
研究背景： 在機器人學習領域，We introduce GE-Sim 2.0 (Genie Envisioner World Simulator 2.0), a closed-loop video world simulator for robotic manipulation. Building on the action-conditioned video generation fr

Technical Approach: On top of this foundation, three new modules close the loop from video simulation to policy learning: a state expert that decodes proprioceptive state from video latents to support next-chunk prediction by downstream VLA policies; a world judge that scores generated rollouts against task instructions, yielding machine-verifiable success signals and rewards in place of manual inspection; and an acceleration framework that delivers a 25-frame rollout in 2.3 seconds on a single H100, with up to …
技術方法： 本文提出的方法：On top of this foundation, three new modules close the loop from video simulation to policy learning: a state expert that decodes proprioceptive state from video latents to support next-chunk prediction by downstream VLA policies; a world judge that

Key Takeaway: GE-Sim 2.0 tops the public WorldArena leaderboard at only 2B parameters, outperforming both dedicated robotic world models and closed-source general video generators, and policies trained against its rollouts and rewards translate into measurable real-world gains, establishing GE-Sim 2.0 as a pra…
核心發現： 核心結果：GE-Sim 2.0 tops the public WorldArena leaderboard at only 2B parameters, outperforming both dedicated robotic world models and closed-source general video generators, and policies trained against its

VR-DAgger: Immersive VR for Dexterous Data Collection and Uncertainty-Guided On-Policy Correction

Authors: René Zurbrügg, Tifanny Portela, Arjun Bhardwaj et al. | Submitted: 2026-05-26 | arXiv: 2605.27114 Categories: cs.RO

Research Background: Learning from demonstrations is effective for robotic manipulation, but collecting sufficient task-specific data remains a major bottleneck. Under distribution shift, small errors compound, performance degrades, and expert time is often spent on redundant, low-value corrections instead of the few critical failure cases.
研究背景： 在機器人學習領域，Learning from demonstrations is effective for robotic manipulation, but collecting sufficient task-specific data remains a major bottleneck. Under distribution shift, small errors

Technical Approach: We present VR-DAgger, a human-in-the-loop framework centered on an immersive VR application for dexterous teleoperation, demonstration collection, and selective policy correction.
技術方法： 本文提出的方法：We present VR-DAgger, a human-in-the-loop framework centered on an immersive VR application for dexterous teleoperation, demonstration collection, and selective policy correction.

Key Takeaway: Active labeling consistently improves over behavioral cloning across all tasks, with gains of up to 23 percentage points.
核心發現： 核心結果：Active labeling consistently improves over behavioral cloning across all tasks, with gains of up to 23 percentage points.

TPS-Drive: Task-Guided Representation Purification for VLM-based Autonomous Driving

Authors: Jiaxiang Li, Yumao Liu, Ke Ma | Submitted: 2026-05-26 | arXiv: 2605.27038 Categories: cs.RO

Research Background: Vision-Language Models (VLMs) provide a promising foundation for autonomous driving planning, yet bridging semantic reasoning and precise 3D spatial forecasting remains a critical challenge. Existing representation strategies generally follow two paths: text-aligned methods flatten continuous spatial states into symbols, which compromises geometric structure and induces “spatial hallucinations”…
研究背景： 在機器人學習領域，Vision-Language Models (VLMs) provide a promising foundation for autonomous driving planning, yet bridging semantic reasoning and precise 3D spatial forecasting remains a critical

Technical Approach: To address these limitations, we introduce TPS-Drive, a novel framework centered on Task-Guided Representation Purification that empowers VLMs to Think in Purified Space. Extensive experiments validate our approach: TPS-Drive achieves accurate agent spatial state forecasting and reduces collision rates in open-loop nuScenes evaluations, while establishing new safety records on the rigorous closed-loop NAVSIMv1 and NAVSIMv2 benchmarks.
技術方法： 本文提出的方法：To address these limitations, we introduce TPS-Drive, a novel framework centered on Task-Guided Representation Purification that empowers VLMs to Think in Purified Space. Extensive experiments validate our approach: TPS-Drive achieves accurate agent

Key Takeaway: Extensive experiments validate our approach: TPS-Drive achieves accurate agent spatial state forecasting and reduces collision rates in open-loop nuScenes evaluations, while establishing new safety records on the rigorous closed-loop NAVSIMv1 and NAVSIMv2 benchmarks.
核心發現： 核心結果：Extensive experiments validate our approach: TPS-Drive achieves accurate agent spatial state forecasting and reduces collision rates in open-loop nuScenes evaluations, while establishing new safety re

Learning Compositional Symbolic Task Rules from Demonstrations with Inductive Logic Programming

Authors: Oleh Borys, Karla Stepanova | Submitted: 2026-05-26 | arXiv: 2605.26828 Categories: cs.RO

Research Background: Learning from Demonstration~(LfD) should capture not only how a task is executed, but also its high-level task structure that explains the demonstrated behavior. As robots become more autonomous, such task representations must be inspectable, reusable, and human-interpretable.
研究背景： 在機器人學習領域，Learning from Demonstration~(LfD) should capture not only how a task is executed, but also its high-level task structure that explains the demonstrated behavior. As robots become m

Technical Approach: The system infers symbolic rules from demonstrations and prior (domain) knowledge, and reuses learned rules when learning higher-level task structure. We evaluate the approach in a synthetic block-assembly scenario and show that the learned abstractions are interpretable and support strong generalization to harder, held-out tasks with unseen objects.
技術方法： 本文提出的方法：The system infers symbolic rules from demonstrations and prior (domain) knowledge, and reuses learned rules when learning higher-level task structure. We evaluate the approach in a synthetic block-assembly scenario and show that the learned abstracti

Key Takeaway: These results provide preliminary evidence that decomposed ILP is a feasible approach to task-level LfD.
核心發現： 核心結果：These results provide preliminary evidence that decomposed ILP is a feasible approach to task-level LfD.

Can VLA Models Learn from Real-World Data Continually without Forgetting?

Authors: Jiarun Zhu, Yijun Hong, Xiaoquan Sun et al. | Submitted: 2026-05-26 | arXiv: 2605.26820 Categories: cs.RO

Research Background: Vision-language-action (VLA) models provide a promising foundation for general-purpose robotics. However, their successful deployment in real-world scenarios requires the ability to continually acquire new skills while retaining previously learned behaviors.
研究背景： 在機器人學習領域，Vision-language-action (VLA) models provide a promising foundation for general-purpose robotics. However, their successful deployment in real-world scenarios requires the ability t

Technical Approach: In summary, this work provides the first empirical study of real-world continual VLA learning and offers practical guidance for deploying long-lived robot policies.
技術方法： 本文提出的方法：In summary, this work provides the first empirical study of real-world continual VLA learning and offers practical guidance for deploying long-lived robot policies.

Key Takeaway: We then systematically evaluate experience replay and uncover key implementation factors that govern its success.
核心發現： 核心結果：We then systematically evaluate experience replay and uncover key implementation factors that govern its success.

On the Generalization Capabilities, Design Choices and Limitations of Keypoint Imitation Learning

Authors: Thomas Lips, Marco Moletta, Michael C. Welle et al. | Submitted: 2026-05-26 | arXiv: 2605.26649 Categories: cs.RO

Research Background: RGB-based imitation learning requires many demonstrations to generalize to unseen objects or scenes, motivating research into intermediate representations to improve generalization for robotic manipulation. Visual foundation models enable one-shot extraction of keypoints to provide such representation.
研究背景： 在機器人學習領域，RGB-based imitation learning requires many demonstrations to generalize to unseen objects or scenes, motivating research into intermediate representations to improve generalization

Technical Approach: Using over 2000 real-world rollouts, we also assess the generalization capabilities of KIL to unseen objects and scene variations. KIL achieves a 75% overall success rate across five tasks, significantly outperforming the RGB baseline (47%) and performing on par with S2-diffusion (73%).
技術方法： 本文提出的方法：Using over 2000 real-world rollouts, we also assess the generalization capabilities of KIL to unseen objects and scene variations. KIL achieves a 75% overall success rate across five tasks, significantly outperforming the RGB baseline (47%) and perfo

Key Takeaway: All rollout videos, demonstrations, and results are available at https://kil-manipulation.github.io/.
核心發現： 核心結果：All rollout videos, demonstrations, and results are available at https://kil-manipulation.github.io/.

Adversarial Dual On-Policy Distillation from Expressive Teacher

Authors: Zhenglin Wan, Jingxuan Wu, Xingrui Yu et al. | Submitted: 2026-05-26 | arXiv: 2605.27095 Categories: cs.LG

Research Background: Learning from demonstrations in embodied control is often cast as behavioral cloning, and recent diffusion or flow-matching policies improve this paradigm by modeling multi-modal expert actions. Yet these methods remain offline supervised learners: the policy is trained only on expert states and receives no corrective signal on the states it actually visits.
研究背景： 在機器學習與機器人領域，Learning from demonstrations in embodied control is often cast as behavioral cloning, and recent diffusion or flow-matching policies improve this paradigm by modeling multi-modal e

Technical Approach: We propose \textbf{FA-OPD}, an \emph{adversarial dual on-policy distillation} method in which a Flow Matching (FM) teacher is learned from demonstrations and co-trained with a lightweight MLP student.
技術方法： 本文提出的方法：We propose \textbf{FA-OPD}, an \emph{adversarial dual on-policy distillation} method in which a Flow Matching (FM) teacher is learned from demonstrations and co-trained with a lightweight MLP student.

Key Takeaway: Across six robot navigation, manipulation, and locomotion benchmarks, FA-OPD beats strong baselines and shows much stronger robustness under noisy or limited demonstrations.
核心發現： 核心結果：Across six robot navigation, manipulation, and locomotion benchmarks, FA-OPD beats strong baselines and shows much stronger robustness under noisy or limited demonstrations.

OmniGF: A Dual-Branch Vision-Language Framework for Unified Gaze Following

Authors: Qiaomu Miao, Haoyu Wu, Jingyi Xu et al. | Submitted: 2026-05-26 | arXiv: 2605.26399 Categories: cs.CV

Research Background: Understanding human gaze behavior is essential for complex scene comprehension and human-computer interaction. Traditional gaze following models are typically restricted to pure spatial localization, lacking the high-level capacity to reason about semantic targets or complex social contexts.
研究背景： 在電腦視覺與機器人領域，Understanding human gaze behavior is essential for complex scene comprehension and human-computer interaction. Traditional gaze following models are typically restricted to pure sp

Technical Approach: To bridge this gap, we propose OmniGF, a unified vision-language framework that adapts foundational VLMs for highly scalable multi-person gaze reasoning. Extensive experiments demonstrate that our framework establishes new state-of-the-art performance across multiple standard benchmarks.
技術方法： 本文提出的方法：To bridge this gap, we propose OmniGF, a unified vision-language framework that adapts foundational VLMs for highly scalable multi-person gaze reasoning. Extensive experiments demonstrate that our framework establishes new state-of-the-art performanc

Key Takeaway: Extensive experiments demonstrate that our framework establishes new state-of-the-art performance across multiple standard benchmarks.
核心發現： 核心結果：Extensive experiments demonstrate that our framework establishes new state-of-the-art performance across multiple standard benchmarks.

ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving

Authors: Mohammadreza Teymoorianfard, Jean-Philippe Monteuuis, Jonathan Petit et al. | Submitted: 2026-05-27 | arXiv: 2605.29114 Categories: cs.CR, cs.LG, cs.RO

Research Background: Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under realistic input perturbations remains largely unexplored.
研究背景： 在機器人 AI領域，Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory gener

Technical Approach: We introduce a reasoning-aware evaluation framework capturing both semantic and structural aspects of reasoning, along with safety-centric measures.
技術方法： 本文提出的方法：We introduce a reasoning-aware evaluation framework capturing both semantic and structural aspects of reasoning, along with safety-centric measures.

Key Takeaway: Our results highlight the need for rigorous evaluation and improved defenses to ensure the safety of reasoning-enabled VLA systems in autonomous driving.
核心發現： 核心結果：Our results highlight the need for rigorous evaluation and improved defenses to ensure the safety of reasoning-enabled VLA systems in autonomous driving.

Imitation Learning for Robot Assistance in Open Surgery: A Multi-Policy Evaluation on Suture Following

Authors: Xucheng Wang, Zhizhou Yang, Xiaoman Zhang et al. | Submitted: 2026-05-27 | arXiv: 2605.28736 Categories: cs.RO

Research Background: This study presents the first evaluation of general-purpose imitation learning for surgeon-robot collaborative assistance in open surgery, targeting suture following: the grab-pull-release motion an assistant performs at every stitch. We collect 160 teleoperated demonstrations (32,374 frames) on an open-source robot arm, benchmark four architecturally diverse imitation learning policies (ACT, D…
研究背景： 在機器人學習領域，This study presents the first evaluation of general-purpose imitation learning for surgeon-robot collaborative assistance in open surgery, targeting suture following: the grab-pull

Technical Approach: Among all policies, $π_{0}$ achieves the strongest results with a pretrained vision-language backbone, demonstrating superior data efficiency, greater robustness to background variation, and smoother trajectories compatible with surgical workflow. When deployed in a surgeon-robot suturing trial, $π_{0}$ yields a $92%$ stitch completion rate.
技術方法： 本文提出的方法：Among all policies, $π_{0}$ achieves the strongest results with a pretrained vision-language backbone, demonstrating superior data efficiency, greater robustness to background variation, and smoother trajectories compatible with surgical workflow. When

Key Takeaway: Among all policies, $π_{0}$ achieves the strongest results with a pretrained vision-language backbone, demonstrating superior data efficiency, greater robustness to background variation, and smoother trajectories compatible with surgical workflow.
核心發現： 核心結果：Among all policies, $π_{0}$ achieves the strongest results with a pretrained vision-language backbone, demonstrating superior data efficiency, greater robustness to background variation, and smoother tr

How VLAs Fail Differently: Black-Box Action Monitoring Reveals Architecture-Specific Failure Signatures

Authors: Krishnam Gupta | Submitted: 2026-05-27 | arXiv: 2605.28726 Categories: cs.RO, cs.LG

Research Background: We discover that VLA architectures fail in fundamentally different, predictable ways at the motor-command level. Running VQ-BeT, Diffusion Policy, and ACT on identical evaluation protocols (n=450 episodes across PushT and ALOHA 14-DOF bimanual manipulation), we find: (1) direction reversal rate is a universal failure predictor across all three architectures (AUROC=0.93, 0.79, 0.91; p<0.001); (2…
研究背景： 在機器人學習領域，We discover that VLA architectures fail in fundamentally different, predictable ways at the motor-command level. Running VQ-BeT, Diffusion Policy, and ACT on identical evaluation p

Technical Approach: No single monitor works universally; architecture-matched selection is required. This finding was enabled by SafeContract, a training-free, black-box action monitoring toolkit with conformal calibration.
技術方法： 本文提出的方法：No single monitor works universally; architecture-matched selection is required. This finding was enabled by SafeContract, a training-free, black-box action monitoring toolkit with conformal calibration.

Key Takeaway: This finding was enabled by SafeContract, a training-free, black-box action monitoring toolkit with conformal calibration.
核心發現： 核心結果：This finding was enabled by SafeContract, a training-free, black-box action monitoring toolkit with conformal calibration.

PrimitiveVLA: Learning Reusable Motion Primitives for Efficient and Generalizable Robotic Manipulation

Authors: Yutai Li, Shaohui Peng, Jiaming Guo et al. | Submitted: 2026-05-27 | arXiv: 2605.28634 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models offer a promising paradigm for generalist robotic policies, yet their adaptation is hindered by data inefficiency and poor generalization. We argue that these bottlenecks stem from the prevailing Direct Instruction-to-Control Mapping, which forces models to memorize monolithic trajectories rather than reusable motion patterns, i.e., primitives.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models offer a promising paradigm for generalist robotic policies, yet their adaptation is hindered by data inefficiency and poor generalization. We ar

Technical Approach: We propose PrimitiveVLA, a framework that shifts this paradigm toward a Primitive-Centric Disassemble & Assemble paradigm. Extensive experiments show that our framework improves data efficiency and achieves superior zero-shot generalization across unseen and long-horizon tasks.
技術方法： 本文提出的方法：We propose PrimitiveVLA, a framework that shifts this paradigm toward a Primitive-Centric Disassemble & Assemble paradigm. Extensive experiments show that our framework improves data efficiency and achieves superior zero-shot generalization across un

Key Takeaway: Extensive experiments show that our framework improves data efficiency and achieves superior zero-shot generalization across unseen and long-horizon tasks.
核心發現： 核心結果：Extensive experiments show that our framework improves data efficiency and achieves superior zero-shot generalization across unseen and long-horizon tasks.

What Frozen VLAs Already Know About Success: A Probing Study of Value-Like Structure in Foundation Robot Policies

Authors: Jiachen Zhang, Junnan Nie, Junyi Lao et al. | Submitted: 2026-05-27 | arXiv: 2605.28527 Categories: cs.RO

Research Background: Vision—language—action (VLA) policies are trained to imitate actions; their loss never asks them to estimate reward, progress, or future success. Their frozen representations nevertheless carry such information, and it can be read out and used to guide action choice without retraining the policy.
研究背景： 在機器人學習領域，Vision—language—action (VLA) policies are trained to imitate actions; their loss never asks them to estimate reward, progress, or future success. Their frozen representations nev

Technical Approach: The targets are consistently predictable from OpenVLA, Pi0.5, DINOv2, and CLIP features, and substantially less so from baselines built on progress, time-to-go, task identity, or proprioception. To rule out task and temporal shortcuts, we evaluate the probes under same-task, same-timestep matched comparisons: Pi0.5 probes still reach roughly 92% pairwise ordering accuracy, while label-shuffled controls stay at chance.
技術方法： 本文提出的方法：The targets are consistently predictable from OpenVLA, Pi0.5, DINOv2, and CLIP features, and substantially less so from baselines built on progress, time-to-go, task identity, or proprioception. To rule out task and temporal shortcuts, we evaluate th

Key Takeaway: To rule out task and temporal shortcuts, we evaluate the probes under same-task, same-timestep matched comparisons: Pi0.5 probes still reach roughly 92% pairwise ordering accuracy, while label-shuffled controls stay at chance.
核心發現： 核心結果：To rule out task and temporal shortcuts, we evaluate the probes under same-task, same-timestep matched comparisons: Pi0.5 probes still reach roughly 92% pairwise ordering accuracy, while label-shuffle

Mag-VLA: Vision-Language-Action Model for Bimanual Magnetically Actuated Microrobot Manipulation

Authors: Yongchen Wang, Kangyi Lu, Lan Wei et al. | Submitted: 2026-05-27 | arXiv: 2605.28486 Categories: cs.RO

Research Background: Magnetically actuated microrobots have been used as wireless, non-contact manipulation tools at microscales, making them promising for minimally invasive applications. However, their control remains challenging due to indirect actuation, limited sensing, and nonlinear magnetic interactions.
研究背景： 在機器人學習領域，Magnetically actuated microrobots have been used as wireless, non-contact manipulation tools at microscales, making them promising for minimally invasive applications. However, the

Technical Approach: In this work, we propose Mag-VLA, a vision-language-action (VLA) model for dexterous magnetic microrobot manipulation using two robotic arms with mounted magnets for dynamic magnetic-field construction. Our framework adapts a Qwen2.5-VL-7B backbone using Low-Rank Adaptation (LoRA) to process visual observations and language instructions for action prediction. To capture task progression, we introduce a motion-aware phase classifier and a phase-conditioned Action Chunking Transformer (ACT) dec…
技術方法： 本文提出的方法：In this work, we propose Mag-VLA, a vision-language-action (VLA) model for dexterous magnetic microrobot manipulation using two robotic arms with mounted magnets for dynamic magnetic-field construction. Our framework adapts a Qwen2.5-VL-7B backbone u

Key Takeaway: These results demonstrate that hierarchical VLA modeling provides a promising framework for magnetic microrobot manipulation.
核心發現： 核心結果：These results demonstrate that hierarchical VLA modeling provides a promising framework for magnetic microrobot manipulation.

Teacher-Student Representational Alignment for Reinforcement Learning-Driven Imitation Learning

Authors: Meraj Mammadov, Pedro Zuidberg Dos Martires, Johannes Andreas Stork | Submitted: 2026-05-27 | arXiv: 2605.28372 Categories: cs.LG, cs.RO

Research Background: Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observation spaces prevalent in robotics. This paper addresses the irreducible imitation gap that emerges when teacher and student are learned in isolation, and the teacher policy has the liberty to rely on privileged state in…
研究背景： 在機器學習與機器人領域，Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observati

Technical Approach: This paper addresses the irreducible imitation gap that emerges when teacher and student are learned in isolation, and the teacher policy has the liberty to rely on privileged state information that the student cannot infer from its observations. Instead of improving poor student performance with RL finetuning after IL, which often requires a whole new training setup, we propose a novel algorithm which learns a shared embedding space that hides agent-specific observations and thus trains imit…
技術方法： 本文提出的方法：This paper addresses the irreducible imitation gap that emerges when teacher and student are learned in isolation, and the teacher policy has the liberty to rely on privileged state information that the student cannot infer from its observations. Ins

Key Takeaway: We perform evaluations on several example domains and compare to state-of-the-art baselines showing that our algorithm enables higher student performance with substantially reduced imitation gap.
核心發現： 核心結果：We perform evaluations on several example domains and compare to state-of-the-art baselines showing that our algorithm enables higher student performance with substantially reduced imitation gap.

ProgVLA: Progress-Aware Robot Manipulation Skill Learning

Authors: Seungsu Kim, Jinyoung Choi, Seungmin Baek et al. | Submitted: 2026-05-27 | arXiv: 2605.28231 Categories: cs.RO, cs.LG

Research Background: We present ProgVLA, a compact vision-language-action (VLA) model designed for reliable robot manipulation under tight compute and memory budgets. The model specifically focuses on efficiently processing long multi-modal sequences by maintaining an explicit representation of task progress over extended horizons.
研究背景： 在機器人學習領域，We present ProgVLA, a compact vision-language-action (VLA) model designed for reliable robot manipulation under tight compute and memory budgets. The model specifically focuses on

Technical Approach: Second, an auxiliary set of progress heads is trained with offline reinforcement learning (RL) objectives to jointly learn critics over normalized remaining-horizon targets. This provides the policy with an internal estimate of task progress and enables advantage- and success-weighted flow-matching imitation learning.
技術方法： 本文提出的方法：Second, an auxiliary set of progress heads is trained with offline reinforcement learning (RL) objectives to jointly learn critics over normalized remaining-horizon targets. This provides the policy with an internal estimate of task progress and enab

Key Takeaway: On two well-established multi-task robot manipulation benchmarks, a 0.1B-parameter ProgVLA model reaches success rates that are competitive with, and on long-horizon and harder task tiers exceed, substantially larger pretrained baselines.
核心發現： 核心結果：On two well-established multi-task robot manipulation benchmarks, a 0.1B-parameter ProgVLA model reaches success rates that are competitive with, and on long-horizon and harder task tiers exceed, subs

SAFEVPR: Patch-Based Conformal Verification for Safe Cross-Condition Sequence Visual Place Recognition

Authors: Ha Sier, Jiaqiang Zhang, Zhuo Zou et al. | Submitted: 2026-05-27 | arXiv: 2605.28048 Categories: cs.RO

Research Background: Sequence-based visual place recognition (VPR) for SLAM and robot relocalization must decide whether the retrieved top-1 candidate is safe to accept. Conformal prediction is a natural framework for this accept/reject decision, but its finite-sample guarantees rely on exchangeability between calibration and deployment (test) data, which is violated under cross-condition deployment.
研究背景： 在機器人學習領域，Sequence-based visual place recognition (VPR) for SLAM and robot relocalization must decide whether the retrieved top-1 candidate is safe to accept. Conformal prediction is a natur

Technical Approach: We introduce SAFEVPR, a non-trainable verification-and-calibration pipeline for safe cross-condition sequence VPR.
技術方法： 本文提出的方法：We introduce SAFEVPR, a non-trainable verification-and-calibration pipeline for safe cross-condition sequence VPR.

Key Takeaway: The results show that raw discrimination alone is not sufficient for conformal validity: AnyLoc-VLAD and Super-Point+LightGlue reach comparable area under the receiver operating characteristic curve (AUROC) but fail more setups under the same calibration.
核心發現： 核心結果：The results show that raw discrimination alone is not sufficient for conformal validity: AnyLoc-VLAD and Super-Point+LightGlue reach comparable area under the receiver operating characteristic curve (

World Models for Robotic Manipulation: A Survey

Authors: Fangyuan Wang, Ziyuan Wang, Guorui Pei et al. | Submitted: 2026-05-27 | arXiv: 2606.00113 Categories: cs.RO

Research Background: Robotic manipulation depends on the ability to anticipate how actions reshape objects, contacts, and scene geometry before execution. Learned world models provide this capability by predicting task-relevant future evolution under robot intervention, yet the term now spans latent dynamics models, action-conditioned video generators, three- and four-dimensional scene predictors, physics-informed …
研究背景： 在機器人學習領域，Robotic manipulation depends on the ability to anticipate how actions reshape objects, contacts, and scene geometry before execution. Learned world models provide this capability b

Technical Approach: We operationally define a world model as an action-conditioned predictive system and distinguish it from perception modules, inverse models, policies, rewards, and value functions. We then organize existing work into five representation families, develop a functional taxonomy that separates integrated prediction-action models from explicit predictive planners, and characterize infrastructure roles including synthetic experience generation, candidate filtering, search-based evaluation, learned…
技術方法： 本文提出的方法：We operationally define a world model as an action-conditioned predictive system and distinguish it from perception modules, inverse models, policies, rewards, and value functions. We then organize existing work into five representation families, dev

Key Takeaway: This survey shows that world models are evolving from task-specific dynamics predictors into predictive infrastructure for robot learning, while exposing open challenges in contact modeling, hallucination control, action alignment, and benchmarking under closed-loop use.
核心發現： 核心結果：This survey shows that world models are evolving from task-specific dynamics predictors into predictive infrastructure for robot learning, while exposing open challenges in contact modeling, hallucina

Frequency-Guided Action Diffusion via Sub-Frequency Manifold Traversal

Authors: Junlin Wang | Submitted: 2026-05-27 | arXiv: 2605.27919 Categories: cs.RO, cs.LG

Research Background: Learning visuomotor policies via behavior cloning typically involves mimicking expert demonstrations collected by human operators. However, natural human demonstrations inherently contain high-frequency noise, such as intermittent jerks, pauses, and action jitter.
研究背景： 在機器人學習領域，Learning visuomotor policies via behavior cloning typically involves mimicking expert demonstrations collected by human operators. However, natural human demonstrations inherently

Technical Approach: To address these limitations, we present a novel frequency-based algorithm that enables implicit spectral maneuvering and smooth action generation. Our method, Frequency Guidance Operator (FGO), steers the generation process of diffusion polices by progressively driving the noisy samples through intermediate sub-frequency manifolds with expanding spectral bands.
技術方法： 本文提出的方法：To address these limitations, we present a novel frequency-based algorithm that enables implicit spectral maneuvering and smooth action generation. Our method, Frequency Guidance Operator (FGO), steers the generation process of diffusion polices by p

Key Takeaway: Validated on 15 robotic manipulation tasks from 5 benchmarks, FGO achieves superior performance in enhancing action smoothness and temporal consistency while preserving the details necessary for successful task execution.
核心發現： 核心結果：Validated on 15 robotic manipulation tasks from 5 benchmarks, FGO achieves superior performance in enhancing action smoothness and temporal consistency while preserving the details necessary for succe

General Covariant Action Modeling: Constructing Generalized Manifolds via Spatio-Temporal Decoupling

Authors: Huaihai Lyu, Chaofan Chen, Mingyu Cao et al. | Submitted: 2026-05-27 | arXiv: 2606.00110 Categories: cs.CV, cs.RO

Research Background: Achieving robust generalization from limited data is a central challenge in embodied intelligence. Prevailing methods fail by regressing absolute coordinates, which violates the principle of general covariance.
研究背景： 在電腦視覺與機器人領域，Achieving robust generalization from limited data is a central challenge in embodied intelligence. Prevailing methods fail by regressing absolute coordinates, which violates the pr

Technical Approach: To resolve this, we propose the Generalized Action Manifold (GAM) framework that enforces general covariance through structural disentanglement.
技術方法： 本文提出的方法：To resolve this, we propose the Generalized Action Manifold (GAM) framework that enforces general covariance through structural disentanglement.

Key Takeaway: Empirical results demonstrate that GAM enables superior transfer and robustness capabilities, outperforming geometry-agnostic baselines.
核心發現： 核心結果：Empirical results demonstrate that GAM enables superior transfer and robustness capabilities, outperforming geometry-agnostic baselines.

Tabero: Learning Gentle Manipulation with Closed-Loop Force Feedback from Vision, Touch, and Language

Authors: Qiwei Wu, Rui Zhang, Xin Xiang et al. | Submitted: 2026-05-27 | arXiv: 2605.27886 Categories: cs.RO

Research Background: Tactile sensing is essential for robots to achieve human-like gentle manipulation. However, existing Vision-Language-Action (VLA) models struggle to exploit tactile feedback for gentle manipulation due to scarce aligned vision-tactile-language data and the lack of effective closed-loop force feedback mechanisms.
研究背景： 在機器人學習領域，Tactile sensing is essential for robots to achieve human-like gentle manipulation. However, existing Vision-Language-Action (VLA) models struggle to exploit tactile feedback for ge

Technical Approach: To address these challenges, we introduce Tabero, a benchmark and model suite for gentle, language-conditioned robotic manipulation that demands fine-grained contact force perception. Second, we propose Tabero-VTLA, an architecture with a decoupled force-position command interface; the resulting force-position commands are executed by a fixed hybrid controller to enable real-time, force-aware manipulation. Evaluated on Tabero, our model maintains high task success while reducing average grip …
技術方法： 本文提出的方法：To address these challenges, we introduce Tabero, a benchmark and model suite for gentle, language-conditioned robotic manipulation that demands fine-grained contact force perception. Second, we propose Tabero-VTLA, an architecture with a decoupled f

Key Takeaway: Evaluated on Tabero, our model maintains high task success while reducing average grip force by over 70% under gentle instructions, demonstrating its ability to modulate interaction forces based on multimodal experience.
核心發現： 核心結果：Evaluated on Tabero, our model maintains high task success while reducing average grip force by over 70% under gentle instructions, demonstrating its ability to modulate interaction forces based on m

Ω-QVLA: Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling

Authors: Xinyu Wang, Mingze Li, Sicheng Lyu et al. | Submitted: 2026-05-27 | arXiv: 2605.28803 Categories: cs.CV, cs.LG

Research Background: Vision-Language-Action (VLA) models unify perception, reasoning, and control within a single policy, yet their multi-billion-parameter backbones and diffusion-based action heads make on-device deployment prohibitively expensive. Prior quantization efforts offer only partial solutions, compressing the LLM backbone while leaving the DiT action head at full precision, or resorting to mixed-precisi…
研究背景： 在電腦視覺與機器人領域，Vision-Language-Action (VLA) models unify perception, reasoning, and control within a single policy, yet their multi-billion-parameter backbones and diffusion-based action heads ma

Technical Approach: Omega-QVLA combines a composite SVD-Hadamard rotation that equalizes per-channel weight energy while diffusing residual activation outliers with per-step DiT activation scaling quantization that absorbs dynamic-range drift across denoising steps. On LIBERO, Omega-QVLA compresses Pi 0.5 and GR00T N1.5 to W4A4 with 98.0% and 87.8% task success rates, matching or exceeding their FP16 references of 97.1% and 87.0%, while reducing the static memory footprint by 71.3%.
技術方法： 本文提出的方法：Omega-QVLA combines a composite SVD-Hadamard rotation that equalizes per-channel weight energy while diffusing residual activation outliers with per-step DiT activation scaling quantization that absorbs dynamic-range drift across denoising steps. On

Key Takeaway: Code is available at https://github.com/UCMP13753/Omega-QVLA.
核心發現： 核心結果：Code is available at https://github.com/UCMP13753/Omega-QVLA.

SPAR: Support-Preserving Action Rectification

Authors: Jiaxin Zhao, Weihang Pan, Xun Liang et al. | Submitted: 2026-05-27 | arXiv: 2605.27877 Categories: cs.LG, cs.AI

Research Background: Offline policy improvement faces an inherent conflict between maximizing value and fitting the data distribution. While in-sample weighted regression is stable, it suffers from over-conservatism that suppresses high-value actions in the distribution tail; conversely, gradient-based approaches often exhibit a fitting-optimization conflict of gradients, which drives the policy off the data manifold.
研究背景： 在機器學習與機器人領域，Offline policy improvement faces an inherent conflict between maximizing value and fitting the data distribution. While in-sample weighted regression is stable, it suffers from ove

Technical Approach: To address this, we propose Support-Preserving Action Rectification (SPAR), which reframes global learning as a local residual rectification anchored to a frozen pure behavior cloning policy.
技術方法： 本文提出的方法：To address this, we propose Support-Preserving Action Rectification (SPAR), which reframes global learning as a local residual rectification anchored to a frozen pure behavior cloning policy.

Key Takeaway: Theoretically, we prove this mechanism eliminates the manifold-normal drift of standard value gradients, while extensive D4RL experiments show SPAR extracts significant gains from suboptimal baselines to achieve state-of-the-art performance.
核心發現： 核心結果：Theoretically, we prove this mechanism eliminates the manifold-normal drift of standard value gradients, while extensive D4RL experiments show SPAR extracts significant gains from suboptimal baselines

GEM: Generative Supervision Helps Embodied Intelligence

Authors: Ruowen Zhao, Bangguo Li, Zuyan Liu et al. | Submitted: 2026-05-27 | arXiv: 2605.28548 Categories: cs.CV

Research Background: Embodied Vision-Language Models (VLMs) have demonstrated impressive performance and generalization in robotics, particularly within Vision-Language-Action frameworks. However, a significant gap remains between the high-level semantic focus of standard text-guided pre-training paradigms and the low-level spatial and physical knowledge critical for execution in embodied environments.
研究背景： 在電腦視覺與機器人領域，Embodied Vision-Language Models (VLMs) have demonstrated impressive performance and generalization in robotics, particularly within Vision-Language-Action frameworks. However, a si

Technical Approach: In this paper, we introduce GEM, a Generative-supervised Embodied vision-language Model designed to bridge this divide. We propose integrating a depth map generation task directly into the VLM pre-training phase.
技術方法： 本文提出的方法：In this paper, we introduce GEM, a Generative-supervised Embodied vision-language Model designed to bridge this divide. We propose integrating a depth map generation task directly into the VLM pre-training phase.

Key Takeaway: Furthermore, our deployed action model, GEM-VLA, exhibits vastly superior task execution abilities in both simulation environments and real-world evaluations.
核心發現： 核心結果：Furthermore, our deployed action model, GEM-VLA, exhibits vastly superior task execution abilities in both simulation environments and real-world evaluations.

VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking

Authors: Jiyuan Fu, Kaixun Jiang, Jingkai Jia et al. | Submitted: 2026-05-27 | arXiv: 2605.28083 Categories: cs.CV

Research Background: While Vision-Language-Action (VLA) models have emerged as powerful generalist policies, their severe vulnerability to adversarial patches significantly hinders their deployment in safety-critical domains. Moreover, existing patch attacks primarily focus on white-box settings, heavily overfitting to the specific action output space of the target model, which results in poor cross-architecture tr…
研究背景： 在電腦視覺與機器人領域，While Vision-Language-Action (VLA) models have emerged as powerful generalist policies, their severe vulnerability to adversarial patches significantly hinders their deployment in

Technical Approach: To overcome this limitation, we propose VLA-Hijack, a unified adversarial framework that breaks the transferability bottleneck by exploiting a fundamental vulnerability identified in this work: before planning any motion, a VLA model must first use visual information to locate its own robotic arm within the environment. Targeting this shared visual self-localization process, our approach concurrently optimizes Attention-Guided Proprioceptive Suppression to inhibit the real robotic arm’s featu…
技術方法： 本文提出的方法：To overcome this limitation, we propose VLA-Hijack, a unified adversarial framework that breaks the transferability bottleneck by exploiting a fundamental vulnerability identified in this work: before planning any motion, a VLA model must first use v

Key Takeaway: Extensive experiments across diverse architectures (OpenVLA, UniVLA, and CronusVLA) demonstrate that VLA-Hijack achieves superior optimization efficiency in white-box settings and sets a new SOTA for cross-architecture and cross-domain black-box transferability.
核心發現： 核心結果：Extensive experiments across diverse architectures (OpenVLA, UniVLA, and CronusVLA) demonstrate that VLA-Hijack achieves superior optimization efficiency in white-box settings and sets a new SOTA for

BOKBO (Best of K Bad Options): Calibrated Abstention for VLA Policies

Authors: Anya Singh, Cabrel Happi, Jai Relan et al. | Submitted: 2026-05-28 | arXiv: 2605.30660 Categories: cs.LG, cs.RO

Research Background: Test-time scaling for vision-language-action (VLA) policies, methods such as RoboMonkey, SEAL, MG-Select, and V-GPS, samples K candidate action chunks at inference and executes the verifier-best. When all K candidates are unsafe, the system executes a violating action with no warning.
研究背景： 在機器學習與機器人領域，Test-time scaling for vision-language-action (VLA) policies, methods such as RoboMonkey, SEAL, MG-Select, and V-GPS, samples K candidate action chunks at inference and executes the

Technical Approach: We propose BOKBO, the first conformal abstention layer for K-sample VLA inference, providing finite-sample distribution-free guarantees on executed-violation rate.
技術方法： 本文提出的方法：We propose BOKBO, the first conformal abstention layer for K-sample VLA inference, providing finite-sample distribution-free guarantees on executed-violation rate.

Key Takeaway: Results are stable across 5 training seeds, replicate within bootstrap noise on $π_{0}$ -FAST, hold on libero_spatial_temp_x0.1 as a co-equal benchmark, and survive four within-suite distribution shifts.
核心發現： 核心結果：Results are stable across 5 training seeds, replicate within bootstrap noise on $π_{0}$ -FAST, hold on libero_spatial_temp_x0.1 as a co-equal benchmark, and survive four within-suite distribution shifts.

ELAN4D: Embodiment-Centric 4D Supervision for Vision-Language-Action Models via Plug-and-Play Adaptation

Authors: Zeyuan He, Bowen Yang, Zhirui Fang et al. | Submitted: 2026-05-28 | arXiv: 2605.30484 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have shown promise for robotic manipulation, yet most existing policies operate reactively by directly regressing actions from current observations, without explicitly modeling future dynamics. This limits their ability to generalize under out-of-distribution perturbations.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models have shown promise for robotic manipulation, yet most existing policies operate reactively by directly regressing actions from current observati

Technical Approach: To address this issue, we propose ELAN4D, an embodiment-centric, 4D-aware training framework that enhances VLA policies with future robot keypoint tracks as predictive spatio-temporal supervision.
技術方法： 本文提出的方法：To address this issue, we propose ELAN4D, an embodiment-centric, 4D-aware training framework that enhances VLA policies with future robot keypoint tracks as predictive spatio-temporal supervision.

Key Takeaway: These results highlight the effectiveness of embodiment-centric 4D supervision for building more robust and generalizable manipulation policies.
核心發現： 核心結果：These results highlight the effectiveness of embodiment-centric 4D supervision for building more robust and generalizable manipulation policies.

Authors: Tri-Tin Nguyen, Tien-Dat Nguyen, Gia-Uy Le et al. | Submitted: 2026-05-28 | arXiv: 2605.30468 Categories: cs.RO

Research Background: This paper presents a learning-based navigation framework for indoor mobile robots. The proposed method combines a supervised neural global planner, trained from cost-aware A* expert trajectories, with the proposed Learning-Based DWA local planner, which is formulated as discrete candidate selection over the Dynamic Window Approach (DWA) action lattice.
研究背景： 在機器人學習領域，This paper presents a learning-based navigation framework for indoor mobile robots. The proposed method combines a supervised neural global planner, trained from cost-aware A* expe

Technical Approach: The framework is implemented and evaluated in both simulated and real-world indoor environments. Experimental results show that the proposed method generates feasible global routes and reliable local motion commands for safe goal-directed navigation in the presence of obstacles.
技術方法： 本文提出的方法：The framework is implemented and evaluated in both simulated and real-world indoor environments. Experimental results show that the proposed method generates feasible global routes and reliable local motion commands for safe goal-directed navigation

Key Takeaway: These results demonstrate the effectiveness of integrating learning-based global planning with reinforcement-learning-refined local control for indoor mobile robot navigation.
核心發現： 核心結果：These results demonstrate the effectiveness of integrating learning-based global planning with reinforcement-learning-refined local control for indoor mobile robot navigation.

Authors: Jusuk Lee, Seungjae Lee, Jonghun Shin et al. | Submitted: 2026-05-28 | arXiv: 2605.30350 Categories: cs.RO, cs.LG

Research Background: Robot manipulation critically depends on perception that preserves the action-relevant aspects of a scene. Yet most robot learning pipelines are built upon visual encoders pre-trained for static recognition or vision-language alignment, leaving motion understanding to downstream policies.
研究背景： 在機器人學習領域，Robot manipulation critically depends on perception that preserves the action-relevant aspects of a scene. Yet most robot learning pipelines are built upon visual encoders pre-trai

Technical Approach: We introduce DynaFLIP, a dynamics-aware multimodal pre-training framework that pushes motion understanding upstream into perception. Our key idea is to encourage the three modalities to span a small simplex volume in the shared hyperspherical space — a smaller simplex volume indicating stronger alignment.
技術方法： 本文提出的方法：We introduce DynaFLIP, a dynamics-aware multimodal pre-training framework that pushes motion understanding upstream into perception. Our key idea is to encourage the three modalities to span a small simplex volume in the shared hyperspherical space -

Key Takeaway: Our results suggest that robot generalization improves when visual representations are trained to encode not just what is present, but how the world changes under action.
核心發現： 核心結果：Our results suggest that robot generalization improves when visual representations are trained to encode not just what is present, but how the world changes under action.

RoboWits: Unexpected Challenges for Robotic Creative Problem Solving

Authors: Chunru Lin, Hongxin Zhang, Fenghao Yu et al. | Submitted: 2026-05-28 | arXiv: 2605.30326 Categories: cs.RO, cs.AI

Research Background: The ability to reason, adapt, and creatively solve problems under unexpected challenges is essential for robots operating in real-world environments. However, current robotic benchmarks primarily emphasize skill-level execution and provide limited insight into such cognitive reasoning capabilities.
研究背景： 在機器人學習領域，The ability to reason, adapt, and creatively solve problems under unexpected challenges is essential for robots operating in real-world environments. However, current robotic bench

Technical Approach: We introduce RoboWits, a bi-manual robotic benchmark designed to systematically evaluate cognitive reasoning, creative tool use, and robustness to unexpected conditions. To enable scalable construction of high-quality reasoning-centric unexpected scenarios, we propose an automated task generation pipeline formulated as a multi-agent cooperative framework, comprising agents for seed task generation and verification, metric generation, scene generation, and task mutation.
技術方法： 本文提出的方法：We introduce RoboWits, a bi-manual robotic benchmark designed to systematically evaluate cognitive reasoning, creative tool use, and robustness to unexpected conditions. To enable scalable construction of high-quality reasoning-centric unexpected sce

Key Takeaway: Our results reveal a significant performance gap: while pre-trained VLAs exhibit preliminary success on seed tasks after single-task fine-tuning, they struggle to perform on mutated tasks, implying their brittleness in manipulation tasks requiring reasoning, strategy adaptation, and robustness to…
核心發現： 核心結果：Our results reveal a significant performance gap: while pre-trained VLAs exhibit preliminary success on seed tasks after single-task fine-tuning, they struggle to perform on mutated tasks, implying th

Gaze2Act: Gaze-Conditioned Vision-Language-Action Policies for Interactive Robot Manipulation

Authors: Kuangji Zuo, Gen Li, Bofan Lyu et al. | Submitted: 2026-05-28 | arXiv: 2605.30282 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have recently shown strong potential for robot learning by following language instructions. However, in practice, language alone is often insufficient to precisely convey human intent.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models have recently shown strong potential for robot learning by following language instructions. However, in practice, language alone is often insuff

Technical Approach: To address this limitation, we propose Gaze2Act, a novel VLA framework that leverages human gaze as a dynamic and intuitive intent signal for complex interactive manipulation.
技術方法： 本文提出的方法：To address this limitation, we propose Gaze2Act, a novel VLA framework that leverages human gaze as a dynamic and intuitive intent signal for complex interactive manipulation.

Key Takeaway: These results demonstrate that human gaze provides a natural, low-burden, and highly expressive modality for human-in-the-loop VLA control.
核心發現： 核心結果：These results demonstrate that human gaze provides a natural, low-burden, and highly expressive modality for human-in-the-loop VLA control.

Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments

Authors: Qiuyue Wang, Mingsheng Li, Jian Guan et al. | Submitted: 2026-05-28 | arXiv: 2605.30280 Categories: cs.RO, cs.AI, cs.CL

Research Background: Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generalization across tasks, environments, and robot embodiments. In this work, we study whether heterogeneous embodied decision-making problems can be unified within a single vision-language-action model.
研究背景： 在機器人學習領域，Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generali

Technical Approach: In this work, we study whether heterogeneous embodied decision-making problems can be unified within a single vision-language-action model. We present Qwen-VLA, a unified embodied foundation model that extends Qwen’s vision-language modeling stack from perception, understanding, and reasoning to continuous action and trajectory generation through a DiT-based action decoder. To support multiple robot platforms, we introduce embodiment-aware prompt conditioning, where robot-specific textual des…
技術方法： 本文提出的方法：In this work, we study whether heterogeneous embodied decision-making problems can be unified within a single vision-language-action model. We present Qwen-VLA, a unified embodied foundation model that extends Qwen’s vision-language modeling stack fr

Key Takeaway: Qwen-VLA-Instruct achieves 97.9% on LIBERO, 73.7% on Simpler-WidowX, 86.1%/87.2% on RoboTwin-Easy/Hard, 69.0% OSR on R2R, 59.6% SR on RxR, 76.9% average OOD success in real-world ALOHA experiments, and 26.6% zero-shot success on DOMINO dynamic manipulation.
核心發現： 核心結果：Qwen-VLA-Instruct achieves 97.9% on LIBERO, 73.7% on Simpler-WidowX, 86.1%/87.2% on RoboTwin-Easy/Hard, 69.0% OSR on R2R, 59.6% SR on RxR, 76.9% average OOD success in real-world ALOHA experiments, an

BORA: Bridging Offline Reinforcement Learning and Online Residual Adaptation for Real-World Dexterous VLA Models

Authors: Zhongxi Chen, Yifan Han, Yanming Shao et al. | Submitted: 2026-05-28 | arXiv: 2605.30226 Categories: cs.RO, cs.AI

Research Background: Vision-Language-Action (VLA) models have emerged as a promising paradigm for grounding visual-language understanding into real-world robotic manipulation. However, dexterous manipulation remains challenging for VLA policies due to high-dimensional hand control and compounding execution errors, which makes real-world RL post-training essential for bridging the gap between visually grounded actio…
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models have emerged as a promising paradigm for grounding visual-language understanding into real-world robotic manipulation. However, dexterous manipu

Technical Approach: To address these challenges, we propose BORA, an offline-to-online RL post-training framework designed for real-world dexterous VLA models.
技術方法： 本文提出的方法：To address these challenges, we propose BORA, an offline-to-online RL post-training framework designed for real-world dexterous VLA models.

Key Takeaway: Extensive evaluations across five complex real-world dexterous tasks demonstrate that BORA significantly outperforms pure imitation learning and traditional decoupled RL baselines, achieving a 33% absolute increase in average success rate under standard settings and up to a 43% improvement in uns…
核心發現： 核心結果：Extensive evaluations across five complex real-world dexterous tasks demonstrate that BORA significantly outperforms pure imitation learning and traditional decoupled RL baselines, achieving a 33% abs

Sample-Efficient Diffusion-based Reinforcement Learning with Critic Guidance

Authors: Shutong Ding, Zejia Zhong, Zhongyi Wang et al. | Submitted: 2026-05-28 | arXiv: 2605.30056 Categories: cs.RO, cs.LG

Research Background: Recent advances in reinforcement learning (RL) have achieved great successes by leveraging the multimodality and exploration capability of diffusion policies. Among these approaches, one representative branch focuses on the sampling-based policy optimization.
研究背景： 在機器人學習領域，Recent advances in reinforcement learning (RL) have achieved great successes by leveraging the multimodality and exploration capability of diffusion policies. Among these approache

Technical Approach: To address this issue, we propose CGPO, \textbf{C}ritic-\textbf{G}uided diffusion \textbf{P}olicy \textbf{O}ptimization, which effectively balances exploration and exploitation with the training-free guidance technique integrated into the denoising process of diffusion policy.
技術方法： 本文提出的方法：To address this issue, we propose CGPO, \textbf{C}ritic-\textbf{G}uided diffusion \textbf{P}olicy \textbf{O}ptimization, which effectively balances exploration and exploitation with the training-free guidance technique integrated into the denoising p

Key Takeaway: Notably, CGPO is the first success to incorporate diffusion policy into real-world RL, with its superior performance on Franka robot arm grasping tasks.
核心發現： 核心結果：Notably, CGPO is the first success to incorporate diffusion policy into real-world RL, with its superior performance on Franka robot arm grasping tasks.

Fisher-Preserving Guidance: Training-Free Manifold Constraints for Safe Diffusion Control

Authors: Hao Ren, Zetong Bi, Yiming Zeng et al. | Submitted: 2026-05-28 | arXiv: 2605.29937 Categories: cs.RO, cs.LG

Research Background: Diffusion models are effective for waypoint prediction in visual navigation, but standard sampling and test time guidance can produce unreliable or inefficient trajectories when updates drift off the training manifold. We propose Fisher Preserving Guidance with Outer Product Span Projection, a training-free inference method that avoids large Fisher drift associated with off-distribution actions…
研究背景： 在機器人學習領域，Diffusion models are effective for waypoint prediction in visual navigation, but standard sampling and test time guidance can produce unreliable or inefficient trajectories when up

Technical Approach: We propose Fisher Preserving Guidance with Outer Product Span Projection, a training-free inference method that avoids large Fisher drift associated with off-distribution actions while optimizing a task objective. Our method computes the Fisher-preserving update via a low-rank Jacobian factorization, requiring only a single backward pass per step and enabling real-time use.
技術方法： 本文提出的方法：We propose Fisher Preserving Guidance with Outer Product Span Projection, a training-free inference method that avoids large Fisher drift associated with off-distribution actions while optimizing a task objective. Our method computes the Fisher-prese

Key Takeaway: Experiments on toy and realistic navigation benchmarks, including Maze2D with TSDF-based guidance, PushT with official Diffusion Policy weights, and visual navigation in simulation and on real robots, demonstrate consistent improvements in performance over strong diffusion-policy baselines withou…
核心發現： 核心結果：Experiments on toy and realistic navigation benchmarks, including Maze2D with TSDF-based guidance, PushT with official Diffusion Policy weights, and visual navigation in simulation and on real robots,

MARS Policy: Multimodality Only When It Matters

Authors: Jindou Jia, Tuo An, Yuxuan Hu et al. | Submitted: 2026-05-28 | arXiv: 2605.29766 Categories: cs.RO

Research Background: Imitation learning has become a cornerstone for solving complex robotic manipulation tasks. In particular, multimodality, which enables robots to capture diverse yet valid behavioral patterns, has driven the rapid emergence of generative policies as a dominant paradigm in robot learning.
研究背景： 在機器人學習領域，Imitation learning has become a cornerstone for solving complex robotic manipulation tasks. In particular, multimodality, which enables robots to capture diverse yet valid behavior

Technical Approach: Motivated by this insight, we propose the Modality-Adaptive Robot Sampling (MARS) policy, which adaptively invokes tailored stochasticity only when it is truly beneficial, while reverting to an efficient deterministic learning during single-modal phases.
技術方法： 本文提出的方法：Motivated by this insight, we propose the Modality-Adaptive Robot Sampling (MARS) policy, which adaptively invokes tailored stochasticity only when it is truly beneficial, while reverting to an efficient deterministic learning during single-modal pha

Key Takeaway: Empirical studies across 8 simulated and 4 real-world tasks demonstrate that MARS exhibits robust multimodal expressivity and high efficiency, with a 16.67% success rate improvement and an 83.20% inference latency reduction in real-world tests.
核心發現： 核心結果：Empirical studies across 8 simulated and 4 real-world tasks demonstrate that MARS exhibits robust multimodal expressivity and high efficiency, with a 16.67% success rate improvement and an 83.20% infe

PhAIL: A Real-Robot VLA Benchmark and Distributional Methodology

Authors: Sergey Arkhangelskiy | Submitted: 2026-05-28 | arXiv: 2605.29710 Categories: cs.RO

Research Background: Real-world evaluation of vision-language-action (VLA) policies still rests on binary success rate at a fixed timeout with $N \leq 25$ rollouts per condition, almost always without confidence intervals or paired statistical comparison; these cohort sizes struggle to resolve close comparisons reliably. We introduce PhAIL (Physical AI Leaderboard, https://phail.ai), an open real-robot benchmark on …
研究背景： 在機器人學習領域，Real-world evaluation of vision-language-action (VLA) policies still rests on binary success rate at a fixed timeout with $N \leq 25$ rollouts per condition, almost always without c

Technical Approach: We introduce PhAIL (Physical AI Leaderboard, https://phail.ai), an open real-robot benchmark on a Franka FR3 (dataset, per-rollout artifacts, and end-to-end reference implementation) of a distributional evaluation methodology: the time-to-success cumulative distribution function (CDF) as the evaluation primitive, with two separated jobs.
技術方法： 本文提出的方法：We introduce PhAIL (Physical AI Leaderboard, https://phail.ai), an open real-robot benchmark on a Franka FR3 (dataset, per-rollout artifacts, and end-to-end reference implementation) of a distributional evaluation methodology: the time-to-success cum

Key Takeaway: The best evaluated VLA is $\sim 7 \times$ slower per operation (RMST ratio) than the human reference.
核心發現： 核心結果：The best evaluated VLA is $\sim 7 \times$ slower per operation (RMST ratio) than the human reference.

VLAConf: Calibrated Task-Success Confidence for Vision-Language-Action Models

Authors: Dehao Huang, Aoxiang Gu, Chengjie Zhang et al. | Submitted: 2026-05-28 | arXiv: 2605.29605 Categories: cs.RO

Research Background: Confidence estimation for Vision-Language-Action (VLA) models is essential for robots to perform manipulation tasks in the open world, providing crucial signals for risk-sensitive decision-making and failure anticipation. Existing confidence estimation methods typically rely on ensemble-based paradigms or action-token probabilities to predict the likelihood of task success.
研究背景： 在機器人學習領域，Confidence estimation for Vision-Language-Action (VLA) models is essential for robots to perform manipulation tasks in the open world, providing crucial signals for risk-sensitive

Technical Approach: To address this issue, we propose VLAConf, a one-class discriminative confidence framework.
技術方法： 本文提出的方法：To address this issue, we propose VLAConf, a one-class discriminative confidence framework.

Key Takeaway: Experiments on the LIBERO benchmark demonstrate that VLAConf significantly improves the quality of the confidence signal constructed for post-hoc calibration, outperforming existing baselines by a large margin in inference efficiency.
核心發現： 核心結果：Experiments on the LIBERO benchmark demonstrate that VLAConf significantly improves the quality of the confidence signal constructed for post-hoc calibration, outperforming existing baselines by a lar

VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Models

Authors: Shengyu Si, Yuanzhuo Lu, Ruimeng Yang et al. | Submitted: 2026-05-28 | arXiv: 2605.29562 Categories: cs.RO, cs.AI, cs.CV

Research Background: Vision-Language-Action~(VLA) models have shown strong potential for general-purpose robotic manipulation, yet they still struggle to generalize to unseen tasks that necessitate transferring relevant experience across objects, scenes, and action patterns. This paper proposes VLA-Pro, a plug-and-play framework designed to enhance cross-task generalization by storing task-relevant procedural memor…
研究背景： 在機器人學習領域，Vision-Language-Action~(VLA) models have shown strong potential for general-purpose robotic manipulation, yet they still struggle to generalize to unseen tasks that necessitate tra

Technical Approach: This paper proposes VLA-Pro, a plug-and-play framework designed to enhance cross-task generalization by storing task-relevant procedural memories at training time and transferring these memories during inference. These results suggest that procedural memory retrieval and adaptation provide an effective mechanism for transferring manipulation experience to novel tasks while preserving modularity and execution stability.
技術方法： 本文提出的方法：This paper proposes VLA-Pro, a plug-and-play framework designed to enhance cross-task generalization by storing task-relevant procedural memories at training time and transferring these memories during inference. These results suggest that procedural

Key Takeaway: These results suggest that procedural memory retrieval and adaptation provide an effective mechanism for transferring manipulation experience to novel tasks while preserving modularity and execution stability.
核心發現： 核心結果：These results suggest that procedural memory retrieval and adaptation provide an effective mechanism for transferring manipulation experience to novel tasks while preserving modularity and execution s

ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models

Authors: Ye Li, Huanan Liu, Kangye Ji et al. | Submitted: 2026-05-28 | arXiv: 2605.29438 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models are a powerful paradigm for generalist robotic control. However, their high computational cost and limited control frequency hinder real-time robotic manipulation, especially when large vision-language backbones and iterative action heads run at every control step.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models are a powerful paradigm for generalist robotic control. However, their high computational cost and limited control frequency hinder real-time ro

Technical Approach: We propose ElegantVLA, a plug-in phase-adaptive inference framework that accelerates VLA models through intra-model dynamic compute scheduling.
技術方法： 本文提出的方法：We propose ElegantVLA, a plug-in phase-adaptive inference framework that accelerates VLA models through intra-model dynamic compute scheduling.

Key Takeaway: Experiments on GR00T and CogACT achieve up to 2.55x and 3.77x speedup, and on six real-world GR00T tasks ElegantVLA cuts computation by 2.18x while raising control frequency from 13.8 Hz to 26.3 Hz.
核心發現： 核心結果：Experiments on GR00T and CogACT achieve up to 2.55x and 3.77x speedup, and on six real-world GR00T tasks ElegantVLA cuts computation by 2.18x while raising control frequency from 13.8 Hz to 26.3 Hz.

3DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding

Authors: Zhongyu Xia, Yousen Tang, Bingqing Wei et al. | Submitted: 2026-05-28 | arXiv: 2605.29416 Categories: cs.RO, cs.CV

Research Background: Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak extraction of 3D spatial positions without enforcing multi-view consistency, inadequate 3D instance understanding, and fragile reasoning under occlusion.
研究背景： 在機器人學習領域，Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficien

Technical Approach: To address the above challenges, we propose 3DVLA, a plug-and-play framework that injects robust 3D reasoning into pretrained VLAs without requiring extra manual labels or discarding VLM priors. Results show consistent and significant gains in manipulation performance, validating both the effectiveness and plug-and-play compatibility of our approach.
技術方法： 本文提出的方法：To address the above challenges, we propose 3DVLA, a plug-and-play framework that injects robust 3D reasoning into pretrained VLAs without requiring extra manual labels or discarding VLM priors. Results show consistent and significant gains in manipu

Key Takeaway: Results show consistent and significant gains in manipulation performance, validating both the effectiveness and plug-and-play compatibility of our approach.
核心發現： 核心結果：Results show consistent and significant gains in manipulation performance, validating both the effectiveness and plug-and-play compatibility of our approach.

Phase-Conditioned Imitation Learning with Autonomous Failure Recovery for Robust Deformable Object Manipulation

Authors: Dayuan Chen, Kai Tang, Yukuan Zhang et al. | Submitted: 2026-05-28 | arXiv: 2605.29407 Categories: cs.RO

Research Background: This paper presents a phase-conditioned, force-aware framework for robust deformable object manipulation. Standard imitation learning policies such as Action Chunking with Transformers (ACT) rely on a Markovian assumption at inference, causing state aliasing when visually similar observations require contradictory actions and preventing autonomous recovery from execution failures.
研究背景： 在機器人學習領域，This paper presents a phase-conditioned, force-aware framework for robust deformable object manipulation. Standard imitation learning policies such as Action Chunking with Transfor

Technical Approach: A multi-modal phase predictor fusing visual, force, and pose feedback estimates the phase in real time, detecting contact failures that are invisible to vision alone and autonomously triggering recovery trajectories. The system is completed by a hybrid impedance controller for compliant execution and a haptic teleoperation interface for force-aware data collection.
技術方法： 本文提出的方法：A multi-modal phase predictor fusing visual, force, and pose feedback estimates the phase in real time, detecting contact failures that are invisible to vision alone and autonomously triggering recovery trajectories. The system is completed by a hybr

Key Takeaway: Validated on hanging and removing a T-shirt with dual arms, the closed-loop system improves the hanging success rate from 56% to 87% through autonomous error recovery.
核心發現： 核心結果：Validated on hanging and removing a T-shirt with dual arms, the closed-loop system improves the hanging success rate from 56% to 87% through autonomous error recovery.

VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies

Authors: Mingjian Gao, Wenqiao Zhang, Yuqian Yuan et al. | Submitted: 2026-05-28 | arXiv: 2605.30011 Categories: cs.CV, cs.AI

Research Background: Recent work has begun to equip vision-language-action (VLA) policies with explicit intermediate reasoning. In embodied control, however, textual chain-of-thought is a poor fit: irrelevant or weakly textual information can interfere with action prediction, while autoregressive text decoding adds too much latency for real-time closed-loop execution.
研究背景： 在電腦視覺與機器人領域，Recent work has begun to equip vision-language-action (VLA) policies with explicit intermediate reasoning. In embodied control, however, textual chain-of-thought is a poor fit: irr

Technical Approach: We present VISUALTHINK-VLA, a visual intermediate-reasoning framework for accurate, low-latency VLA policies.
技術方法： 本文提出的方法：We present VISUALTHINK-VLA, a visual intermediate-reasoning framework for accurate, low-latency VLA policies.

Key Takeaway: For example, on BridgeData V2, it reduces step latency from 8.377,s with ECoT to 0.367,s, achieving a 22.8 times speedup.
核心發現： 核心結果：For example, on BridgeData V2, it reduces step latency from 8.377,s with ECoT to 0.367,s, achieving a 22.8 times speedup.

SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation

Authors: Shilin Ma, Chubin Zhang, Changyuan Wang et al. | Submitted: 2026-05-28 | arXiv: 2605.29662 Categories: cs.CV

Research Background: Real-time inference of vision-language-action (VLA) models is essential for robotic control. While visual token pruning has shown strong potential for accelerating inference, most existing methods mainly base pruning decisions on shallow-layer cues and risk discarding visual information required by deep layers.
研究背景： 在電腦視覺與機器人領域，Real-time inference of vision-language-action (VLA) models is essential for robotic control. While visual token pruning has shown strong potential for accelerating inference, most

Technical Approach: To address this issue, we propose SAFE-Pruner, a plug-and-play pruning framework that incorporates attention cues of future layers into pruning decisions. Based on this observation, we design a forward-looking strategy to forecast the token saliency in deep layers, which prevents the premature removal of critical tokens and leads to more stable acceleration. Extensive experiments in simulation and real-world settings demonstrate that our method achieves up to 1.89x speedup with a minimal degr…
技術方法： 本文提出的方法：To address this issue, we propose SAFE-Pruner, a plug-and-play pruning framework that incorporates attention cues of future layers into pruning decisions. Based on this observation, we design a forward-looking strategy to forecast the token saliency

Key Takeaway: Extensive experiments in simulation and real-world settings demonstrate that our method achieves up to 1.89x speedup with a minimal degradation in success rate of less than 1.7%, while outperforming state-of-the-art methods by up to 1.9%.
核心發現： 核心結果：Extensive experiments in simulation and real-world settings demonstrate that our method achieves up to 1.89x speedup with a minimal degradation in success rate of less than 1.7%, while outperforming s

Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning

Authors: Kyujin Lee, Injae Kim, Jihwan Park et al. | Submitted: 2026-05-28 | arXiv: 2605.29577 Categories: cs.CV

Research Background: Vision-Language-Action (VLA) models have emerged as a promising framework that unifies perception, reasoning, and control for robot manipulation by adapting pretrained vision-language models (VLMs) to action prediction. However, VLM-derived representations are often insensitive to subtle visual distinctions required for low-level control, causing state aliasing between visually similar states t…
研究背景： 在電腦視覺與機器人領域，Vision-Language-Action (VLA) models have emerged as a promising framework that unifies perception, reasoning, and control for robot manipulation by adapting pretrained vision-langu

Technical Approach: To mitigate state aliasing, we introduce inverse dynamics learning as an auxiliary objective that directly supervises the VLA vision encoder. Our method applies to diverse VLA baselines, uses only standard observation-action pairs without additional annotations, and preserves the original inference pipeline at test time. Frozen-encoder probing and state-feature alignment analyses further show that our method learns state-discriminative visual representations that reduce state aliasing and bet…
技術方法： 本文提出的方法：To mitigate state aliasing, we introduce inverse dynamics learning as an auxiliary objective that directly supervises the VLA vision encoder. Our method applies to diverse VLA baselines, uses only standard observation-action pairs without additional

Key Takeaway: Frozen-encoder probing and state-feature alignment analyses further show that our method learns state-discriminative visual representations that reduce state aliasing and better align with robot state changes.
核心發現： 核心結果：Frozen-encoder probing and state-feature alignment analyses further show that our method learns state-discriminative visual representations that reduce state aliasing and better align with robot state

Behavior Cloning of MPC for 3-DOF Robotic Manipulators

Authors: Theo Guegan, Dexter Wen Jie Teo | Submitted: 2026-05-29 | arXiv: 2606.00383 Categories: cs.RO, cs.LG, eess.SY

Research Background: While Model Predictive Control (MPC) provides strong stability and robustness, it imposes a significant computational burden on real-time systems. This paper investigates the application of Behavior Cloning to approximate MPC policies for the real-time control of a 3-degree-of-freedom robotic manipulator.
研究背景： 在機器人學習領域，While Model Predictive Control (MPC) provides strong stability and robustness, it imposes a significant computational burden on real-time systems. This paper investigates the appli

Technical Approach: This paper investigates the application of Behavior Cloning to approximate MPC policies for the real-time control of a 3-degree-of-freedom robotic manipulator. We present a baseline controller combining Inverse Kinematics with MPC and evaluate neural network architectures, ranging from classical regression algorithms to deep learning models including Deep MLPs and RNNs, to derive computationally efficient surrogate policies.
技術方法： 本文提出的方法：This paper investigates the application of Behavior Cloning to approximate MPC policies for the real-time control of a 3-degree-of-freedom robotic manipulator. We present a baseline controller combining Inverse Kinematics with MPC and evaluate neural

Key Takeaway: Notably, we find that static architectures outperform temporal variants, confirming the sufficiency of instantaneous state observations for this task.
核心發現： 核心結果：Notably, we find that static architectures outperform temporal variants, confirming the sufficiency of instantaneous state observations for this task.

Per-Group Error, Not Total MSE: Fine-Tuning Vision-Language-Action Models for 11-DoF Mobile Manipulation

Authors: Pau Montagut Bofi, Mario García Blasco, Tessa Pulli et al. | Submitted: 2026-05-29 | arXiv: 2606.00253 Categories: cs.RO, cs.LG

Research Background: Fine-tuning Vision-Language-Action (VLA) models for mobile manipulators with heterogeneous joint spaces can produce a counterintuitive result: the checkpoint with the lowest aggregate MSE is not the one that performs best on the real robot. We argue this is a predictable consequence of collapsing heterogeneous joint groups (arm, gripper, head, wheeled base) into a single metric, where easy-to-p…
研究背景： 在機器人學習領域，Fine-tuning Vision-Language-Action (VLA) models for mobile manipulators with heterogeneous joint spaces can produce a counterintuitive result: the checkpoint with the lowest aggreg

Technical Approach: In expert-only fine-tuning of $π_{0.5}$ (training only the action head, backbone frozen), total MSE drops below the baseline but arm accuracy degrades. On 60 real-robot trials (20 per model), $π_{0.5}$ 80k (4.0/4) significantly outperforms both fine-tuned variants (expert-only 3k: 3.75/4; HSR-SmolVLA: 3.5/4; Mann-Whitney $p \leq 0.010$ ), despite expert-only 3k having the lowest total MSE.
技術方法： 本文提出的方法：In expert-only fine-tuning of $π_{0.5}$ (training only the action head, backbone frozen), total MSE drops below the baseline but arm accuracy degrades. On 60 real-robot trials (20 per model), $π_{0.5}$ 80k (4.0/4) significantly outperforms both fine-

Key Takeaway: On 60 real-robot trials (20 per model), $π_{0.5}$ 80k (4.0/4) significantly outperforms both fine-tuned variants (expert-only 3k: 3.75/4; HSR-SmolVLA: 3.5/4; Mann-Whitney $p \leq 0.010$ ), despite expert-only 3k having the lowest total MSE.
核心發現： 核心結果：On 60 real-robot trials (20 per model), $π_{0.5}$ 80k (4.0/4) significantly outperforms both fine-tuned variants (expert-only 3k: 3.75/4; HSR-SmolVLA: 3.5/4; Mann-Whitney $p \leq 0.010$ ), despite expe

HOIST: Humanoid Optimization with Imitation and Sample-efficient Tuning for Manipulating Suspended Loads

Authors: Songyang Liu, Shunyu Yao, Dingyuan Huang et al. | Submitted: 2026-05-29 | arXiv: 2606.00252 Categories: cs.RO, cs.LG

Research Background: Manipulating suspended payloads with humanoid robots is challenging because the robot can only influence an underactuated, oscillatory load through whole-body motion and intermittent contact. Imitation learning provides safe initial behavior but does not directly optimize final placement, while reinforcement learning from scratch is unsafe and sample-inefficient on real humanoids.
研究背景： 在機器人學習領域，Manipulating suspended payloads with humanoid robots is challenging because the robot can only influence an underactuated, oscillatory load through whole-body motion and intermitte

Technical Approach: We present HOIST-Humanoid Optimized with Imitation and Sample-efficient Tuning for manipulating suspended loads.
技術方法： 本文提出的方法：We present HOIST-Humanoid Optimized with Imitation and Sample-efficient Tuning for manipulating suspended loads.

Key Takeaway: Experiments in simulation and on a real humanoid show that HOIST improves over imitation-only and additional-demonstration baselines; compared with pure VLA rollouts, HOIST reduces translational placement error by 19.9 cm and raw angular error by 3.56 degrees, demonstrating the potential of human…
核心發現： 核心結果：Experiments in simulation and on a real humanoid show that HOIST improves over imitation-only and additional-demonstration baselines; compared with pure VLA rollouts, HOIST reduces translational place

Continuous Reasoning for Vision-Language-Action

Authors: Yueh-Hua Wu, Tatsuya Matsushima, Kei Ota | Submitted: 2026-05-29 | arXiv: 2606.00229 Categories: cs.RO, cs.AI, cs.LG

Research Background: Natural language is a powerful reasoning medium for language and vision-language models, but it is mismatched to the granularity of continuous control. Text and explicit subgoals operate at task-level granularity, whereas vision-language-action (VLA) policies must choose actions at a much finer temporal scale; a single reasoning step can therefore span many action chunks while remaining only we…
研究背景： 在機器人學習領域，Natural language is a powerful reasoning medium for language and vision-language models, but it is mismatched to the granularity of continuous control. Text and explicit subgoals o

Technical Approach: Based on this view, we propose Continuous Reasoning for Vision-Language-Action. Our model first predicts continuous reasoning in the form of a structured set of continuous thoughts, then reuses them as shared context for chunk-structured action generation.
技術方法： 本文提出的方法：Based on this view, we propose Continuous Reasoning for Vision-Language-Action. Our model first predicts continuous reasoning in the form of a structured set of continuous thoughts, then reuses them as shared context for chunk-structured action gener

Key Takeaway: Empirically, Continuous Reasoning improves LIBERO-PRO robustness and performs strongly on real robots, raising mean subtask success over π0.5 by 40.4% on TX-G2, an AgiBot G2-compatible variant, and 26.3% on HSR.
核心發現： 核心結果：Empirically, Continuous Reasoning improves LIBERO-PRO robustness and performs strongly on real robots, raising mean subtask success over π0.5 by 40.4% on TX-G2, an AgiBot G2-compatible variant, and 26

Surface Constraint Policy for Learning Surface-Constrained and Dynamically Feasible Robot Skills

Authors: Shuai Ke, Jiexin Zhang, Huan Zhao et al. | Submitted: 2026-05-29 | arXiv: 2605.31321 Categories: cs.RO

Research Background: Diffusion-based imitation learning methods have driven rapid progress in robot dexterous manipulation tasks. However, they have limitations when applied to tasks that involve complex free-form surface constraints because of their lack of explicit surface geometry constraint modeling and the dynamic feasibility issue, resulting in stochastic action generation that fails to achieve reliable surfa…
研究背景： 在機器人學習領域，Diffusion-based imitation learning methods have driven rapid progress in robot dexterous manipulation tasks. However, they have limitations when applied to tasks that involve compl

Technical Approach: To address these limitations, we propose a novel surface constraint policy (SCP) for generating robot actions that satisfy free-form surface constraints on the basis of human demonstrations and real-time visual observations.
技術方法： 本文提出的方法：To address these limitations, we propose a novel surface constraint policy (SCP) for generating robot actions that satisfy free-form surface constraints on the basis of human demonstrations and real-time visual observations.

Key Takeaway: The experimental results demonstrate superior task success rates and contact stability under surface constraints.
核心發現： 核心結果：The experimental results demonstrate superior task success rates and contact stability under surface constraints.

DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulation

Authors: Taiyi Su, Jian Zhu, Tianjian Wang et al. | Submitted: 2026-05-29 | arXiv: 2605.31286 Categories: cs.RO, cs.AI

Research Background: Real-world household robots require Vision-Language-Action (VLA) foundation models that can acquire reusable manipulation skills across diverse objects, task conditions, and household environments. Deformable-object folding is a representative challenge, requiring robots to handle clothing items from random initial states across varying categories, geometries, materials, and scenes.
研究背景： 在機器人學習領域，Real-world household robots require Vision-Language-Action (VLA) foundation models that can acquire reusable manipulation skills across diverse objects, task conditions, and househ

Technical Approach: To move beyond category-specific folding policies, we introduce DeMaVLA, a VLA foundation model for generalizable Deformable Manipulation.
技術方法： 本文提出的方法：To move beyond category-specific folding policies, we introduce DeMaVLA, a VLA foundation model for generalizable Deformable Manipulation.

Key Takeaway: These results highlight the value of scalable real-world data, efficient action generation, and corrective learning for general-purpose VLA policies in deformable-object manipulation.
核心發現： 核心結果：These results highlight the value of scalable real-world data, efficient action generation, and corrective learning for general-purpose VLA policies in deformable-object manipulation.

HARP-VLA: Human-Robot Aligned Representation Learning for Vision-Language-Action Model

Authors: Xiang Zhu, Puzhen Yuan, Yichen Liu et al. | Submitted: 2026-05-29 | arXiv: 2605.31234 Categories: cs.RO

Research Background: Learning generalizable vision-language-action (VLA) models from large-scale human videos is promising but challenging due to cross-embodiment discrepancies in both visual observations and executable actions. While latent action models reduce the action execution gap by learning action abstractions, they still rely on visual features.
研究背景： 在機器人學習領域，Learning generalizable vision-language-action (VLA) models from large-scale human videos is promising but challenging due to cross-embodiment discrepancies in both visual observati

Technical Approach: To address this, we propose HARP, a human-robot aligned representation learning framework for more effective VLA pretraining from human videos.
技術方法： 本文提出的方法：To address this, we propose HARP, a human-robot aligned representation learning framework for more effective VLA pretraining from human videos.

Key Takeaway: Experiments on feature visualization, simulation, and realworld manipulation show improved human-robot alignment and downstream policy performance, achieving 4.481 average length on CALVIN ABC $\to$ D and a 7.1% realworld success rate gain over the strongest baseline.
核心發現： 核心結果：Experiments on feature visualization, simulation, and realworld manipulation show improved human-robot alignment and downstream policy performance, achieving 4.481 average length on CALVIN ABC$\righta

Can Aerial VLA Models Cooperate? Evaluating Closed-Loop Air-Ground Coordination with CARLA-Air

Authors: Tianle Zeng, Yanci Wen, Xueang Yu et al. | Submitted: 2026-05-29 | arXiv: 2605.31066 Categories: cs.RO

Research Background: Recent aerial vision-language-action (VLA) models show promising single-UAV capabilities, such as tracking moving objects and navigating to language-specified landmarks. However, it remains unclear whether these capabilities can transfer to air-ground cooperation, where a UAV and a UGV must act jointly in a shared, closed-loop physical world.
研究背景： 在機器人學習領域，Recent aerial vision-language-action (VLA) models show promising single-UAV capabilities, such as tracking moving objects and navigating to language-specified landmarks. However, i

Technical Approach: Using CARLA-Air, we evaluate representative aerial VLA and planning baselines on two complementary diagnostic tasks: moving-platform landing and occlusion-recovery escort. The results show that current aerial VLA models can often track or follow a ground partner, but struggle to convert this single-agent competence into stable cooperative behavior.
技術方法： 本文提出的方法：Using CARLA-Air, we evaluate representative aerial VLA and planning baselines on two complementary diagnostic tasks: moving-platform landing and occlusion-recovery escort. The results show that current aerial VLA models can often track or follow a gr

Key Takeaway: State prompting provides limited benefit, and naive bidirectional interaction fails to consistently improve performance and can amplify errors for most baselines.
核心發現： 核心結果：State prompting provides limited benefit, and naive bidirectional interaction fails to consistently improve performance and can amplify errors for most baselines.

A study on a Real-Time VR-Based Teleoperation Framework for Manipulator in Dynamic Environment

Authors: InGyu Choi, GeonYeong Go, SunWoo Ahn et al. | Submitted: 2026-05-29 | arXiv: 2605.30989 Categories: cs.RO

Research Background: Robot teleoperation enables safe, non-contact task execution in hazardous environments where direct human access is difficult, and its application has expanded with recent VR technologies. Many VR teleoperation studies, however, have primarily served as data-collection tools for robot imitation learning, so they often do not explicitly address dynamic obstacles, workspace changes, or collision …
研究背景： 在機器人學習領域，Robot teleoperation enables safe, non-contact task execution in hazardous environments where direct human access is difficult, and its application has expanded with recent VR techn

Technical Approach: This paper presents a VR teleoperation framework that supports real-time manipulation while handling collisions with both static and moving obstacles.
技術方法： 本文提出的方法：This paper presents a VR teleoperation framework that supports real-time manipulation while handling collisions with both static and moving obstacles.

Key Takeaway: The results indicate that the proposed approach generates motion consistent with the operator’s command while producing safe detours when obstacles interfere with the commanded path.
核心發現： 核心結果：The results indicate that the proposed approach generates motion consistent with the operator’s command while producing safe detours when obstacles interfere with the commanded path.

RDGen: Demonstration Generation for High-Quality Robot Learning via Reinforcement Learning

Authors: Zijian Zhu, Menglin Zou, Zhuang Li et al. | Submitted: 2026-05-29 | arXiv: 2605.30957 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robot control. However, their performance remains fundamentally constrained by the availability of high-quality robot trajectory data.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robot control. However, their performance remains fundamentally constrained by the avai

Technical Approach: In this paper, we propose RDGen, a sim-to-real reinforcement learning framework for generating high-quality robot demonstrations.
技術方法： 本文提出的方法：In this paper, we propose RDGen, a sim-to-real reinforcement learning framework for generating high-quality robot demonstrations.

Key Takeaway: These results indicate that RL-generated demonstrations can serve as more reliable and consistent supervisory signals for robot policy learning.
核心發現： 核心結果：These results indicate that RL-generated demonstrations can serve as more reliable and consistent supervisory signals for robot policy learning.

Wall-OSS-0.5 Technical Report

Authors: Ryan Yu, Pushi Zhang, Starrick Liu et al. | Submitted: 2026-05-29 | arXiv: 2605.30877 Categories: cs.RO

Research Background: Large-scale Vision-Language-Action (VLA) pretraining is increasingly adopted as the foundation for robot policies, yet the evidence for pretrained VLAs is almost invariably reported after task-specific fine-tuning. This leaves a foundational question unanswered: does VLA pretraining itself yield executable robot behavior, or does it merely furnish a better initialization for downstream policy l…
研究背景： 在機器人學習領域，Large-scale Vision-Language-Action (VLA) pretraining is increasingly adopted as the foundation for robot policies, yet the evidence for pretrained VLAs is almost invariably reporte

Technical Approach: We present Wall-OSS-0.5, an open-source 4B VLA built upon a 3B VLM backbone augmented with action-generation components, designed so that pretrained robotic capability is directly measurable on physical hardware.
技術方法： 本文提出的方法：We present Wall-OSS-0.5, an open-source 4B VLA built upon a 3B VLM backbone augmented with action-generation components, designed so that pretrained robotic capability is directly measurable on physical hardware.

Key Takeaway: Together, these results reposition VLA pretraining from an initialization strategy to a directly testable, already useful source of robot capability.
核心發現： 核心結果：Together, these results reposition VLA pretraining from an initialization strategy to a directly testable, already useful source of robot capability.

Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoring

Authors: Seongheon Park, Wendi Li, Changdae Oh et al. | Submitted: 2026-05-29 | arXiv: 2605.30834 Categories: cs.RO, cs.AI

Research Background: Vision-Language-Action (VLA) models enable robots to follow natural language instructions and generalize across diverse tasks, but they remain vulnerable to execution failures that compromise reliability in real-world deployment. Detecting such failures during execution is therefore critical for the robust deployment of embodied systems.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models enable robots to follow natural language instructions and generalize across diverse tasks, but they remain vulnerable to execution failures that

Technical Approach: In this paper, we propose \textbf{Hide-and-Seek}, a framework that formulates VLA failure detection as a coarsely supervised learning problem. We evaluate Hide-and-Seek on LIBERO, VLABench, and a real-world robotic platform across three representative VLA policies: OpenVLA, $π_{0}$ , and $π_{0.5}$ .Our method achieves state-of-the-art multi-task failure detection performance with a practical accuracy—timeliness trade-off under conformal prediction, and generalizes well to both seen and unseen ta…
技術方法： 本文提出的方法：In this paper, we propose \textbf{Hide-and-Seek}, a framework that formulates VLA failure detection as a coarsely supervised learning problem. We evaluate Hide-and-Seek on LIBERO, VLABench, and a real-world robotic platform across three representativ

Key Takeaway: We evaluate Hide-and-Seek on LIBERO, VLABench, and a real-world robotic platform across three representative VLA policies: OpenVLA, $π_{0}$ , and $π_{0.5}$ .Our method achieves state-of-the-art multi-task failure detection performance with a practical accuracy—timeliness trade-off under conformal pr…
核心發現： 核心結果：We evaluate Hide-and-Seek on LIBERO, VLABench, and a real-world robotic platform across three representative VLA policies: OpenVLA, $π_{0}$ , and $π_{0.5}$ .Our method achieves state-of-the-art multi-task

Feat2Go: Visual Feature-Grounded Value Estimation for Embodied Reinforcement Learning

Authors: Junyang Shu, Zhiwei Lin, Bingqing Wei et al. | Submitted: 2026-05-29 | arXiv: 2605.30795 Categories: cs.RO

Research Background: Reinforcement learning is a promising approach for improving the capabilities of vision-language-action (VLA) models while avoiding the heavy data requirements of imitation learning. However, its effectiveness for VLA models is often constrained by sparse supervision and the difficulty of designing informative reward signals for long-horizon manipulation.
研究背景： 在機器人學習領域，Reinforcement learning is a promising approach for improving the capabilities of vision-language-action (VLA) models while avoiding the heavy data requirements of imitation learnin

Technical Approach: In this work, we present Feat2Go, a fine-grained value estimation framework for embodied reinforcement learning.
技術方法： 本文提出的方法：In this work, we present Feat2Go, a fine-grained value estimation framework for embodied reinforcement learning.

Key Takeaway: On RoboTwin 2.0, Feat2Go achieves an average success rate of 88.8% in domain-randomized task settings, outperforming prior reinforcement learning methods.
核心發現： 核心結果：On RoboTwin 2.0, Feat2Go achieves an average success rate of 88.8% in domain-randomized task settings, outperforming prior reinforcement learning methods.

Completion at the Boundary (CaB): Deployable Switching with Completion-Aware Control under Limited Calibration

Authors: Yusuke Sano, Takeshi Itoga | Submitted: 2026-05-29 | arXiv: 2606.00145 Categories: cs.RO, cs.AI

Research Background: Vision-language-action (VLA) agents can execute natural-language instructions, yet deployed systems still lack an operational interface: deciding when the instruction is complete. This gap is acute in short composites (“do A, then B”), where mistimed handoffs cascade into downstream failures.
研究背景： 在機器人學習領域，Vision-language-action (VLA) agents can execute natural-language instructions, yet deployed systems still lack an operational interface: deciding when the instruction is complete.

Technical Approach: We propose Completion at the Boundary (CaB), which predicts an event-local completion object in the form of Boundary-Phase Tokens (Before/Hit/After), retaining two-sided boundary evidence under this discipline.
技術方法： 本文提出的方法：We propose Completion at the Boundary (CaB), which predicts an event-local completion object in the form of Boundary-Phase Tokens (Before/Hit/After), retaining two-sided boundary evidence under this discipline.

Key Takeaway: Using an intervention-aware E1/E2 protocol, we show that CaB improves composite execution and handoff quality on a first-person Minecraft VLA benchmark under matched capacity and deployability constraints.
核心發現： 核心結果：Using an intervention-aware E1/E2 protocol, we show that CaB improves composite execution and handoff quality on a first-person Minecraft VLA benchmark under matched capacity and deployability constra

Primitive Subspaces Mediate Few-Shot Transfer in VLAs

Authors: Anya Singh, Cabrel Happi, Jai Relan et al. | Submitted: 2026-05-29 | arXiv: 2605.30695 Categories: cs.RO

Research Background: Deploying vision-language-action (VLA) policies in industrial environments requires the ability to teach new tasks at low cost, a property current VLAs lack, since each new task requires fine-tuning. We investigate whether primitive-aware training produces a transferable artifact: a learned library of sub-skills that can be composed at inference time, conditioned on a small number of demonstrat…
研究背景： 在機器人學習領域，Deploying vision-language-action (VLA) policies in industrial environments requires the ability to teach new tasks at low cost, a property current VLAs lack, since each new task re

Technical Approach: We replicate across three training seeds and validate on a second dataset (LIBERO-Long). Primitive-trained models reach 78% of fine-tuned upper-bound performance with only m=3 demonstrations, while flat-trained models require m=10 demonstrations to reach the same level — a $3 \times$ sample efficiency gap that replicates across seeds, architectures, and datasets.
技術方法： 本文提出的方法：We replicate across three training seeds and validate on a second dataset (LIBERO-Long). Primitive-trained models reach 78% of fine-tuned upper-bound performance with only m=3 demonstrations, while flat-trained models require m=10 demonstrations to r

Key Takeaway: We identify and correct a methodological pitfall in evaluating chunked policies: family-wise inflation of single-step action-range gates produces order-of-magnitude higher false-failure rates against ground-truth human demonstrations.
核心發現： 核心結果：We identify and correct a methodological pitfall in evaluating chunked policies: family-wise inflation of single-step action-range gates produces order-of-magnitude higher false-failure rates against

WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation

Authors: Varun Nair, Vidyut Baradwaj, Jiahang He et al. | Submitted: 2026-05-29 | arXiv: 2605.30671 Categories: cs.CV, cs.RO

Research Background: Recovering ego-camera orientation from manipulation video is a prerequisite for disentangling hand motion from camera motion, a key step in imitation learning from egocentric demonstrations. The obvious approach, inferring orientation from scene geometry, fails when hands occlude the frame: VGGT, a 1B-parameter scene reconstruction model, scores worse than a constant predictor on the TACO bench…
研究背景： 在電腦視覺與機器人領域，Recovering ego-camera orientation from manipulation video is a prerequisite for disentangling hand motion from camera motion, a key step in imitation learning from egocentric demon

Technical Approach: We identify an alternative visual concept that is present precisely when scene geometry is absent: kinematic coupling dynamics, the structured physical relationship between wrist motion and camera orientation imposed by the arm-shoulder-head chain. We find that this concept is compact (4D inter-wrist features outperform 126D full hand keypoints), temporal (requiring a GRU over short windows rather than per-frame retrieval), and physically grounded (transferring zero-shot across datasets becau…
技術方法： 本文提出的方法：We identify an alternative visual concept that is present precisely when scene geometry is absent: kinematic coupling dynamics, the structured physical relationship between wrist motion and camera orientation imposed by the arm-shoulder-head chain. W

Key Takeaway: Trained only on tabletop manipulation, WristCompass transfers zero-shot to Epic Kitchens cooking video, achieving 14.3 $^{\circ}$ median geodesic error and approaching the performance of a 1B-parameter scene model at 200K GRU parameters.
核心發現： 核心結果：Trained only on tabletop manipulation, WristCompass transfers zero-shot to Epic Kitchens cooking video, achieving 14.3 $^{\circ}$ median geodesic error and approaching the performance of a 1B-parameter s

From Noise to Control: Parameterized Diffusion Policies

Authors: Renhao Zhang, Haotian Fu, Mingxi Jia et al. | Submitted: 2026-05-29 | arXiv: 2606.00336 Categories: cs.AI, cs.LG

Research Background: We propose Parameterized Diffusion Policy (PDP), a framework for learning diffusion policies conditioned on low-dimensional, continuous parameters embedded in a learned behavior manifold. By constructing this manifold so that distances between latent representations reflect the semantic similarity between physical trajectories, we transform diffusion from a mechanism for stochastic diversity in…
研究背景： 在人工智慧與機器人領域，We propose Parameterized Diffusion Policy (PDP), a framework for learning diffusion policies conditioned on low-dimensional, continuous parameters embedded in a learned behavior ma

Technical Approach: Our approach enables smooth interpolation between known strategies and efficient adaptation to novel constraints without updating policy weights. We demonstrate that PDP significantly improves adaptation performance on complex multimodal benchmarks in both simulated and real-robot experiments compared to standard diffusion policies, particularly in scenarios requiring the synthesis of novel behaviors.
技術方法： 本文提出的方法：Our approach enables smooth interpolation between known strategies and efficient adaptation to novel constraints without updating policy weights. We demonstrate that PDP significantly improves adaptation performance on complex multimodal benchmarks i

Key Takeaway: We demonstrate that PDP significantly improves adaptation performance on complex multimodal benchmarks in both simulated and real-robot experiments compared to standard diffusion policies, particularly in scenarios requiring the synthesis of novel behaviors.
核心發現： 核心結果：We demonstrate that PDP significantly improves adaptation performance on complex multimodal benchmarks in both simulated and real-robot experiments compared to standard diffusion policies, particularl

nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving

Authors: Zhiyu Huang, Johnson Liu, Rui Song et al. | Submitted: 2026-05-29 | arXiv: 2605.31572 Categories: cs.CV

Research Background: Reasoning is essential for autonomous driving (AD) in long-tail scenarios, where vehicles must apply commonsense knowledge, understand spatial relations, infer agent interactions, and make safe decisions. However, existing AD datasets and benchmarks mainly target perception, prediction, or planning, and provide limited supervision for reasoning over realistic long-tail driving scenes.
研究背景： 在電腦視覺與機器人領域，Reasoning is essential for autonomous driving (AD) in long-tail scenarios, where vehicles must apply commonsense knowledge, understand spatial relations, infer agent interactions,

Technical Approach: We introduce nuReasoning, a large-scale real-world dataset and benchmark for reasoning-centric AD.
技術方法： 本文提出的方法：We introduce nuReasoning, a large-scale real-world dataset and benchmark for reasoning-centric AD.

Key Takeaway: These results establish nuReasoning as a foundation for evaluating and improving robust, interpretable, reasoning-driven AD systems in realistic long-tail settings.
核心發現： 核心結果：These results establish nuReasoning as a foundation for evaluating and improving robust, interpretable, reasoning-driven AD systems in realistic long-tail settings.

DriveMA: Driving Vision-Language-Action Models with verifiable Meta-Actions

Authors: Weicheng Zheng, Yixin Huang, Qiao Sun et al. | Submitted: 2026-05-29 | arXiv: 2605.31271 Categories: cs.CV

Research Background: Driving Vision-Language-Action Models (Driving VLAs) aim to use language to improve end-to-end planning, but the language-action gap limits this promise. We propose DriveMA, a Driving VLA framework built on verifiable meta-actions, which summarize future ego motion into compact language-domain intentions and can be constructed from expert trajectories with a trajectory-grounded annotation pipel…
研究背景： 在電腦視覺與機器人領域，Driving Vision-Language-Action Models (Driving VLAs) aim to use language to improve end-to-end planning, but the language-action gap limits this promise. We propose DriveMA, a Driv

Technical Approach: We propose DriveMA, a Driving VLA framework built on verifiable meta-actions, which summarize future ego motion into compact language-domain intentions and can be constructed from expert trajectories with a trajectory-grounded annotation pipeline and can be verified against generated trajectories through rule-based projection.
技術方法： 本文提出的方法：We propose DriveMA, a Driving VLA framework built on verifiable meta-actions, which summarize future ego motion into compact language-domain intentions and can be constructed from expert trajectories with a trajectory-grounded annotation pipeline and

Key Takeaway: These results show that even a simple meta-action interface can achieve state-of-the-art planning when made verifiable and optimized for language-action alignment.
核心發現： 核心結果：These results show that even a simple meta-action interface can achieve state-of-the-art planning when made verifiable and optimized for language-action alignment.

Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior?

Authors: Jingtao He, Hongliang Lu, Xiaoyun Qiu et al. | Submitted: 2026-05-29 | arXiv: 2605.31041 Categories: cs.CV, cs.AI

Research Background: Vision-Language-Action (VLA) models have demonstrated promising capability in autonomous driving, highlighting the potential of unified multimodal architectures for jointly modeling perception and planning. However, how current VLA-based driving behavior is grounded in visual information remains poorly understood.
研究背景： 在電腦視覺與機器人領域，Vision-Language-Action (VLA) models have demonstrated promising capability in autonomous driving, highlighting the potential of unified multimodal architectures for jointly modelin

Technical Approach: In this work, we introduce a structured multi-level visual perturbation framework to analyze visual-behavior dependency in VLA-based driving models systematically.
技術方法： 本文提出的方法：In this work, we introduce a structured multi-level visual perturbation framework to analyze visual-behavior dependency in VLA-based driving models systematically.

Key Takeaway: Experimental results reveal evaluation-dependent dependency patterns and uneven visual grounding across abstraction levels.
核心發現： 核心結果：Experimental results reveal evaluation-dependent dependency patterns and uneven visual grounding across abstraction levels.

SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models

Authors: Jialiang Fan, Weizhe Xu, Oleg Sokolsky et al. | Submitted: 2026-05-30 | arXiv: 2606.00773 Categories: cs.RO

Research Background: Vision-language-action (VLA) benchmarks measure whether a policy completes a requested manipulation task, but binary success can hide safety-relevant trajectory behavior: reaching the goal while applying excessive contact, disturbing bystander objects, destabilizing the held object, or entering robot self-contact. We present SafeVLA-Bench, a post-hoc safety-evaluation framework for existing sim…
研究背景： 在機器人學習領域，Vision-language-action (VLA) benchmarks measure whether a policy completes a requested manipulation task, but binary success can hide safety-relevant trajectory behavior: reaching

Technical Approach: We present SafeVLA-Bench, a post-hoc safety-evaluation framework for existing simulator-based VLA benchmarks.
技術方法： 本文提出的方法：We present SafeVLA-Bench, a post-hoc safety-evaluation framework for existing simulator-based VLA benchmarks.

Key Takeaway: We instantiate SafeVLA-Bench on LIBERO and RoboCasa-365, evaluating nine policy-benchmark entries across tabletop and kitchen manipulation tasks.
核心發現： 核心結果：We instantiate SafeVLA-Bench on LIBERO and RoboCasa-365, evaluating nine policy-benchmark entries across tabletop and kitchen manipulation tasks.

Infeasible optimization problems and the hierarchical augmented Lagrangian method in imitation learning

Authors: Roland Andrews, Justin Carpentier, Ajay Sathya | Submitted: 2026-05-30 | arXiv: 2606.00730 Categories: cs.RO

Research Background: Imitation learning (IL) is an effective approach to train complex robotics policies. Recent works have introduced hard constraints into imitation-learning optimization problems to ensure safety, stability, and robustness of the learned policy.
研究背景： 在機器人學習領域，Imitation learning (IL) is an effective approach to train complex robotics policies. Recent works have introduced hard constraints into imitation-learning optimization problems to

Technical Approach: We show that our approach drives the learned policy toward the solution of a closest-feasible constrained IL problem with desirable properties.
技術方法： 本文提出的方法：We show that our approach drives the learned policy toward the solution of a closest-feasible constrained IL problem with desirable properties.

Key Takeaway: We show that our approach drives the learned policy toward the solution of a closest-feasible constrained IL problem with desirable properties.
核心發現： 核心結果：We show that our approach drives the learned policy toward the solution of a closest-feasible constrained IL problem with desirable properties.

PACE: Phase-Aware Chunk Execution for Robot Policies with Action Chunking

Authors: Junnan Nie, Jiayi Li, Jiachen Zhang et al. | Submitted: 2026-05-30 | arXiv: 2606.00537 Categories: cs.RO

Research Background: Recent vision-language-action and diffusion-based robot policies often use action chunking, where each policy query predicts a sequence of future actions and the robot executes an open-loop prefix before re-querying. While this interface improves local motion continuity, deployment still requires choosing the execution horizon: how much of each predicted chunk should be executed before acquirin…
研究背景： 在機器人學習領域，Recent vision-language-action and diffusion-based robot policies often use action chunking, where each policy query predicts a sequence of future actions and the robot executes an

Technical Approach: We propose PACE (Phase-Aware Chunk Execution), a training-free test-time execution method that selects the execution horizon online from the predicted chunk itself.
技術方法： 本文提出的方法：We propose PACE (Phase-Aware Chunk Execution), a training-free test-time execution method that selects the execution horizon online from the predicted chunk itself.

Key Takeaway: Ablations and rollout-level analyses show that PACE adapts execution horizons across manipulation phases, shortening near transitions while preserving longer execution during coherent motion.
核心發現： 核心結果：Ablations and rollout-level analyses show that PACE adapts execution horizons across manipulation phases, shortening near transitions while preserving longer execution during coherent motion.

PaCo-VLA: Passivity-Shielded Compliance Prior for Contact-Rich Vision-Language-Action Manipulation

Authors: Haofan Cao, Zhaoyang Li, Zhichao You et al. | Submitted: 2026-05-30 | arXiv: 2606.00515 Categories: cs.RO, cs.AI, eess.SY

Research Background: Contact-rich manipulation demands both high-level semantic reasoning and the safe regulation of high-frequency contact dynamics. While Vision-Language-Action (VLA) models provide unprecedented semantic generalization, their low-rate outputs lack the reliability required for direct plant authority in force-sensitive tasks.
研究背景： 在機器人學習領域，Contact-rich manipulation demands both high-level semantic reasoning and the safe regulation of high-frequency contact dynamics. While Vision-Language-Action (VLA) models provide u

Technical Approach: To bridge this semantic-to-control gap, we introduce PaCo-VLA, a passivity-shielded compliance prior that recasts the VLA interface.
技術方法： 本文提出的方法：To bridge this semantic-to-control gap, we introduce PaCo-VLA, a passivity-shielded compliance prior that recasts the VLA interface.

Key Takeaway: Extensive simulated and real-world connector-insertion experiments demonstrate that PaCo-VLA achieves superior precision over unshielded VLA baselines, sustaining zero passivity violations even under adversarial compliance shifts.
核心發現： 核心結果：Extensive simulated and real-world connector-insertion experiments demonstrate that PaCo-VLA achieves superior precision over unshielded VLA baselines, sustaining zero passivity violations even under

ROG-Grasp: Root-Oriented Geometry for Robotic Grasping and Placement

Authors: Zijian An, Augustus Sroka, Ran Yang et al. | Submitted: 2026-05-30 | arXiv: 2606.00449 Categories: cs.RO

Research Background: Orientation-aware manipulation is essential in post-harvest agricultural processing, where produce must be grasped and placed in consistent configurations. This paper presents ROG-Grasp, a geometry-based robotic grasping and placement framework that estimates the produce orientation from root surface geometry using RGB-D perception.
研究背景： 在機器人學習領域，Orientation-aware manipulation is essential in post-harvest agricultural processing, where produce must be grasped and placed in consistent configurations. This paper presents ROG-

Technical Approach: This paper presents ROG-Grasp, a geometry-based robotic grasping and placement framework that estimates the produce orientation from root surface geometry using RGB-D perception.
技術方法： 本文提出的方法：This paper presents ROG-Grasp, a geometry-based robotic grasping and placement framework that estimates the produce orientation from root surface geometry using RGB-D perception.

Key Takeaway: These results highlight the effectiveness of geometry-driven perception for practical orientation-controlled manipulation tasks.
核心發現： 核心結果：These results highlight the effectiveness of geometry-driven perception for practical orientation-controlled manipulation tasks.

LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World

Authors: Hojune Kim, Timothy Chen, Jiankai Sun et al. | Submitted: 2026-05-31 | arXiv: 2606.01458 Categories: cs.RO

Research Background: Training vision-language-action (VLA) policies for humanoid loco-manipulation is constrained by the high cost and complexity of collecting human teleoperation demonstrations. VLA policies fine-tuned in simulators have, until now, failed to transfer effectively in humanoid loco-manipulation tasks.
研究背景： 在機器人學習領域，Training vision-language-action (VLA) policies for humanoid loco-manipulation is constrained by the high cost and complexity of collecting human teleoperation demonstrations. VLA p

Technical Approach: We present LEGS (Loco-manipulation via Embodied Gaussian Splatting), a hybrid simulator that composites a mesh foreground (robot, objects, props) over a photorealistic 3D Gaussian Splatting (3DGS) background reconstructed from a handheld scene capture.
技術方法： 本文提出的方法：We present LEGS (Loco-manipulation via Embodied Gaussian Splatting), a hybrid simulator that composites a mesh foreground (robot, objects, props) over a photorealistic 3D Gaussian Splatting (3DGS) background reconstructed from a handheld scene captur

Key Takeaway: Humanoid motion is recorded independently of scene appearance in LEGS, allowing the same auto-generated demonstrations to be re-rendered under new backgrounds and object meshes—covering a new scene at more than 15x lower cost than teleoperation—to augment training data for robustness to scene v…
核心發現： 核心結果：Humanoid motion is recorded independently of scene appearance in LEGS, allowing the same auto-generated demonstrations to be re-rendered under new backgrounds and object meshes—covering a new scene a

OneVLA: A Unified Framework for Embodied Tasks

Authors: Lingfeng Zhang, Xiaoshuai Hao, Yingbo Tang et al. | Submitted: 2026-05-31 | arXiv: 2606.01241 Categories: cs.RO

Research Background: Navigation and manipulation are fundamental capabilities of embodied intelligence, enabling robots to interpret natural language commands and interact physically with their surroundings. However, current Vision-Language-Action (VLA) models remain constrained by task-specific architectures, specializing in either navigation or manipulation, which hinders the development of general-purpose roboti…
研究背景： 在機器人學習領域，Navigation and manipulation are fundamental capabilities of embodied intelligence, enabling robots to interpret natural language commands and interact physically with their surroun

Technical Approach: To bridge this gap, we introduce OneVLA, a unified architecture that integrates these distinct tasks into a single, cohesive framework. Specifically, we design a unified action head capable of generating both navigation and manipulation actions without requiring task-specific variants. Furthermore, we propose a multi stage progressive training strategy-incorporating curated data construction and Chain-of-Thought (CoT) fine-tuning that facilitates strong positive transfer and mutual reinforcem…
技術方法： 本文提出的方法：To bridge this gap, we introduce OneVLA, a unified architecture that integrates these distinct tasks into a single, cohesive framework. Specifically, we design a unified action head capable of generating both navigation and manipulation actions witho

Key Takeaway: Extensive experiments in both simulated and real-world environments demonstrate that OneVLA achieves state-of-the-art performance, significantly outperforming both specialized single-task and existing cross-task models.
核心發現： 核心結果：Extensive experiments in both simulated and real-world environments demonstrate that OneVLA achieves state-of-the-art performance, significantly outperforming both specialized single-task and existing

Authors: Xuchen Liu, Jiawei Huang, Shihao Xia et al. | Submitted: 2026-05-31 | arXiv: 2606.01205 Categories: cs.RO

Research Background: Vision-language navigation (VLN) for UAVs demands grounding free-form instructions into 6-DoF flight under partial observability. While Vision-Language-Action (VLA) models excel at semantic reasoning, they suffer from brittleness due to geometric inconsistency and dynamics mismatch.
研究背景： 在機器人學習領域，Vision-language navigation (VLN) for UAVs demands grounding free-form instructions into 6-DoF flight under partial observability. While Vision-Language-Action (VLA) models excel at

Technical Approach: To address this, we propose ImagineUAV, an imagination-driven framework leveraging cascaded world-action modeling.
技術方法： 本文提出的方法：To address this, we propose ImagineUAV, an imagination-driven framework leveraging cascaded world-action modeling.

Key Takeaway: With only 1.3B parameters, ImagineUAV outperforms prior VLN and VLA baselines on benchmarks and real-world flights, validating the practicality of imagination-driven aerial navigation.
核心發現： 核心結果：With only 1.3B parameters, ImagineUAV outperforms prior VLN and VLA baselines on benchmarks and real-world flights, validating the practicality of imagination-driven aerial navigation.

Implicit Drifting Policy: One-Step Action Generation via Conditional Expert Geometry

Authors: Zemin Yang, Yaoyu He, Yiming Zhong et al. | Submitted: 2026-05-31 | arXiv: 2606.01098 Categories: cs.RO, cs.AI

Research Background: Generative action policies based on diffusion or flow matching excel in behavior cloning, yet their iterative sampling is prohibitive for high-frequency robot control. While recent one-step formulations alleviate this latency, they inevitably discard the intermediate trajectory evolution that provides crucial action correction.
研究背景： 在機器人學習領域，Generative action policies based on diffusion or flow matching excel in behavior cloning, yet their iterative sampling is prohibitive for high-frequency robot control. While recent

Technical Approach: We introduce Implicit Drifting Policy (IDP), a one-step imitation learning framework that brings the training-time correction of Drifting into policy learning without explicit vector field estimation.
技術方法： 本文提出的方法：We introduce Implicit Drifting Policy (IDP), a one-step imitation learning framework that brings the training-time correction of Drifting into policy learning without explicit vector field estimation.

Key Takeaway: Extensive evaluations across 2D, 3D, and real-world manipulation tasks show IDP effectively maintains adherence to valid action manifolds, improving upon explicit drifting methods and achieving competitive performance with strong one-step baselines.
核心發現： 核心結果：Extensive evaluations across 2D, 3D, and real-world manipulation tasks show IDP effectively maintains adherence to valid action manifolds, improving upon explicit drifting methods and achieving compet

Beyond Task Success: Behavioral and Representational Diagnostics for WAM and VLA

Authors: Hung Mai, Bin Zhu, Tuan Do | Submitted: 2026-05-31 | arXiv: 2606.01095 Categories: cs.RO, cs.AI

Research Background: Vision-language-action (VLA) policies and World-Action Models (WAM) represent two increasingly important paradigms for robotic manipulation. However, it remains unclear whether future prediction in WAMs leads to behaviorally meaningful improvements beyond final task success.
研究背景： 在機器人學習領域，Vision-language-action (VLA) policies and World-Action Models (WAM) represent two increasingly important paradigms for robotic manipulation. However, it remains unclear whether fut

Technical Approach: In this paper, we ask whether WAMs merely add future prediction, or whether they change robot behavior and internal representations in ways that are actionable for control. We introduce a model-agnostic diagnostic framework that compares WAMs and VLAs through two complementary lenses: behavioral rollout analysis and sparse-autoencoder-based feature analysis.
技術方法： 本文提出的方法：In this paper, we ask whether WAMs merely add future prediction, or whether they change robot behavior and internal representations in ways that are actionable for control. We introduce a model-agnostic diagnostic framework that compares WAMs and VLA

Key Takeaway: Our results show that success alone hides key differences: WAMs often improve object-level behavior and target selectivity, but their gains depend on architecture and incur higher inference cost.
核心發現： 核心結果：Our results show that success alone hides key differences: WAMs often improve object-level behavior and target selectivity, but their gains depend on architecture and incur higher inference cost.

Expanding Spatial and Temporal Context for Robotic Imitation Learning With Scene Graphs

Authors: Jianing Qian, Qinhe Peng, Emmanuel Panov et al. | Submitted: 2026-05-31 | arXiv: 2606.01072 Categories: cs.RO, cs.CV

Research Background: Imitation learning enables robots to learn how to execute tasks via observation. However, real-world environments like homes and offices are often severely partially observed due to their large spatial scales.
研究背景： 在機器人學習領域，Imitation learning enables robots to learn how to execute tasks via observation. However, real-world environments like homes and offices are often severely partially observed due t

Technical Approach: To address these challenges, we propose using scene graphs as an explicit and structured memory mechanism in imitation learning. By maintaining a dynamic scene graph that captures object-centric relationships and their evolution over time, our method allows the agent to retain relevant historical context during task execution to efficiently reason over incrementally accrued scene information. Our experiments on simulated mobile manipulation and real-world tabletop manipulation demonstrate tha…
技術方法： 本文提出的方法：To address these challenges, we propose using scene graphs as an explicit and structured memory mechanism in imitation learning. By maintaining a dynamic scene graph that captures object-centric relationships and their evolution over time, our method

Key Takeaway: Our experiments on simulated mobile manipulation and real-world tabletop manipulation demonstrate that our approach substantially improves policy performance, particularly in settings that demand long-term reasoning and robust generalization under partial observability.
核心發現： 核心結果：Our experiments on simulated mobile manipulation and real-world tabletop manipulation demonstrate that our approach substantially improves policy performance, particularly in settings that demand long

Make Your VLA More Robust Without More Data By Interleaving Motion Planning

Authors: Dan BW Choe, Sundhar Vinodh Sangeetha, Samuel Coogan et al. | Submitted: 2026-05-31 | arXiv: 2606.00985 Categories: cs.RO

Research Background: Vision-Language-Action (VLA) models have shown remarkable progress for mobile manipulation, but their performance on long-horizon tasks remains poor. These tasks are especially challenging because (1) progress toward high-level goals must be maintained across extended sequences of spatially distributed subtasks, and (2) early execution errors compound rapidly over the task horizon.
研究背景： 在機器人學習領域，Vision-Language-Action (VLA) models have shown remarkable progress for mobile manipulation, but their performance on long-horizon tasks remains poor. These tasks are especially cha

Technical Approach: To address these challenges, we propose MPVI: Motion Planner / VLA Interleaving, a framework that integrates model-based motion planning with VLAs to improve robustness without further training. We evaluate our approach on the BEHAVIOR-1K benchmark and demonstrate 113% improvement in task progress over a top end-to-end VLA baseline.
技術方法： 本文提出的方法：To address these challenges, we propose MPVI: Motion Planner / VLA Interleaving, a framework that integrates model-based motion planning with VLAs to improve robustness without further training. We evaluate our approach on the BEHAVIOR-1K benchmark a

Key Takeaway: We evaluate our approach on the BEHAVIOR-1K benchmark and demonstrate 113% improvement in task progress over a top end-to-end VLA baseline.
核心發現： 核心結果：We evaluate our approach on the BEHAVIOR-1K benchmark and demonstrate 113% improvement in task progress over a top end-to-end VLA baseline.

Threading Optimization for Vision-Language-Action Model Inference in Low-Cost Smart Agricultural Manipulation

Authors: Keith Truongcao, Christopher Nhu, Zijian An et al. | Submitted: 2026-05-31 | arXiv: 2606.00966 Categories: cs.RO

Research Background: Vision-Language Action (VLA) models continue to face challenges such as slow inference speed and difficulty performing fine-grained motion adjustments, limiting their widespread adoption in industry. While the Real-Time Action Chunking (RTAC) algorithm has been proposed to address these bottlenecks, bridging the gap between the algorithm provided in pseudocode to a stable, real-world deployment…
研究背景： 在機器人學習領域，Vision-Language Action (VLA) models continue to face challenges such as slow inference speed and difficulty performing fine-grained motion adjustments, limiting their widespread ad

Technical Approach: In this work, we present a complete system-level implementation of RTAC tailored for a low-cost robotic manipulation system.
技術方法： 本文提出的方法：In this work, we present a complete system-level implementation of RTAC tailored for a low-cost robotic manipulation system.

Key Takeaway: Experimental results demonstrate that our custom threading implementation significantly improves control stability and speed compared to the base implementation of RTAC.
核心發現： 核心結果：Experimental results demonstrate that our custom threading implementation significantly improves control stability and speed compared to the base implementation of RTAC.

Lagrangian Perturbation Diffusion Steering: Latent Reinforcement Learning for Generative Policies

Authors: Hikmet Simsir, Ozgur S. Oguz | Submitted: 2026-05-31 | arXiv: 2606.01151 Categories: cs.LG

Research Background: Behavior cloning with high-capacity generative policies achieves strong imitation performance, but is often limited by demonstration coverage and distribution shift. Direct reinforcement learning fine-tuning can improve performance, but updating large action decoders is frequently unstable and sample inefficient.
研究背景： 在機器學習與機器人領域，Behavior cloning with high-capacity generative policies achieves strong imitation performance, but is often limited by demonstration coverage and distribution shift. Direct reinfor

Technical Approach: We propose Lagrangian Perturbation Diffusion Steering (LP-DS), a lightweight adaptation method that improves a frozen generative policy by learning a compact noise-space perturbation before decoding.
技術方法： 本文提出的方法：We propose Lagrangian Perturbation Diffusion Steering (LP-DS), a lightweight adaptation method that improves a frozen generative policy by learning a compact noise-space perturbation before decoding.

Key Takeaway: Additional evaluations with flow-matching backbones, a large vision-language-action model, and physical Franka deployment show that LP-DS is not limited to compact diffusion policies or simulated benchmarks.
核心發現： 核心結果：Additional evaluations with flow-matching backbones, a large vision-language-action model, and physical Franka deployment show that LP-DS is not limited to compact diffusion policies or simulated benc

PhyPush: One Push is All You Need for Sensorless Physical Property Estimation with Physics-Guided Transformers

Authors: Koyo Fujii, Luis Figueredo, Praminda Caleb-Solly et al. | Submitted: 2026-05-25 | arXiv: 2605.26284 Categories: cs.RO

Research Background: Accurately estimating object mass and friction is fundamental to achieving reliable and adaptive robotic manipulation. Although interactive perception provides a powerful mechanism for inferring such properties, most existing approaches depend on specialized hardware such as force/torque sensors, tactile arrays, or multi-camera motion-capture systems, limiting scalability and deployment.
研究背景： 在機器人學習領域，Accurately estimating object mass and friction is fundamental to achieving reliable and adaptive robotic manipulation. Although interactive perception provides a powerful mechanism

Technical Approach: This paper presents PhyPush, a physics-guided Transformer framework that estimates an object’s mass and friction coefficient using only kinematically derived end-effector velocity from a single push.
技術方法： 本文提出的方法：This paper presents PhyPush, a physics-guided Transformer framework that estimates an object’s mass and friction coefficient using only kinematically derived end-effector velocity from a single push.

Key Takeaway: Overall, the results demonstrate that physics-guided learning can enable low-cost, sensor-efficient estimation of physical properties, relying solely on a single push and readily available kinematic data.
核心發現： 核心結果：Overall, the results demonstrate that physics-guided learning can enable low-cost, sensor-efficient estimation of physical properties, relying solely on a single push and readily available kinematic d

ParkourFormer: Integrating Predictive Supervision and Sequence Modeling into Parkour Locomotion

Authors: Yanheng Mai, Wenhao Xu, Zirui Huang et al. | Submitted: 2026-05-25 | arXiv: 2605.25782 Categories: cs.RO

Research Background: Humanoid parkour requires locomotion policies to coordinate whole-body dynamics across rapidly changing terrains such as stairs, gaps, slopes, and obstacles. Existing reinforcement learning policies are largely reactive, mapping observations directly to actions without explicitly modeling future body states.
研究背景： 在機器人學習領域，Humanoid parkour requires locomotion policies to coordinate whole-body dynamics across rapidly changing terrains such as stairs, gaps, slopes, and obstacles. Existing reinforcement

Technical Approach: We present ParkourFormer, a Transformer-based sequence modeling framework that reformulates humanoid locomotion as a future-conditioned decision-making problem.
技術方法： 本文提出的方法：We present ParkourFormer, a Transformer-based sequence modeling framework that reformulates humanoid locomotion as a future-conditioned decision-making problem.

Key Takeaway: These results demonstrate that explicit future-state modeling significantly improves robustness and generalization for agile whole-body locomotion.
核心發現： 核心結果：These results demonstrate that explicit future-state modeling significantly improves robustness and generalization for agile whole-body locomotion.

Compliant Non-Prehensile Pushing Manipulation

Authors: Francesco Cufino, Mario Selvaggio, Fabio Amadio et al. | Submitted: 2026-05-25 | arXiv: 2605.25672 Categories: cs.RO

Research Background: In this paper, we address the challenge of performing non-prehensile pushing operations with a compliant robotic manipulation system. To ensure safe operations in human-populated environments, robots must comply with external physical interactions and exhibit passive behavior.
研究背景： 在機器人學習領域，In this paper, we address the challenge of performing non-prehensile pushing operations with a compliant robotic manipulation system. To ensure safe operations in human-populated e

Technical Approach: We develop a model predictive control framework built upon this model that enables compliant pushing through optimal modulation of the robot’s position/velocity set-point, jointly realizing the required pushing force and contact point adaptation to obtain desired object motion.
技術方法： 本文提出的方法：We develop a model predictive control framework built upon this model that enables compliant pushing through optimal modulation of the robot’s position/velocity set-point, jointly realizing the required pushing force and contact point adaptation to o

Key Takeaway: The proposed method has been rigorously tested in simulation and validated through experiments on two different robotic systems, demonstrating passive compliance during human-robot interactions and assessing trajectory tracking performance and robustness to variations in the object’s physical par…
核心發現： 核心結果：The proposed method has been rigorously tested in simulation and validated through experiments on two different robotic systems, demonstrating passive compliance during human-robot interactions and as

TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation

Authors: Sizhe Zhao, Shengping Zhang, Shuo Yang et al. | Submitted: 2026-05-25 | arXiv: 2605.25547 Categories: cs.RO, cs.CV

Research Background: Existing embodied control research demonstrates remarkable performance improvements by scaling training data and model size. We instead explore inference-time strategy as an alternative axis.
研究背景： 在機器人學習領域，Existing embodied control research demonstrates remarkable performance improvements by scaling training data and model size. We instead explore inference-time strategy as an altern

Technical Approach: In this paper, we propose \textbf{TapSampling}, a plug-and-play framework for inference-time sampling. First, we introduce an Action-VAE that represents actions in a low-dimensional latent space by mapping policy-generated initial actions into a compressed posterior distribution, from which any number of latent samples can be drawn and decoded into candidate actions that approximate the true action distribution. Extensive experiments in both simulated and real-world environments demonstrate t…
技術方法： 本文提出的方法：In this paper, we propose \textbf{TapSampling}, a plug-and-play framework for inference-time sampling. First, we introduce an Action-VAE that represents actions in a low-dimensional latent space by mapping policy-generated initial actions into a comp

Key Takeaway: Extensive experiments in both simulated and real-world environments demonstrate that our method substantially improves multiple generalist policies without further policy finetuning.
核心發現： 核心結果：Extensive experiments in both simulated and real-world environments demonstrate that our method substantially improves multiple generalist policies without further policy finetuning.

Safety-Critical Whole-Body Control for Humanoid Robots via Input-to-State Safe Control Barrier Functions

Authors: Kwanwoo Lee, Sanghyuk Park, Gyeongjae Park et al. | Submitted: 2026-05-25 | arXiv: 2605.25546 Categories: cs.RO

Research Background: Safety-critical control is essential for humanoid robots operating in complex human-centered environments, where physical safety constraints such as joint limits, self-collision avoidance, obstacle avoidance, and workspace boundaries must be satisfied during real-robot operation. However, existing approaches remain limited because kinematic safety guarantees can be degraded in the presence of u…
研究背景： 在機器人學習領域，Safety-critical control is essential for humanoid robots operating in complex human-centered environments, where physical safety constraints such as joint limits, self-collision av

Technical Approach: This paper presents a hierarchical safety-critical whole-body control framework for humanoid robots based on input-to-state safe control barrier functions (ISSf-CBFs).
技術方法： 本文提出的方法：This paper presents a hierarchical safety-critical whole-body control framework for humanoid robots based on input-to-state safe control barrier functions (ISSf-CBFs).

Key Takeaway: Simulation and real-robot experiments demonstrate that the proposed framework improves safety margins under model mismatch and reliably enforces multiple safety constraints in real time during locomotion, teleoperation, and single-leg balancing with hand control.
核心發現： 核心結果：Simulation and real-robot experiments demonstrate that the proposed framework improves safety margins under model mismatch and reliably enforces multiple safety constraints in real time during locomot

RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation

Authors: Wenhui Chu | Submitted: 2026-05-25 | arXiv: 2605.25495 Categories: cs.RO, cs.CV

Research Background: Robotic perception in unstructured environments remains challenging despite the zero-shot capabilities of foundation models such as SAM. This work attributes performance degradation to non-uniform representation shifts across transformer layers: shallow layers exhibit substantial domain gaps (CKA < 0.5), whereas deep layers transfer effectively (CKA > 0.7).
研究背景： 在機器人學習領域，Robotic perception in unstructured environments remains challenging despite the zero-shot capabilities of foundation models such as SAM. This work attributes performance degradatio

Technical Approach: This work attributes performance degradation to non-uniform representation shifts across transformer layers: shallow layers exhibit substantial domain gaps (CKA < 0.5), whereas deep layers transfer effectively (CKA > 0.7). Based on this observation, we propose RepSAM, a representation-guided parameter-efficient fine-tuning (PEFT) framework for adapting foundation models to robotic vision.
技術方法： 本文提出的方法：This work attributes performance degradation to non-uniform representation shifts across transformer layers: shallow layers exhibit substantial domain gaps (CKA < 0.5), whereas deep layers transfer effectively (CKA > 0.7). Based on this observation,

Key Takeaway: These improvements are statistically significant (p < 0.01) and translate to a 12.0% absolute improvement in robotic manipulation success rates over the LoRA (RGB) baseline.
核心發現： 核心結果：These improvements are statistically significant (p < 0.01) and translate to a 12.0% absolute improvement in robotic manipulation success rates over the LoRA (RGB) baseline.

FOUND-IT: Foundation-model-first Task-driven 3D Scene Graphs with Granularity on Demand

Authors: Dominic Maggio, Nicolas Gorlo, Luca Carlone | Submitted: 2026-05-25 | arXiv: 2605.25371 Categories: cs.RO

Research Background: We present the first approach to build hierarchical task-driven 3D scene graphs of arbitrary indoor or outdoor environments using an uncalibrated monocular camera in real-time. We leverage geometric foundation models to estimate geometric attributes of the scene graph (e.g., object bounding boxes), but we also observe that traversability information (the “places” layer of a scene graph) can be …
研究背景： 在機器人學習領域，We present the first approach to build hierarchical task-driven 3D scene graphs of arbitrary indoor or outdoor environments using an uncalibrated monocular camera in real-time. We

Technical Approach: Our approach is task-driven in the sense that we adjust the granularity of the objects and regions in the map depending on the task; for instance, during a manipulation task, our approach is able to resolve small knobs on a stove, while during a navigation task it can focus on large objects (e.g., the entire stove). Furthermore, to highlight the robustness of our method, we demonstrate constructing 3D scene graphs on casually captured realtor apartment tours from YouTube.
技術方法： 本文提出的方法：Our approach is task-driven in the sense that we adjust the granularity of the objects and regions in the map depending on the task; for instance, during a manipulation task, our approach is able to resolve small knobs on a stove, while during a navi

Key Takeaway: Furthermore, to highlight the robustness of our method, we demonstrate constructing 3D scene graphs on casually captured realtor apartment tours from YouTube.
核心發現： 核心結果：Furthermore, to highlight the robustness of our method, we demonstrate constructing 3D scene graphs on casually captured realtor apartment tours from YouTube.

Authors: Morten Roed Frederiksen, Kasper Støy | Submitted: 2026-05-26 | arXiv: 2605.27539 Categories: cs.RO

Research Background: Many children experience challenges in emotional regulation and social interaction, which can limit their participation in everyday activities and therapeutic programs. For socially assistive robots to be effective in this context, it is essential that children remain consistently and meaningfully engaged.
研究背景： 在機器人學習領域，Many children experience challenges in emotional regulation and social interaction, which can limit their participation in everyday activities and therapeutic programs. For sociall

Technical Approach: This work contributes insights into age-related differences in engagement strategy effectiveness in human-robot interaction design.
技術方法： 本文提出的方法：This work contributes insights into age-related differences in engagement strategy effectiveness in human-robot interaction design.

Key Takeaway: The follow up study with university students across a full day of interactions revealed contrasting results: points-based systems produced significantly higher task accuracy (p < 0.05) and sustained performance over time.
核心發現： 核心結果：The follow up study with university students across a full day of interactions revealed contrasting results: points-based systems produced significantly higher task accuracy (p < 0.05) and sustained p

Towards Shared Embodied Intelligence in Humanoid Robots through Optimization Development and Testing of the Human Aware ergoCub Robot

Authors: Carlotta Sartore, Mohamed Elobaid, Lorenzo Rapetti et al. | Submitted: 2026-05-26 | arXiv: 2605.26991 Categories: cs.RO

Research Background: Collaboration is central to human behavior, enabling tasks beyond individual capability. This ability arises from coordinating actions through internal representations of others, a concept known as shared intelligence.
研究背景： 在機器人學習領域，Collaboration is central to human behavior, enabling tasks beyond individual capability. This ability arises from coordinating actions through internal representations of others, a

Technical Approach: Here we propose an architecture that integrates shared intelligence and embodied cognition to enable robots to physically collaborate with humans, where robot hardware and control are optimized for human metrics, using representations of the human body and motion intelligence. As a concrete implementation, we present the humanoid robot ergoCub, whose morphology and control have been optimized for collaborative tasks with humans. Our approach provides a framework for designing humanoid robots …
技術方法： 本文提出的方法：Here we propose an architecture that integrates shared intelligence and embodied cognition to enable robots to physically collaborate with humans, where robot hardware and control are optimized for human metrics, using representations of the human bo

Key Takeaway: The ultimate goal is to achieve a form of shared embodied intelligence.
核心發現： 核心結果：The ultimate goal is to achieve a form of shared embodied intelligence.

Authors: Akira Shiba, Marina Obata, Nathan Kau et al. | Submitted: 2026-05-26 | arXiv: 2605.26710 Categories: cs.RO

Research Background: The distance at which a mobile robot reacts to a person strongly impacts various qualities of the human-robot interaction. In this paper, we focus on the navigation of a mobile delivery robot platform in a residential indoor hallway environment.
研究背景： 在機器人學習領域，The distance at which a mobile robot reacts to a person strongly impacts various qualities of the human-robot interaction. In this paper, we focus on the navigation of a mobile del

Technical Approach: In this paper, we focus on the navigation of a mobile delivery robot platform in a residential indoor hallway environment. In this work, however, we demonstrate that by extending the reaction distance to over eight meters, far beyond the typical interaction distance, we can improve the human’s perception of the robot’s motion. We introduce the Proactive Lane-Changing (PLC) motion pattern and a navigation system that leverages it to react to people at an increased distance.
技術方法： 本文提出的方法：In this paper, we focus on the navigation of a mobile delivery robot platform in a residential indoor hallway environment. In this work, however, we demonstrate that by extending the reaction distance to over eight meters, far beyond the typical inte

Key Takeaway: In contrast, in the intersection (Blind Corner) scenarios, none of the approaches performed significantly better than any other, with participants having a diverse range of preferences among robot motion patterns.
核心發現： 核心結果：In contrast, in the intersection (Blind Corner) scenarios, none of the approaches performed significantly better than any other, with participants having a diverse range of preferences among robot mot

HyperSim: A Holistic Sim-To-Real Framework For Robust Robotic Manipulation

Authors: Junyi Dong, Haotian Luo, Ziwei Xu et al. | Submitted: 2026-05-26 | arXiv: 2605.26638 Categories: cs.RO

Research Background: Scaling data volume and diversity is critical for generalizing embodied intelligence. While synthetic data generation offers a scalable alternative to expensive physical data acquisition, transferring robotic manipulation policies from simulation to the real world (sim-to-real) remains a formidable challenge due to the domain gap.
研究背景： 在機器人學習領域，Scaling data volume and diversity is critical for generalizing embodied intelligence. While synthetic data generation offers a scalable alternative to expensive physical data acqui

Technical Approach: This paper presents HyperSim, a holistic framework spanning from synthetic data generation to policy training and seamless real-world deployment.
技術方法： 本文提出的方法：This paper presents HyperSim, a holistic framework spanning from synthetic data generation to policy training and seamless real-world deployment.

Key Takeaway: Furthermore, policies trained on our adversarial trajectories exhibit significantly enhanced robustness against dynamic uncertainties, achieving a 35% higher completion rate under physical perturbations.
核心發現： 核心結果：Furthermore, policies trained on our adversarial trajectories exhibit significantly enhanced robustness against dynamic uncertainties, achieving a 35% higher completion rate under physical perturbatio

Efficient On-policy Visual-RL via Stochastic Decoupled Policy Gradient

Authors: Haoxiang You, Yilang Liu, Davis Zong et al. | Submitted: 2026-05-26 | arXiv: 2605.26478 Categories: cs.RO, cs.AI, cs.CV, cs.LG

Research Background: We present the stochastic decoupled policy gradient (SDPG), a lightweight visual reinforcement learning (RL) method that trains diverse visuomotor control policies end-to-end within a few hours on a single NVIDIA RTX 4080 GPU. SDPG estimates policy gradients via random perturbations of trajectory rollouts, requiring orders of magnitude fewer batch-rendered environments and substantially reducin…
研究背景： 在機器人學習領域，We present the stochastic decoupled policy gradient (SDPG), a lightweight visual reinforcement learning (RL) method that trains diverse visuomotor control policies end-to-end withi

Technical Approach: Finally, to support future research, we introduce a suite of realistic visual robotics benchmarks spanning dexterous manipulation, challenging locomotion, and demonstrate effective sim-to-real transfer on physical hardware.
技術方法： 本文提出的方法：Finally, to support future research, we introduce a suite of realistic visual robotics benchmarks spanning dexterous manipulation, challenging locomotion, and demonstrate effective sim-to-real transfer on physical hardware.

Key Takeaway: Finally, to support future research, we introduce a suite of realistic visual robotics benchmarks spanning dexterous manipulation, challenging locomotion, and demonstrate effective sim-to-real transfer on physical hardware.
核心發現： 核心結果：Finally, to support future research, we introduce a suite of realistic visual robotics benchmarks spanning dexterous manipulation, challenging locomotion, and demonstrate effective sim-to-real transfe

Probabilistic Recurrent Intention Switching Model

Authors: Wenyuan Sheng, Hao Zhu, Joschka Boedecker | Submitted: 2026-05-26 | arXiv: 2605.26998 Categories: cs.LG, q-bio.NC

Research Background: Inverse reinforcement learning (IRL) recovers reward functions from observed behavior, yet traditional methods assume a single stationary reward that cannot capture goal switching within an episode. Recent multi-intention IRL methods address this by segmenting trajectories, but model intention transitions as either a memoryless Markov chain or via manual state augmentation with a fixed history …
研究背景： 在機器學習與機器人領域，Inverse reinforcement learning (IRL) recovers reward functions from observed behavior, yet traditional methods assume a single stationary reward that cannot capture goal switching

Technical Approach: We propose the Probabilistic Recurrent Intention Switching Model (PRISM), which replaces both mechanisms with a lightweight recurrent network that maps observation history to a per-step intention distribution.
技術方法： 本文提出的方法：We propose the Probabilistic Recurrent Intention Switching Model (PRISM), which replaces both mechanisms with a lightweight recurrent network that maps observation history to a per-step intention distribution.

Key Takeaway: Across all settings PRISM achieves the highest held-out log-likelihood while recovering nameable, temporally coherent intentions from unlabeled demonstrations, suggesting that discrete goal switching is present in both biological and artificial agents.
核心發現： 核心結果：Across all settings PRISM achieves the highest held-out log-likelihood while recovering nameable, temporally coherent intentions from unlabeled demonstrations, suggesting that discrete goal switching

Aligning Few-Step Generative Models by Amortizing Sample-based Variational Inference

Authors: Jaewoo Lee, Hyeongyu Kang, Dohyun Kim et al. | Submitted: 2026-05-26 | arXiv: 2605.26552 Categories: cs.LG, cs.AI

Research Background: Aligning a few-step generative model is challenging, since existing alignment frameworks typically rely on restrictive assumptions: a tractable likelihood, a specific ODE/SDE solver, or a particular model family. We introduce FAV, Few-step Generative Models Alignment via Sample-based Variational Inference, a general alignment framework that requires only sample access to the generator and the r…
研究背景： 在機器學習與機器人領域，Aligning a few-step generative model is challenging, since existing alignment frameworks typically rely on restrictive assumptions: a tractable likelihood, a specific ODE/SDE solve

Technical Approach: We introduce FAV, Few-step Generative Models Alignment via Sample-based Variational Inference, a general alignment framework that requires only sample access to the generator and the reference distribution.
技術方法： 本文提出的方法：We introduce FAV, Few-step Generative Models Alignment via Sample-based Variational Inference, a general alignment framework that requires only sample access to the generator and the reference distribution.

Key Takeaway: On generative policy alignment for robotic manipulation, FAV outperforms prevailing policy extraction baselines across 56 offline and 30 offline-to-online RL tasks.
核心發現： 核心結果：On generative policy alignment for robotic manipulation, FAV outperforms prevailing policy extraction baselines across 56 offline and 30 offline-to-online RL tasks.

What-If World: A Causal Benchmark for General World Models in Embodied Scenarios

Authors: Kunlin Cai, Rui Song, Jinghuai Zhang et al. | Submitted: 2026-05-26 | arXiv: 2605.27589 Categories: cs.CV

Research Background: Video generation models are increasingly used as world simulators for tasks like driving and robotic manipulation. What matters in these settings is not whether a single video looks right, but whether the model’s output changes when its input changes.
研究背景： 在電腦視覺與機器人領域，Video generation models are increasingly used as world simulators for tasks like driving and robotic manipulation. What matters in these settings is not whether a single video look

Technical Approach: We introduce What-If World, 319 such prompt pairs built on real frames from nuScenes and DROID, organized by a taxonomy of six physical variables shared across driving and manipulation.
技術方法： 本文提出的方法：We introduce What-If World, 319 such prompt pairs built on real frames from nuScenes and DROID, organized by a taxonomy of six physical variables shared across driving and manipulation.

Key Takeaway: Across nine state-of-the-art models, no system exceeds 52% on the paired score, and open-source models cluster near 28%.
核心發現： 核心結果：Across nine state-of-the-art models, no system exceeds 52% on the paired score, and open-source models cluster near 28%.

Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation

Authors: Jiahe Pan, Stelian Coros, Jitendra Malik et al. | Submitted: 2026-05-27 | arXiv: 2605.28812 Categories: cs.RO, cs.AI, cs.LG

Research Background: A primary bottleneck in contact-rich manipulation is the difficulty of collecting real-world data. Sim-to-real reinforcement learning offers a scalable alternative, but the simulation-reality gap prevents information-dense modalities like touch from being effectively used.
研究背景： 在機器人學習領域，A primary bottleneck in contact-rich manipulation is the difficulty of collecting real-world data. Sim-to-real reinforcement learning offers a scalable alternative, but the simulat

Technical Approach: In this work, we introduce Center-of-Pressure (CoP), an effective tactile representation grounded in physical principles that preserves dense contact information while maintaining robustness for sim-to-real transfer. To support this representation, we propose a sensor calibration scheme based on differentiable dynamics, enabling the estimation of taxel orientations without requiring ground-truth force measurements.
技術方法： 本文提出的方法：In this work, we introduce Center-of-Pressure (CoP), an effective tactile representation grounded in physical principles that preserves dense contact information while maintaining robustness for sim-to-real transfer. To support this representation, w

Key Takeaway: Across both tasks, policies conditioned on CoP achieve zero-shot sim-to-real transfer on a multi-fingered hand, and outperform both coarse binary-contact and raw-taxel baselines.
核心發現： 核心結果：Across both tasks, policies conditioned on CoP achieve zero-shot sim-to-real transfer on a multi-fingered hand, and outperform both coarse binary-contact and raw-taxel baselines.

EIT-Pneumatic Hybrid Robotic Skin for Practical and Accurate Force Map Reconstruction

Authors: Junhwi Cho, Sunggyu Bae, Junghyeon Ma et al. | Submitted: 2026-05-27 | arXiv: 2605.28468 Categories: cs.RO

Research Background: We present a hybrid robotic skin that combines electrical impedance tomography (EIT) with pneumatic tactile sensing to improve force reconstruction capability. The developed robotic skin is fabricated entirely by 3D printing and spray coating, making it affordable and easy to build.
研究背景： 在機器人學習領域，We present a hybrid robotic skin that combines electrical impedance tomography (EIT) with pneumatic tactile sensing to improve force reconstruction capability. The developed roboti

Technical Approach: For validation, we conducted load-cell indentation experiments; the results showed consistent force reconstruction across locations within a pad. Compared with an EIT-only baseline, sensitivity non-uniformity was also reduced, with the coefficient of variation decreasing from 0.31 to 0.14, indicating that the proposed approach addresses a longstanding limitation of EIT.
技術方法： 本文提出的方法：For validation, we conducted load-cell indentation experiments; the results showed consistent force reconstruction across locations within a pad. Compared with an EIT-only baseline, sensitivity non-uniformity was also reduced, with the coefficient of

Key Takeaway: These results indicate a practical path toward accurate, scalable whole-body tactile sensing in real robotic systems.
核心發現： 核心結果：These results indicate a practical path toward accurate, scalable whole-body tactile sensing in real robotic systems.

A Digital Twin Framework for Virtual Visuo-Haptic Teleoperation of Complex-Shaped Optical Microrobots

Authors: Zongcai Tan, Lan Wei, Dandan Zhang | Submitted: 2026-05-27 | arXiv: 2605.28448 Categories: cs.RO

Research Background: Optical tweezers (OT) provide piconewton-scale manipulation for delicate biomedical tasks, where visuo-haptic feedback can improve operator awareness by conveying interaction-force cues and trap-stability information. However, visuo-haptic teleoperation frameworks for complex-shaped optical microrobots remain underdeveloped, particularly in multi-trap manipulation scenarios.
研究背景： 在機器人學習領域，Optical tweezers (OT) provide piconewton-scale manipulation for delicate biomedical tasks, where visuo-haptic feedback can improve operator awareness by conveying interaction-force

Technical Approach: This paper presents a digital twin framework for virtual visuo-haptic teleoperation of complex-shaped OT-driven microrobots.
技術方法： 本文提出的方法：This paper presents a digital twin framework for virtual visuo-haptic teleoperation of complex-shaped OT-driven microrobots.

Key Takeaway: These results demonstrate the framework’s effectiveness for evaluating visuo-haptic teleoperation strategies for complex-shaped optical microrobots.
核心發現： 核心結果：These results demonstrate the framework’s effectiveness for evaluating visuo-haptic teleoperation strategies for complex-shaped optical microrobots.

Tactile-Proprioceptive Sensor Fusion for Contact Wrench Estimation in Whole-Body Physical Human-Robot Interaction

Authors: Junha Min, Junghyeon Ma, Jiwung Kwon et al. | Submitted: 2026-05-27 | arXiv: 2605.28412 Categories: cs.RO, cs.LG

Research Background: Direct physical guidance is a natural means of teaching and interacting with robots, and robotic skins make a key contribution by enabling sensitive contact sensing and localization. This paper presents a tactile-proprioceptive sensor fusion framework for natural physical human-robot interaction.
研究背景： 在機器人學習領域，Direct physical guidance is a natural means of teaching and interacting with robots, and robotic skins make a key contribution by enabling sensitive contact sensing and localizatio

Technical Approach: This paper presents a tactile-proprioceptive sensor fusion framework for natural physical human-robot interaction.
技術方法： 本文提出的方法：This paper presents a tactile-proprioceptive sensor fusion framework for natural physical human-robot interaction.

Key Takeaway: Results indicate improved sensitivity and responsiveness across diverse contact conditions compared with tactile-only and proprioceptive-only baselines, supporting tactile-proprioceptive fusion as a reliable pathway to safe, intuitive physical human-robot interaction.
核心發現： 核心結果：Results indicate improved sensitivity and responsiveness across diverse contact conditions compared with tactile-only and proprioceptive-only baselines, supporting tactile-proprioceptive fusion as a r

Safety-Critical Adaptive Impedance Control via Nonsmooth Control Barrier Functions under State and Input Constraints

Authors: Faisal Lawan, Xiaoran Han, Joaquin Carrasco et al. | Submitted: 2026-05-27 | arXiv: 2605.28367 Categories: cs.RO, eess.SY

Research Background: Safe physical interaction is critical for deploying robotic manipulators in human-robot interaction and contact-rich tasks, where uncertainty, external forces, and actuator limitations can compromise both performance and safety. We propose an online adaptive impedance control framework that enforces joint-state safety while achieving compliant interaction under uncertain dynamics.
研究背景： 在機器人學習領域，Safe physical interaction is critical for deploying robotic manipulators in human-robot interaction and contact-rich tasks, where uncertainty, external forces, and actuator limitat

Technical Approach: We propose an online adaptive impedance control framework that enforces joint-state safety while achieving compliant interaction under uncertain dynamics. The approach combines a quadratic-program-based safety filter with a novel composed position-velocity non-smooth control barrier function (NCBF), enabling joint position and velocity constraints to be enforced through a unified relative-degree-one barrier.
技術方法： 本文提出的方法：We propose an online adaptive impedance control framework that enforces joint-state safety while achieving compliant interaction under uncertain dynamics. The approach combines a quadratic-program-based safety filter with a novel composed position-ve

Key Takeaway: Simulations on a 7-DOF manipulator with severe parametric uncertainty and external interaction wrenches demonstrate safe constraint satisfaction and robust impedance tracking.
核心發現： 核心結果：Simulations on a 7-DOF manipulator with severe parametric uncertainty and external interaction wrenches demonstrate safe constraint satisfaction and robust impedance tracking.

Magnet-Based Soft Robotic Skin Using a 3D-Printed Multi-Lattice Structure and CNN-Based Tactile Super-Resolution

Authors: Yunseong Bang, Joowon Park, Suan Sim et al. | Submitted: 2026-05-27 | arXiv: 2605.28352 Categories: cs.RO

Research Background: This paper presents a magnet-based robotic skin that integrates a multilayer soft lattice with distributed Hall-effect sensor arrays and a tactile super-resolution model. External contact forces are converted to magnetic field changes by embedded permanent magnets, and the lattice spreads these changes across the sensing domain.
研究背景： 在機器人學習領域，This paper presents a magnet-based robotic skin that integrates a multilayer soft lattice with distributed Hall-effect sensor arrays and a tactile super-resolution model. External

Technical Approach: Lattice parameters are tunable, enabling joint adjustment of mechanical compliance and transduction characteristics. An implicit modeling workflow and selective laser sintering (SLS) 3D printing support rapid fabrication of conformal, high-complexity structures.
技術方法： 本文提出的方法：Lattice parameters are tunable, enabling joint adjustment of mechanical compliance and transduction characteristics. An implicit modeling workflow and selective laser sintering (SLS) 3D printing support rapid fabrication of conformal, high-complexity

Key Takeaway: This gives each sensor a large, overlapping receptive field and enables a large sensing area with minimal blind spots.
核心發現： 核心結果：This gives each sensor a large, overlapping receptive field and enables a large sensing area with minimal blind spots.

Natural Functional Gradients for Smooth Trajectory Optimization

Authors: Kisang Park, Chanwoo Kim, Kyungjae Lee et al. | Submitted: 2026-05-27 | arXiv: 2605.28202 Categories: cs.RO

Research Background: Generating collision-free and smooth motions remains a central challenge in robotic manipulation, particularly in cluttered environments and narrow passages where feasible regions are highly constrained and fragmented. We propose a trajectory optimization framework that performs geometry-aware updates directly in function space using natural functional gradients.
研究背景： 在機器人學習領域，Generating collision-free and smooth motions remains a central challenge in robotic manipulation, particularly in cluttered environments and narrow passages where feasible regions

Technical Approach: We propose a trajectory optimization framework that performs geometry-aware updates directly in function space using natural functional gradients.
技術方法： 本文提出的方法：We propose a trajectory optimization framework that performs geometry-aware updates directly in function space using natural functional gradients.

Key Takeaway: Additional results, videos, and implementation details are available at the project page: https://kisangpark.github.io/natural-functional-gradient/
核心發現： 核心結果：Additional results, videos, and implementation details are available at the project page: https://kisangpark.github.io/natural-functional-gradient/

Authors: Arissa J. Sato, Callie Y. Kim, Nathan Thomas White et al. | Submitted: 2026-05-27 | arXiv: 2605.28154 Categories: cs.HC, cs.RO

Research Background: Programming social robots is challenging for novice robot programmers due to required expertise in planning, interaction design, and programming. While large language models (LLMs) hold significant promise through code generation from natural-language descriptions, they can obscure critical elements of programming and supplant designer intent, eventually resulting in over-reliance instead of de…
研究背景： 在人機互動領域，Programming social robots is challenging for novice robot programmers due to required expertise in planning, interaction design, and programming. While large language models (LLMs)

Technical Approach: In this paper, we explore how LLM-based social-robot-programming tools can support novice robot programmers through a Research through Design (RtD) process. We designed and prototyped Robo-Blocks, a block-based programming environment that leverages LLMs to offer novice robot programmers generative scaffolding through structured narratives that connect high-level ideas to executable robot behaviors. We present design insights for the effective use of generative scaffolding and its integration…
技術方法： 本文提出的方法：In this paper, we explore how LLM-based social-robot-programming tools can support novice robot programmers through a Research through Design (RtD) process. We designed and prototyped Robo-Blocks, a block-based programming environment that leverages

Key Takeaway: While large language models (LLMs) hold significant promise through code generation from natural-language descriptions, they can obscure critical elements of programming and supplant designer intent, eventually resulting in over-reliance instead of developing programming skills.
核心發現： 核心結果：While large language models (LLMs) hold significant promise through code generation from natural-language descriptions, they can obscure critical elements of programming and supplant designer intent,

How Should We Teach Robots? A Comparison of Kinesthetic, Joystick, and Gesture-Based Teaching

Authors: Petr Vanc, Jan Kristof Behrens, Václav Hlaváč et al. | Submitted: 2026-05-27 | arXiv: 2605.28033 Categories: cs.RO

Research Background: Instructing robots from demonstrations can be done through different teaching modalities, each with different usability and performance trade-offs. This paper compares kinesthetic guidance, joystick teleoperation, and hand gestures in a user study with eight participants.
研究背景： 在機器人學習領域，Instructing robots from demonstrations can be done through different teaching modalities, each with different usability and performance trade-offs. This paper compares kinesthetic

Technical Approach: This paper compares kinesthetic guidance, joystick teleoperation, and hand gestures in a user study with eight participants.
技術方法： 本文提出的方法：This paper compares kinesthetic guidance, joystick teleoperation, and hand gestures in a user study with eight participants.

Key Takeaway: Hand-gesture teaching, although less reliable overall, performed better than expected and in some cases achieved results comparable to kinesthetic guidance.
核心發現： 核心結果：Hand-gesture teaching, although less reliable overall, performed better than expected and in some cases achieved results comparable to kinesthetic guidance.

Simultaneous Contact Selection and Planning for Contact-Rich Manipulation with Cascaded Optimization

Authors: Zhe Zhang, Xingrong Diao, Haoxiang Liang et al. | Submitted: 2026-05-27 | arXiv: 2605.27972 Categories: cs.RO

Research Background: We propose an optimization-based framework for robust contact-rich manipulation. Recent contact-implicit methods enable online hybrid planning across contact modes, allowing closed-loop manipulation for a given target state and contact location sequence of the robot and object.
研究背景： 在機器人學習領域，We propose an optimization-based framework for robust contact-rich manipulation. Recent contact-implicit methods enable online hybrid planning across contact modes, allowing closed

Technical Approach: To address these challenges, we introduce Simultaneous Contact Selection and Planning (SCSP), a cascaded optimization framework comprising Contact Selection Optimization (CSO) and Contact Planning Optimization (CPO).
技術方法： 本文提出的方法：To address these challenges, we introduce Simultaneous Contact Selection and Planning (SCSP), a cascaded optimization framework comprising Contact Selection Optimization (CSO) and Contact Planning Optimization (CPO).

Key Takeaway: Extensive simulations and real-world experiments demonstrate that SCSP produces diverse manipulation behaviors and robust control under inaccurate dynamics and perceptual noise.
核心發現： 核心結果：Extensive simulations and real-world experiments demonstrate that SCSP produces diverse manipulation behaviors and robust control under inaccurate dynamics and perceptual noise.

SANTS: A State-Adaptive Scheduler for World Action Models

Authors: Yirui Sun, Guangyu Zhuge, Keliang Liu et al. | Submitted: 2026-05-27 | arXiv: 2605.27947 Categories: cs.RO

Research Background: World Action Models (WAMs) improve robot manipulation by using video-based future representations to condition action generation. In pixel-space WAMs, however, the best action condition is not necessarily the fully denoised video.
研究背景： 在機器人學習領域，World Action Models (WAMs) improve robot manipulation by using video-based future representations to condition action generation. In pixel-space WAMs, however, the best action cond

Technical Approach: We introduce State-Adaptive Noise Trajectory Scheduler (SANTS), a lightweight scheduler for video-to-action diffusion policies.
技術方法： 本文提出的方法：We introduce State-Adaptive Noise Trajectory Scheduler (SANTS), a lightweight scheduler for video-to-action diffusion policies.

Key Takeaway: These results indicate that adaptive selection along the video noise trajectory can preserve the control benefits of WAM-style future reasoning while removing much of its redundant inference cost.
核心發現： 核心結果：These results indicate that adaptive selection along the video noise trajectory can preserve the control benefits of WAM-style future reasoning while removing much of its redundant inference cost.

LEIA: Learned Environment for Interactive Architected Materials

Authors: Haiqian Yang, Yuan Cao, Markus J. Buehler | Submitted: 2026-05-27 | arXiv: 2605.28368 Categories: cs.LG, cond-mat.mtrl-sci, physics.app-ph

Research Background: World models have enabled interactive exploration of game environments and robotic manipulation, but physical engineering remains beyond their reach: real materials exhibit nonlinear constitutive laws, carry history-dependent internal state, undergo inertial dynamics, and may possess hierarchical structures spanning multiple length scales. We present LEIA (Learned Environment for Interactive Ar…
研究背景： 在機器學習與機器人領域，World models have enabled interactive exploration of game environments and robotic manipulation, but physical engineering remains beyond their reach: real materials exhibit nonline

Technical Approach: We present LEIA (Learned Environment for Interactive Architected materials), a world model that lets engineers apply boundary conditions step by step and observe the resulting deformation and stress fields in real time. We introduce MicroPlate, a benchmark of architected plates spanning two regimes of microstructure modeling: architected lattices that resolve microstructure explicitly through three-dimensional geometry, and a homogeneous plate where microstructural change is modeled implicitl…
技術方法： 本文提出的方法：We present LEIA (Learned Environment for Interactive Architected materials), a world model that lets engineers apply boundary conditions step by step and observe the resulting deformation and stress fields in real time. We introduce MicroPlate, a ben

Key Takeaway: Finally, we demonstrate that LEIA enables efficient candidate generation and ranking for fast surrogate-guided search for de novo designs of architected materials, with stress-accurate candidate ranking validated by finite element ground truth.
核心發現： 核心結果：Finally, we demonstrate that LEIA enables efficient candidate generation and ranking for fast surrogate-guided search for de novo designs of architected materials, with stress-accurate candidate ranki

ClothTransformer: Unified Latent-Space Transformers for Scalable Cloth Simulation

Authors: Yu Zhang, Yidi Shao, Wenqi Ouyang et al. | Submitted: 2026-05-27 | arXiv: 2605.27852 Categories: cs.GR, cs.CV

Research Background: Unified and scalable Transformers have recently achieved remarkable success in modeling diverse phenomena traditionally associated with computer graphics, such as 3D visual effects, rendering processes, and motion in videos. In this work, we take a step further by investigating whether modern Transformer techniques can tackle the challenging task of cloth simulation.
研究背景： 在機器人 AI領域，Unified and scalable Transformers have recently achieved remarkable success in modeling diverse phenomena traditionally associated with computer graphics, such as 3D visual effects

Technical Approach: In this work, we take a step further by investigating whether modern Transformer techniques can tackle the challenging task of cloth simulation. To this end, we present ClothTransformer, a framework that reformulates cloth simulation as autoregressive sequence modeling in a learned latent space. Our approach addresses these limitations through three contributions: (1) a unified Transformer architecture that handles diverse scenarios — body-driven garments, robotic manipulation, and free-fall…
技術方法： 本文提出的方法：In this work, we take a step further by investigating whether modern Transformer techniques can tackle the challenging task of cloth simulation. To this end, we present ClothTransformer, a framework that reformulates cloth simulation as autoregressiv

Key Takeaway: Our approach addresses these limitations through three contributions: (1) a unified Transformer architecture that handles diverse scenarios — body-driven garments, robotic manipulation, and free-fall collisions — under a single model and achieves approximately $4$ — $9 \times$ lower error than …
核心發現： 核心結果：Our approach addresses these limitations through three contributions: (1) a unified Transformer architecture that handles diverse scenarios — body-driven garments, robotic manipulation, and free-fall

Any-ttach: Quick End-effector Swapping Enables Manipulation Dexterity with Simplicity

Authors: Weizhe Ni, Jinzhou Li, Haoyu Li et al. | Submitted: 2026-05-28 | arXiv: 2605.30569 Categories: cs.RO

Research Background: Robotic manipulation dexterity is often pursued by building increasingly complex high-DoF multifingered hands. While many robotic hands are designed to replicate human morphology, the functional role of human hands suggests a different perspective: much of their complexity may exist to enable tool use and tool making.
研究背景： 在機器人學習領域，Robotic manipulation dexterity is often pursued by building increasingly complex high-DoF multifingered hands. While many robotic hands are designed to replicate human morphology,

Technical Approach: The system supports diverse tools and end-effector modules, including daily tools, articulated tools such as scissors, Fin Ray fingers, and a low-cost anthropomorphic hand, through the same shared interface. Our experiments show that Any-ttach improves tool-swapping reliability, increases demonstration efficiency, reduces tool-pose variability, and supports diverse tool-use skills.
技術方法： 本文提出的方法：The system supports diverse tools and end-effector modules, including daily tools, articulated tools such as scissors, Fin Ray fingers, and a low-cost anthropomorphic hand, through the same shared interface. Our experiments show that Any-ttach improv

Key Takeaway: These results suggest that robots can expand manipulation capability not only through more complex end-effectors, but also through rapidly exchangeable tools and end-effector modules.
核心發現： 核心結果：These results suggest that robots can expand manipulation capability not only through more complex end-effectors, but also through rapidly exchangeable tools and end-effector modules.

Physics-informed Goal-Conditioned Reinforcement Learning under Hybrid Contact Dynamics

Authors: Vittorio Giammarino, Anastasios Manganaris, Ahmed H. Qureshi | Submitted: 2026-05-28 | arXiv: 2605.30503 Categories: cs.RO, eess.SY, stat.ML

Research Background: Learning to reach arbitrary goals from sparse feedback requires agents to infer a rich notion of reachability across state—goal pairs. Goal-conditioned reinforcement learning (GCRL) tackles this challenge by learning policies that generalize across goals, but this generalization becomes increasingly difficult as the underlying dynamics become high-dimensional, hybrid, or contact-dependent.
研究背景： 在機器人學習領域，Learning to reach arbitrary goals from sparse feedback requires agents to infer a rich notion of reachability across state—goal pairs. Goal-conditioned reinforcement learning (GCR

Technical Approach: In this work, we show that these structural properties can cause existing Pi-GCRL methods to degrade when applied naively to contact-rich manipulation. Motivated by this analysis, we introduce contact-aware and hierarchical formulations that apply physics-informed inductive biases selectively across the manipulation problem.
技術方法： 本文提出的方法：In this work, we show that these structural properties can cause existing Pi-GCRL methods to degrade when applied naively to contact-rich manipulation. Motivated by this analysis, we introduce contact-aware and hierarchical formulations that apply ph

Key Takeaway: Our results provide a principled step toward extending Pi-GCRL to contact-rich manipulation.
核心發現： 核心結果：Our results provide a principled step toward extending Pi-GCRL to contact-rich manipulation.

LLM-Guided Future Hypotheses for Horizon-Aware Exploration in Multi-Step Robot Manipulation

Authors: Mohammad Khoshnazar, Andrew Melnik, Michael Beetz | Submitted: 2026-05-28 | arXiv: 2605.29864 Categories: cs.RO

Research Background: Multi-step robot manipulation requires acting under uncertainty about how the scene will evolve, making exploration and policy adaptation challenging. We study whether short-horizon, task-consistent future videos can provide useful structured priors for control and reinforcement-learning fine-tuning.
研究背景： 在機器人學習領域，Multi-step robot manipulation requires acting under uncertainty about how the scene will evolve, making exploration and policy adaptation challenging. We study whether short-horizo

Technical Approach: We instantiate this future-conditioning interface primarily with BC and BC+RL, and compare against a future-conditioned Streaming Flow Policy (SFP) baseline on RoboCasa and CALVIN under NoFuture, GTFuture, GenFuture, and WrongFuture. Generated futures improve performance over no-future conditioning, while mismatched futures degrade it, and our BC+RL instantiation achieves the strongest overall results.
技術方法： 本文提出的方法：We instantiate this future-conditioning interface primarily with BC and BC+RL, and compare against a future-conditioned Streaming Flow Policy (SFP) baseline on RoboCasa and CALVIN under NoFuture, GTFuture, GenFuture, and WrongFuture. Generated future

Key Takeaway: These results suggest that short-horizon future videos can serve as useful structured priors for exploration and policy adaptation under imperfect future predictions.
核心發現： 核心結果：These results suggest that short-horizon future videos can serve as useful structured priors for exploration and policy adaptation under imperfect future predictions.

VE2VF: Vision-Enabled to Vision-Free Distillation via Real-world Reinforcement Learning for Robust Contact-Rich Manipulation

Authors: Victor Kowalski, Chengxi Li, Dongheui Lee | Submitted: 2026-05-28 | arXiv: 2605.29564 Categories: cs.RO

Research Background: When using reinforcement learning (RL) for contact-rich robotic manipulation, vision can provide task-relevant information that accelerates learning beyond what proprioception alone can achieve. However, vision-enabled policies tend to overfit to the visual conditions seen during training, limiting their robustness and transferability.
研究背景： 在機器人學習領域，When using reinforcement learning (RL) for contact-rich robotic manipulation, vision can provide task-relevant information that accelerates learning beyond what proprioception alon

Technical Approach: We present a human-in-the-loop RL framework that employs teacher-student distillation to achieve robust performance across multiple task variants, trained entirely in the real world without requiring domain randomization or data augmentation. On the real-world NIST assembly benchmark board, our approach achieves 95% overall success after approximately 50 minutes of training on 3 representative tasks, including robust generalization to 8 unseen task variants.
技術方法： 本文提出的方法：We present a human-in-the-loop RL framework that employs teacher-student distillation to achieve robust performance across multiple task variants, trained entirely in the real world without requiring domain randomization or data augmentation. On the

Key Takeaway: We demonstrate that the resulting policies outperform baselines in both robustness and adaptability.
核心發現： 核心結果：We demonstrate that the resulting policies outperform baselines in both robustness and adaptability.

Decentralized LLM-Driven Coordination of Acoustic Robots for Contactless Object Manipulation

Authors: Yingying Wang, Narsimlu Kemsaram, Sriram Subramanian | Submitted: 2026-05-28 | arXiv: 2605.29378 Categories: cs.RO

Research Background: Natural language interfaces can simplify interaction with multi-robot systems, especially when non-expert users need to issue high-level commands. Acoustic manipulation using ultrasonic phased arrays also enables contactless object handling for applications such as healthcare, laboratory automation, and precision transport.
研究背景： 在機器人學習領域，Natural language interfaces can simplify interaction with multi-robot systems, especially when non-expert users need to issue high-level commands. Acoustic manipulation using ultra

Technical Approach: This paper presents a decentralized framework for natural language-driven coordination of acoustic robots for contactless object manipulation.
技術方法： 本文提出的方法：This paper presents a decentralized framework for natural language-driven coordination of acoustic robots for contactless object manipulation.

Key Takeaway: These results show that natural language commands can be transformed into distributed robot actions for contactless manipulation, highlighting the potential of LLM-driven automation for human-robot interaction in distributed robotic systems.
核心發現： 核心結果：These results show that natural language commands can be transformed into distributed robot actions for contactless manipulation, highlighting the potential of LLM-driven automation for human-robot in

MonoDuo: Using One Robot Arm to Learn Bimanual Policies

Authors: Sandeep Bajamahal, Lawrence Yunliang Chen, Toru Lin et al. | Submitted: 2026-05-28 | arXiv: 2605.29298 Categories: cs.RO

Research Background: Bimanual coordination is essential for many real-world manipulation tasks, yet learning bimanual robot policies is limited by the scarcity of bimanual robots and datasets. Single-arm robots, however, are widely available in research labs.
研究背景： 在機器人學習領域，Bimanual coordination is essential for many real-world manipulation tasks, yet learning bimanual robot policies is limited by the scarcity of bimanual robots and datasets. Single-a

Technical Approach: We present MonoDuo, a framework for learning bimanual manipulation policies using single-arm robot demonstrations paired with human collaboration.
技術方法： 本文提出的方法：We present MonoDuo, a framework for learning bimanual manipulation policies using single-arm robot demonstrations paired with human collaboration.

Key Takeaway: With only 25 target robot demonstrations, few-shot finetuning further boosts success rates by 65-70% over training from scratch, demonstrating MonoDuo’s effectiveness in efficiently transferring knowledge from single-arm robot data to bimanual robot policies.
核心發現： 核心結果：With only 25 target robot demonstrations, few-shot finetuning further boosts success rates by 65-70% over training from scratch, demonstrating MonoDuo’s effectiveness in efficiently transferring knowl

Plan, Don’t Pose: Long Composite Motion Generation with Text-Aligned BFM

Authors: Nikolay Shvetsov, Maksim Bobrin, Nazar Buzun et al. | Submitted: 2026-05-28 | arXiv: 2605.29906 Categories: cs.LG

Research Background: Text-to-motion (T2M) generation has broad applications in character animation, virtual avatars, and human-robot interaction. Existing methods typically generate pose trajectories or motion tokens directly from language, forcing a single model to handle semantic interpretation, long-horizon structure, and low-level physical realization.
研究背景： 在機器學習與機器人領域，Text-to-motion (T2M) generation has broad applications in character animation, virtual avatars, and human-robot interaction. Existing methods typically generate pose trajectories o

Technical Approach: We propose Text2BFM, the first framework that aligns natural language with pretrained Behavioral Foundation Models (BFMs) for T2M generation without relying on heavy end-to-end motion generators.
技術方法： 本文提出的方法：We propose Text2BFM, the first framework that aligns natural language with pretrained Behavioral Foundation Models (BFMs) for T2M generation without relying on heavy end-to-end motion generators.

Key Takeaway: By decoupling semantic planning from motion execution, Text2BFM achieves efficient, robust T2M generation and strong performance on long, compositional textual descriptions.
核心發現： 核心結果：By decoupling semantic planning from motion execution, Text2BFM achieves efficient, robust T2M generation and strong performance on long, compositional textual descriptions.

Dex2HOI: Dexterous Bimanual Two-Object Interaction Generation

Authors: Chrysa Pratikaki, Pablo Ruiz-Ponce, Jiankang Deng et al. | Submitted: 2026-05-28 | arXiv: 2605.30444 Categories: cs.CV

Research Background: Recent advances in 4D Human-Object Interaction (HOI) generation have enabled increasingly realistic motion synthesis, particularly for single-object manipulation. Yet current research overlooks an inherent property of human behavior: people naturally coordinate both hands and manipulate multiple objects simultaneously.
研究背景： 在電腦視覺與機器人領域，Recent advances in 4D Human-Object Interaction (HOI) generation have enabled increasingly realistic motion synthesis, particularly for single-object manipulation. Yet current resea

Technical Approach: To address this gap, we present Dex2HOI, a unified diffusion model for single- and two-object HOI synthesis from text. To synthesize the final motion, we introduce a Motion Fusion Network integrated with novel hand-relative object representations and contact-aware conditioning applied across the whole sequence.
技術方法： 本文提出的方法：To address this gap, we present Dex2HOI, a unified diffusion model for single- and two-object HOI synthesis from text. To synthesize the final motion, we introduce a Motion Fusion Network integrated with novel hand-relative object representations and

Key Takeaway: Extensive evaluation on both single- and two-object benchmarks demonstrates state-of-the-art quantitative results, marking a step beyond conventional single-object HOI generation and toward expressive multi-object manipulation.
核心發現： 核心結果：Extensive evaluation on both single- and two-object benchmarks demonstrates state-of-the-art quantitative results, marking a step beyond conventional single-object HOI generation and toward expressive

Geometry-Guided Modeling of Foundation Features Enables Generalizable Object Shape Deformation Learning

Authors: Yiyao Ma, Kai Chen, Zhongxiang Zhou et al. | Submitted: 2026-05-28 | arXiv: 2605.29661 Categories: cs.CV

Research Background: Monocular 3D shape recovery is fundamental to geometric understanding, yet achieving robust generalization across arbitrary viewpoints and unseen object categories remains a significant challenge. In this paper, we present a generalizable deformation learning framework that reconstructs 3D objects by explicitly deforming a category-level shape template to match the target observation.
研究背景： 在電腦視覺與機器人領域，Monocular 3D shape recovery is fundamental to geometric understanding, yet achieving robust generalization across arbitrary viewpoints and unseen object categories remains a signif

Technical Approach: In this paper, we present a generalizable deformation learning framework that reconstructs 3D objects by explicitly deforming a category-level shape template to match the target observation. To address complex shape variations between the template and the target, we introduce a geometry-guided feature modeling mechanism. Furthermore, to bridge the disparity between the fixed template and arbitrary target views, we propose a view-adaptive feature aggregation module.
技術方法： 本文提出的方法：In this paper, we present a generalizable deformation learning framework that reconstructs 3D objects by explicitly deforming a category-level shape template to match the target observation. To address complex shape variations between the template an

Key Takeaway: Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods in handling large shape variations and diverse viewpoints, exhibiting strong generalization to novel categories and effectively supporting downstream real-world dexterous robotic manipulation ta…
核心發現： 核心結果：Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods in handling large shape variations and diverse viewpoints, exhibiting strong generalization to no

Constrained Whole-Body Tracking for Humanoid Robots

Authors: Daniel Morton, Pranit Mohnot, Marco Pavone | Submitted: 2026-05-29 | arXiv: 2606.00374 Categories: cs.RO

Research Background: Recent advances in reinforcement learning (RL) have demonstrated impressive whole-body agility for humanoid robots, yet ensuring safety and satisfying constraints — particularly those specified after training — remains a challenge. Towards this goal, we present ConstrainedMimic, a control framework that leverages whole-body kinematics and dynamics for real-time constraint enforcement within R…
研究背景： 在機器人學習領域，Recent advances in reinforcement learning (RL) have demonstrated impressive whole-body agility for humanoid robots, yet ensuring safety and satisfying constraints — particularly t

Technical Approach: Towards this goal, we present ConstrainedMimic, a control framework that leverages whole-body kinematics and dynamics for real-time constraint enforcement within RL tracking policies. Our method is fully differentiable, runs on CPU, GPU, and TPU, and can be deployed at up to 300-500 Hz.
技術方法： 本文提出的方法：Towards this goal, we present ConstrainedMimic, a control framework that leverages whole-body kinematics and dynamics for real-time constraint enforcement within RL tracking policies. Our method is fully differentiable, runs on CPU, GPU, and TPU, and

Key Takeaway: In whole-body motion-tracking and teleoperation experiments on a (simulated) Unitree G1 with a learned policy, we demonstrate collision avoidance (both with the robot body and external obstacles), joint limits, and center of mass stability constraints.
核心發現： 核心結果：In whole-body motion-tracking and teleoperation experiments on a (simulated) Unitree G1 with a learned policy, we demonstrate collision avoidance (both with the robot body and external obstacles), joi

StressDream: Steering Video World Models for Robust Policy Evaluation and Improvement

Authors: Junwon Seo, Sushant Veer, Ran Tian et al. | Submitted: 2026-05-29 | arXiv: 2606.00267 Categories: cs.CV, cs.AI, cs.LG, cs.RO

Research Background: Video world models (WMs) have shown promise for policy evaluation and improvement by imagining realistic future observations conditioned on ego-robot actions. While WMs can model distributions over futures, policy evaluation and improvement typically rely on nominal imaginations, which can miss high-impact outcomes of robot actions unless prohibitively many samples are drawn.
研究背景： 在電腦視覺與機器人領域，Video world models (WMs) have shown promise for policy evaluation and improvement by imagining realistic future observations conditioned on ego-robot actions. While WMs can model d

Technical Approach: To enable robust policy evaluation and improvement over WM imaginations, we propose StressDream, which steers imaginations toward high-impact yet plausible outcomes specified at inference time by optimizing the initial noise of diffusion-based WMs.
技術方法： 本文提出的方法：To enable robust policy evaluation and improvement over WM imaginations, we propose StressDream, which steers imaginations toward high-impact yet plausible outcomes specified at inference time by optimizing the initial noise of diffusion-based WMs.

Key Takeaway: Video results are available at https://junwon.me/StressDream/.
核心發現： 核心結果：Video results are available at https://junwon.me/StressDream/.

Learning Terrain-Aware Whole-Body Control for Perceptive Legged Loco-Manipulation

Authors: Sikai Guo, Yudong Zhong, Guoyang Zhao et al. | Submitted: 2026-05-29 | arXiv: 2605.31343 Categories: cs.RO

Research Background: Legged manipulators integrate exceptional terrain adaptability along with mobile manipulation capabilities, which make them highly promising for deployment in human-centric environments. By coordinating the control of both legs and arms, a whole-body controller can significantly expand the operational workspace of legged manipulators.
研究背景： 在機器人學習領域，Legged manipulators integrate exceptional terrain adaptability along with mobile manipulation capabilities, which make them highly promising for deployment in human-centric environ

Technical Approach: In this paper, we introduce TA-WBC, a terrain-aware whole-body control framework for legged manipulators, which features a novel RL-based unified policy tailored to whole-body loco-manipulation tasks in various terrains. Furthermore, to facilitate stable cross-terrain loco-manipulation, we propose a novel end-effector sampling method based on the foot contact plane, decoupling manipulation target from base fluctuations.
技術方法： 本文提出的方法：In this paper, we introduce TA-WBC, a terrain-aware whole-body control framework for legged manipulators, which features a novel RL-based unified policy tailored to whole-body loco-manipulation tasks in various terrains. Furthermore, to facilitate st

Key Takeaway: By coordinating the control of both legs and arms, a whole-body controller can significantly expand the operational workspace of legged manipulators.
核心發現： 核心結果：By coordinating the control of both legs and arms, a whole-body controller can significantly expand the operational workspace of legged manipulators.

Before Parc Fermé: RL-Time Pruning for Efficient Embodied LLMs in Autonomous Driving

Authors: Luca Benfenati, Ali Azimi, Matteo Risso et al. | Submitted: 2026-05-29 | arXiv: 2605.31256 Categories: cs.RO

Research Background: Embodied Large Language Models (LLMs) are increasingly used as reasoning modules in robotic control pipelines to improve human-robot interaction, but their memory and generation latency make real-time deployment difficult. Pruning can reduce these costs, but for controllers that undergo multiple pre- and post-training phases, the crucial question is not only how much to prune, but when pruning …
研究背景： 在機器人學習領域，Embodied Large Language Models (LLMs) are increasingly used as reasoning modules in robotic control pipelines to improve human-robot interaction, but their memory and generation la

Technical Approach: In this work, we propose Before Parc Fermé (BPF), a pruning strategy performed during RL that compresses embodied LLM controllers while they are still being optimized for closed-loop behavior. We propose two variants: BPF-RL, which performs iterative pruning during RL by removing part of the model at predefined training intervals, and BPF-SFT/RL, which first prunes part of the model structure during SFT and then further compresses it during RL using the same iterative strategy as BPF-RL until…
技術方法： 本文提出的方法：In this work, we propose Before Parc Fermé (BPF), a pruning strategy performed during RL that compresses embodied LLM controllers while they are still being optimized for closed-loop behavior. We propose two variants: BPF-RL, which performs iterative

Key Takeaway: On the Jetson AGX Orin mounted on the target robotic platform, the compact models improve decode throughput by up to $27%$ .
核心發現： 核心結果：On the Jetson AGX Orin mounted on the target robotic platform, the compact models improve decode throughput by up to $27%$ .

Two Degree-of-Freedom Vibratory Transport in a Grasp

Authors: C. L. Yako, Shenli Yuan, Kenneth Salisbury | Submitted: 2026-05-29 | arXiv: 2605.30780 Categories: cs.RO

Research Background: In this paper, we use asymmetric vibrations to demonstrate two degree-of-freedom (DoF) in-hand manipulation of grasped parts. The asymmetric vibrations are achieved through closed-loop position control of a moving surface, which applies a periodic stick-slip waveform to the part to be manipulated.
研究背景： 在機器人學習領域，In this paper, we use asymmetric vibrations to demonstrate two degree-of-freedom (DoF) in-hand manipulation of grasped parts. The asymmetric vibrations are achieved through closed-

Technical Approach: The theoretical trends are then validated using an experimental setup where the squeeze force is controlled and part motion is recorded by a high-resolution encoder. We also develop a 2-DoF vibratory surface capable of translation in one direction and rotation about the surface normal.
技術方法： 本文提出的方法：The theoretical trends are then validated using an experimental setup where the squeeze force is controlled and part motion is recorded by a high-resolution encoder. We also develop a 2-DoF vibratory surface capable of translation in one direction an

Key Takeaway: Using two of these 2-DoF surfaces in a parallel jaw gripper configuration, we bidirectionally translate and rotate a variety of grasped parts, as well as demonstrate that the same waveform trends for translation also persist for in-plane rotation.
核心發現： 核心結果：Using two of these 2-DoF surfaces in a parallel jaw gripper configuration, we bidirectionally translate and rotate a variety of grasped parts, as well as demonstrate that the same waveform trends for

Object-Informed Model Predictive Path Integral Control for Non-Prehensile Robot Manipulation

Authors: Nikola Raicevic, Bharath Raam Radhakrishnan, Chenbin Yu et al. | Submitted: 2026-05-29 | arXiv: 2605.30778 Categories: cs.RO

Research Background: Long-horizon planning for non-prehensile robot manipulation is challenging due to underactuated and discontinuous interactions. We propose a hierarchical formulation of model predictive path integral (MPPI) control that guides robot-level planning with a separately computed object-level plan to achieve efficient long-horizon prediction.
研究背景： 在機器人學習領域，Long-horizon planning for non-prehensile robot manipulation is challenging due to underactuated and discontinuous interactions. We propose a hierarchical formulation of model predi

Technical Approach: We propose a hierarchical formulation of model predictive path integral (MPPI) control that guides robot-level planning with a separately computed object-level plan to achieve efficient long-horizon prediction. We evaluate our method in both simulation and hardware using a 6-DoF xArm6 manipulator to perform object pushing tasks in which the target object must reach a goal while avoiding static obstacles, necessitating non-myopic reasoning.
技術方法： 本文提出的方法：We propose a hierarchical formulation of model predictive path integral (MPPI) control that guides robot-level planning with a separately computed object-level plan to achieve efficient long-horizon prediction. We evaluate our method in both simulati

Key Takeaway: We evaluate our method in both simulation and hardware using a 6-DoF xArm6 manipulator to perform object pushing tasks in which the target object must reach a goal while avoiding static obstacles, necessitating non-myopic reasoning.
核心發現： 核心結果：We evaluate our method in both simulation and hardware using a 6-DoF xArm6 manipulator to perform object pushing tasks in which the target object must reach a goal while avoiding static obstacles, nec

Polyphony: Diffusion-based Dual-Hand Action Segmentation with Alternating Vision Transformer and Semantic Conditioning

Authors: Hao Zheng, Hu Wang, Tiantian Zheng et al. | Submitted: 2026-05-29 | arXiv: 2605.31115 Categories: cs.CV

Research Background: Dual-hand action segmentation, densely predicting actions for both hands from untrimmed videos, is essential for understanding complex bimanual activities. However, it poses several unique challenges: complex inter-hand dependencies, visual asymmetry between hands, representation conflicts where the dominant hand monopolizes gradients, and semantic ambiguity in fine-grained actions.
研究背景： 在電腦視覺與機器人領域，Dual-hand action segmentation, densely predicting actions for both hands from untrimmed videos, is essential for understanding complex bimanual activities. However, it poses severa

Technical Approach: We propose Polyphony, a three-stage method to address these challenges through: (1) an Alternating Dual-Hand Vision Transformer that alternates training between left- and right-hand mini-batches to ensure balanced gradient contributions from both hands while sharing a spatio-temporal encoder; (2) Semantic Feature Conditioning that aligns visual features with structured, compositional action descriptions to enhance discrimination of semantically similar actions; and (3) Diffusion-Based Segment…
技術方法： 本文提出的方法：We propose Polyphony, a three-stage method to address these challenges through: (1) an Alternating Dual-Hand Vision Transformer that alternates training between left- and right-hand mini-batches to ensure balanced gradient contributions from both han

Key Takeaway: Polyphony achieves state-of-the-art on both dual-hand datasets (HA-ViD, ATTACH) with improvements up to 16.8 points, and on the single-stream Breakfast dataset (82.5%), outperforming the prior best method that uses a 12x larger backbone.
核心發現： 核心結果：Polyphony achieves state-of-the-art on both dual-hand datasets (HA-ViD, ATTACH) with improvements up to 16.8 points, and on the single-stream Breakfast dataset (82.5%), outperforming the prior best me

Global-Local Attention Decomposition for Terrain Encoding in Humanoid Perceptive Locomotion

Authors: Shengcheng Fu, Yang Zhang, Zhanxiang Cao et al. | Submitted: 2026-05-30 | arXiv: 2606.00637 Categories: cs.RO

Research Background: Although reinforcement learning has significantly advanced humanoid locomotion, perceptive policies still struggle on sparse-foothold terrain and constrained environments. Success in these scenarios requires both broad terrain awareness and precise foothold selection, two perceptual roles that conventional encoders often entangle.
研究背景： 在機器人學習領域，Although reinforcement learning has significantly advanced humanoid locomotion, perceptive policies still struggle on sparse-foothold terrain and constrained environments. Success

Technical Approach: To address this challenge, we propose Global-Local Attention Decomposition (GLAD) for terrain encoding in humanoid locomotion.
技術方法： 本文提出的方法：To address this challenge, we propose Global-Local Attention Decomposition (GLAD) for terrain encoding in humanoid locomotion.

Key Takeaway: In real-world deployment on a Unitree G1 humanoid robot using onboard LiDAR, the proposed method achieves robust zero-shot sim-to-real transfer across diverse sparse-foothold and obstacle-rich domains.
核心發現： 核心結果：In real-world deployment on a Unitree G1 humanoid robot using onboard LiDAR, the proposed method achieves robust zero-shot sim-to-real transfer across diverse sparse-foothold and obstacle-rich domains

Adaptive PD Gains for Energy-Conscious Control in Physical Human-Robot Interaction

Authors: Danyal Saqib, Francisco Andrade Chavez, Marie Charbonneau | Submitted: 2026-05-30 | arXiv: 2606.00459 Categories: cs.RO, eess.SY

Research Background: Compliant force or torque control are approaches often investigated to achieve safe physical human-robot interaction (pHRI). However, these approaches have limitations.
研究背景： 在機器人學習領域，Compliant force or torque control are approaches often investigated to achieve safe physical human-robot interaction (pHRI). However, these approaches have limitations.

Technical Approach: Such approaches aim to achieve safe pHRI by limiting the mechanical energy of the robot. Current schemes leveraging an energy-based approach tend to have a complex implementation, and some may require further stability verification.
技術方法： 本文提出的方法：Such approaches aim to achieve safe pHRI by limiting the mechanical energy of the robot. Current schemes leveraging an energy-based approach tend to have a complex implementation, and some may require further stability verification.

Key Takeaway: We hence propose an adaptive proportional-derivative (PD) controller that can limit a robot’s energy under any given limit to achieve safe pHRI.
核心發現： 核心結果：We hence propose an adaptive proportional-derivative (PD) controller that can limit a robot’s energy under any given limit to achieve safe pHRI.

S2M-Trek: From Single to Multi-Sphere Transport via Per-Frame Deep Sets on a Wheel-Legged Robot

Authors: Zong Chen, Xuebin Li, Jinpeng Xiao et al. | Submitted: 2026-05-31 | arXiv: 2606.01332 Categories: cs.RO

Research Background: We study the problem of scaling dynamic loco-manipulation from a single free-rolling sphere to multiple spheres transported simultaneously on the back of a wheel-legged quadruped, without fences, grippers, or mechanical stops. Multiple identical free-rolling spheres form an unordered set with no persistent identity: their ordering may change independently at each history frame, creating a \emph…
研究背景： 在機器人學習領域，We study the problem of scaling dynamic loco-manipulation from a single free-rolling sphere to multiple spheres transported simultaneously on the back of a wheel-legged quadruped,

Technical Approach: We propose \textbf{Per-Frame Deep Sets (\PFDS)}, which performs permutation-invariant pooling within each history frame before temporal readout; we prove that \PFDS is $\Gframe$ -invariant and universally approximates continuous $\Gframe$ -invariant policies.
技術方法： 本文提出的方法：We propose \textbf{Per-Frame Deep Sets (\PFDS)}, which performs permutation-invariant pooling within each history frame before temporal readout; we prove that \PFDS is $\Gframe$ -invariant and universally approximates continuous $\Gframe$ -invariant po

Key Takeaway: We show that this symmetry mismatch leads to a concrete failure mode in curriculum-based reinforcement learning.
核心發現： 核心結果：We show that this symmetry mismatch leads to a concrete failure mode in curriculum-based reinforcement learning.

Authors: Zijia Chen, Yuenan Hou, Xinhua Jiang et al. | Submitted: 2026-05-31 | arXiv: 2606.01047 Categories: cs.RO

Research Background: Robotic manipulation requires the effective integration of heterogeneous inputs, including visual observations, language instructions, and trajectory representations, to generate accurate actions. Existing transformer-based policies typically process these heterogeneous modalities within a shared parameter space, which often leads to modality interference and inefficient representation learning…
研究背景： 在機器人學習領域，Robotic manipulation requires the effective integration of heterogeneous inputs, including visual observations, language instructions, and trajectory representations, to generate a

Technical Approach: In this work, we propose MATE (Multi-ModAl TrajEctory Policies), a novel trajectory prediction framework built upon MoE. Specifically, we introduce a Multi-Modal MoE architecture to achieve fine-grained sub-token feature decoupling, and design a cross-modal cosine router for stable and scale-invariant expert assignment across heterogeneous modalities.
技術方法： 本文提出的方法：In this work, we propose MATE (Multi-ModAl TrajEctory Policies), a novel trajectory prediction framework built upon MoE. Specifically, we introduce a Multi-Modal MoE architecture to achieve fine-grained sub-token feature decoupling, and design a cros

Key Takeaway: It achieves a 4.75% improvement in average success rate over the trajectory-guided counterpart.
核心發現： 核心結果：It achieves a 4.75% improvement in average success rate over the trajectory-guided counterpart.

$τ_{0}$ -WM: A Unified Video-Action World Model for Robotic Manipulation

Authors: Pengfei Zhou, Shengcong Chen, Di Chen et al. | Submitted: 2026-05-31 | arXiv: 2606.01027 Categories: cs.RO

Research Background: Robotic manipulation requires models that generate executable actions while anticipating and evaluating their future consequences before physical execution. We present $τ_{0}$ -World Model ( $τ_{0}$ -WM), a unified video-action world model that integrates policy learning, video prediction, and action evaluation within a single future-predictive framework.
研究背景： 在機器人學習領域，Robotic manipulation requires models that generate executable actions while anticipating and evaluating their future consequences before physical execution. We present $τ_{0}$ -World

Technical Approach: We present $τ_{0}$ -World Model ( $τ_{0}$ -WM), a unified video-action world model that integrates policy learning, video prediction, and action evaluation within a single future-predictive framework.
技術方法： 本文提出的方法：We present $τ_{0}$ -World Model ( $τ_{0}$ -WM), a unified video-action world model that integrates policy learning, video prediction, and action evaluation within a single future-predictive framework.

Key Takeaway: On challenging long-horizon and fine-grained robotic manipulation tasks, $τ_{0}$ -WM shows superior performance over other relevant baselines.
核心發現： 核心結果：On challenging long-horizon and fine-grained robotic manipulation tasks, $τ_{0}$ -WM shows superior performance over other relevant baselines.

Closing the Loop in Teleoperation: Episode-Level Data Quality Assessment and Feedback for High-Quality Demonstration Collection

Authors: Gokul Narayanan, Yash Shahapurkar, Melih Erdogan et al. | Submitted: 2026-05-25 | arXiv: 2605.26349 Categories: cs.RO

Research Background: Industrial automation is at a pivotal moment, as Physical AI is driving a transition from rigid, hand-engineered automation systems toward more flexible and adaptive systems. This shift has created a growing demand for large-scale, real-world robot demonstration data, making teleoperation an increasingly important mechanism for data collection.
研究背景： 在機器人學習領域，Industrial automation is at a pivotal moment, as Physical AI is driving a transition from rigid, hand-engineered automation systems toward more flexible and adaptive systems. This

Technical Approach: We present a Data Quality Assessment and Feedback (DQAF) framework that closes the loop in teleoperation by providing immediate post-episode feedback grounded in semantic task progress and robot telemetry.
技術方法： 本文提出的方法：We present a Data Quality Assessment and Feedback (DQAF) framework that closes the loop in teleoperation by providing immediate post-episode feedback grounded in semantic task progress and robot telemetry.

Key Takeaway: In the pilot study with three novice operators across two manipulation tasks, the operator who received the systems immediate, automated post-episode feedback improved faster than those who did not, producing higher-quality demonstrations sooner.
核心發現： 核心結果：In the pilot study with three novice operators across two manipulation tasks, the operator who received the systems immediate, automated post-episode feedback improved faster than those who did not, p

SafetyRepro: Configuration-Conditional Rank Instability on Alignment Benchmarks

Authors: Yanhang Li, Zhichao Fan, Zexin Zhuang | Submitted: 2026-05-25 | arXiv: 2605.25492 Categories: cs.LG

Research Background: Pairwise model comparisons drawn from foundation-model benchmarks (“A is safer than B”) are read as quantitative verdicts but hinge on harness choices benchmark papers under-specify. We close one theory-benchmark loop on this primitive: a finite-envelope proposition tying a measurable pairwise-disagreement rate to whether the strict ordering admits a configuration-pair reversal, paired with a c…
研究背景： 在機器學習與機器人領域，Pairwise model comparisons drawn from foundation-model benchmarks (“A is safer than B”) are read as quantitative verdicts but hinge on harness choices benchmark papers under-specif

Technical Approach: We close one theory-benchmark loop on this primitive: a finite-envelope proposition tying a measurable pairwise-disagreement rate to whether the strict ordering admits a configuration-pair reversal, paired with a commit-stamped evaluation protocol that operationalises it on widely cited alignment benchmarks. On every benchmark we test, configuration choice alone can flip the pairwise verdict; the proposition isolates this strict-reversal failure mode.
技術方法： 本文提出的方法：We close one theory-benchmark loop on this primitive: a finite-envelope proposition tying a measurable pairwise-disagreement rate to whether the strict ordering admits a configuration-pair reversal, paired with a commit-stamped evaluation protocol th

Key Takeaway: On every benchmark we test, configuration choice alone can flip the pairwise verdict; the proposition isolates this strict-reversal failure mode.
核心發現： 核心結果：On every benchmark we test, configuration choice alone can flip the pairwise verdict; the proposition isolates this strict-reversal failure mode.

Real-time, Directionality Aware 3D Ultrasound Reconstruction and Re-Slicing

Authors: Tobias Jaeggi, David Gregory Black, Septimiu Salcudean | Submitted: 2026-05-25 | arXiv: 2605.26325 Categories: cs.HC

Research Background: Tele-ultrasound through teleoperation allows experts to perform examinations remotely in communities, but limited connectivity can lead to communication delays that reduce usability and diagnostic performance. Visual-haptic model mediated teleoperation reslices a pre-acquired ultrasound volume in real time to provide an accurate, delay-independent preview image for the sonographer.
研究背景： 在人機互動領域，Tele-ultrasound through teleoperation allows experts to perform examinations remotely in communities, but limited connectivity can lead to communication delays that reduce usabilit

Technical Approach: This paper presents Directionality-Aware Reslicing (DARE), an ultrasound volume reconstruction and reslicing framework that takes directionality into account.
技術方法： 本文提出的方法：This paper presents Directionality-Aware Reslicing (DARE), an ultrasound volume reconstruction and reslicing framework that takes directionality into account.

Key Takeaway: This can improve the effectiveness and robustness of tele-ultrasound in low-resource areas.
核心發現： 核心結果：This can improve the effectiveness and robustness of tele-ultrasound in low-resource areas.

R5DGS: Semantic-Aware 4D Gaussian Splatting with Rigid Body Constraints for Efficient Dynamic Scene Reconstruction

Authors: Denis Gridusov, Maxim Popov, Sergey Kolyubin | Submitted: 2026-05-25 | arXiv: 2605.25909 Categories: cs.CV

Research Background: Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack semantic awareness and suffer from large computational overhead.
研究背景： 在電腦視覺與機器人領域，Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting met

Technical Approach: We introduce $R5DGS$ , a framework that augments a physics-driven 4D Gaussian representation with compact Identity Encoding vectors, enabling precise Gaussian-to-object association. Furthermore, we propose a rigid-body inference constraint that predicts and integrates physical dynamics exclusively for object centroids, propagating motion to associated Gaussians via relative transformations.
技術方法： 本文提出的方法：We introduce $R5DGS$ , a framework that augments a physics-driven 4D Gaussian representation with compact Identity Encoding vectors, enabling precise Gaussian-to-object association. Furthermore, we propose a rigid-body inference constraint th

Key Takeaway: Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack semantic awareness and suffer from large computational overhead.
核心發現： 核心結果：Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack semantic awareness and suffer from large computational overhead.

Towards Active Real-to-Twin Inspection: A New Paradigm for Zero-Shot Anomaly Detection

Authors: Jiaxuan Liu, Yunkang Cao, Yufeng Chen et al. | Submitted: 2026-05-25 | arXiv: 2605.25407 Categories: cs.CV

Research Background: The deployment of zero-shot anomaly detection (AD) in embodied industrial inspection is severely bottlenecked by its reliance on passive, fixed-viewpoint 2D imagery. Such formulations inherently fail to accommodate the active, dynamic observations required in real-world environments.
研究背景： 在電腦視覺與機器人領域，The deployment of zero-shot anomaly detection (AD) in embodied industrial inspection is severely bottlenecked by its reliance on passive, fixed-viewpoint 2D imagery. Such formulati

Technical Approach: To break this limitation, we introduce Real-to-Twin Anomaly Detection, a novel task that evaluates physical observations directly against geometrically matched CAD Digital Twins. To tackle this new task, we propose AVATAR, a framework designed to learn robust semantic alignment between Real and Digital Twins.
技術方法： 本文提出的方法：To break this limitation, we introduce Real-to-Twin Anomaly Detection, a novel task that evaluates physical observations directly against geometrically matched CAD Digital Twins. To tackle this new task, we propose AVATAR, a framework designed to lea

Key Takeaway: Extensive experiments demonstrate that AVATAR substantially outperforms adapted state-of-the-art baselines, exhibiting exceptional robustness to severe viewpoint variations.
核心發現： 核心結果：Extensive experiments demonstrate that AVATAR substantially outperforms adapted state-of-the-art baselines, exhibiting exceptional robustness to severe viewpoint variations.

Manipulating Tangible Virtual Object Dynamics to Promote Learning of Precision Force Generation

Authors: Alberto Garzás-Villar, Alba Riera-Cardona, Alexis Derumigny et al. | Submitted: 2026-05-26 | arXiv: 2605.26782 Categories: cs.RO, cs.HC

Research Background: Robotic haptic devices combined with virtual reality offer novel opportunities to train fine force generation, an essential yet overlooked component of post-stroke rehabilitation. This study proposes that manipulating the rendered dynamics of tangible virtual objects can be leveraged to train precise force control while engaging the somatosensory system.
研究背景： 在機器人學習領域，Robotic haptic devices combined with virtual reality offer novel opportunities to train fine force generation, an essential yet overlooked component of post-stroke rehabilitation.

Technical Approach: Results indicate that the AS-Gaussian group consistently achieved higher force accuracy during training than the linear group, while the Gaussian group only outperformed the linear group toward the end of training. Analysis of personality traits revealed that higher Free Spirit scores were associated with poorer performance and reduced task exploration under Gaussian dynamics, whereas higher Transform-of-Challenge scores correlated with increased exploration.
技術方法： 本文提出的方法：Results indicate that the AS-Gaussian group consistently achieved higher force accuracy during training than the linear group, while the Gaussian group only outperformed the linear group toward the end of training. Analysis of personality traits reve

Key Takeaway: Despite these training effects, no significant differences in long-term retention were found across spring types or personality traits.
核心發現： 核心結果：Despite these training effects, no significant differences in long-term retention were found across spring types or personality traits.

Multi-Robot Box Transport over Different Surfaces with Decentralized Role-based Proportional Control

Authors: Aditya Bhatt, Himavarshini Yarragangu, Urvish Shah et al. | Submitted: 2026-05-26 | arXiv: 2605.26430 Categories: cs.RO

Research Background: Collaborative transport of objects via pushing by multiple robots has many applications, ranging from construction and warehouse environments to post disaster debris clean-up. Achieving collaborative transport over surfaces with different inclination and friction properties however poses unique challenges.
研究背景： 在機器人學習領域，Collaborative transport of objects via pushing by multiple robots has many applications, ranging from construction and warehouse environments to post disaster debris clean-up. Achi

Technical Approach: To address these challenges, this paper presents an asynchronous decentralized task and motion planning approach for transporting rectangular boxes of varying mass over flat, uphill and downhill terrain. Our approach, called R2P2 or Roles with Rules and Proportional-control Primitive, assigns roles (e.g., push, support and prevent) to robots based on rules cognizant of the mode of manipulation needed (box rotation vs translation); this is followed by either rule-based control or proportional …
技術方法： 本文提出的方法：To address these challenges, this paper presents an asynchronous decentralized task and motion planning approach for transporting rectangular boxes of varying mass over flat, uphill and downhill terrain. Our approach, called R2P2 or Roles with Rules

Key Takeaway: R2P2 is evaluated with a six-robot team deployed in a simulator built using NVIDIA IsaacSim — demonstrating generalizability across different surface friction/inclination and box mass scenarios, and better success rate compared to a standard virtual-leader-follower method.
核心發現： 核心結果：R2P2 is evaluated with a six-robot team deployed in a simulator built using NVIDIA IsaacSim — demonstrating generalizability across different surface friction/inclination and box mass scenarios, and

Transferable Reinforcement Learning via Probabilistic Latent Embeddings and Dynamic Policy Adaptation for Sim-to-Real Deployment

Authors: Gengyue Han, Yiheng Feng | Submitted: 2026-05-26 | arXiv: 2605.27659 Categories: cs.LG, cs.AI

Research Background: Due to limited resources and public safety concerns, deep reinforcement learning (RL) agents for many cyber-physical systems (e.g., autonomous vehicles) are first trained in simulators. However, when deployed in real world environments, they often suffer from performance degradation or safety violations because of the inevitable Sim2Real gap.
研究背景： 在機器學習與機器人領域，Due to limited resources and public safety concerns, deep reinforcement learning (RL) agents for many cyber-physical systems (e.g., autonomous vehicles) are first trained in simula

Technical Approach: To address these limitations, we propose a novel reinforcement learning framework that enables safe and efficient policy transfer via probabilistic latent embeddings and dynamic policy adaptation.
技術方法： 本文提出的方法：To address these limitations, we propose a novel reinforcement learning framework that enables safe and efficient policy transfer via probabilistic latent embeddings and dynamic policy adaptation.

Key Takeaway: This strategy promotes safety at the early deployment stage and improves efficiency through fast policy adaptation under the Sim2Real gap.
核心發現： 核心結果：This strategy promotes safety at the early deployment stage and improves efficiency through fast policy adaptation under the Sim2Real gap.

Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases

Authors: Dongyoon Hahm, Dylan Hadfield-Menell, Kimin Lee | Submitted: 2026-05-26 | arXiv: 2605.27355 Categories: cs.AI, cs.CL, cs.LG

Research Background: Reinforcement Learning from Human Feedback (RLHF) is the standard method to align Large Language Models (LLMs) with human preferences. In this work, we introduce alignment tampering, a potential vulnerability where the LLM undergoing alignment influences the preference dataset, causing RLHF to amplify undesired behaviors.
研究背景： 在人工智慧與機器人領域，Reinforcement Learning from Human Feedback (RLHF) is the standard method to align Large Language Models (LLMs) with human preferences. In this work, we introduce alignment tamperin

Technical Approach: In this work, we introduce alignment tampering, a potential vulnerability where the LLM undergoing alignment influences the preference dataset, causing RLHF to amplify undesired behaviors.
技術方法： 本文提出的方法：In this work, we introduce alignment tampering, a potential vulnerability where the LLM undergoing alignment influences the preference dataset, causing RLHF to amplify undesired behaviors.

Key Takeaway: Our experiments demonstrate amplification across diverse biases: from keyword bias to propaganda (e.g., sexism), brand promotion, and instrumental goal-seeking.
核心發現： 核心結果：Our experiments demonstrate amplification across diverse biases: from keyword bias to propaganda (e.g., sexism), brand promotion, and instrumental goal-seeking.

Learning Dynamic Graph Representations through Timespan View Contrasts

Authors: Yiming Xu, Zhen Peng, Bin Shi et al. | Submitted: 2026-05-26 | arXiv: 2605.27063 Categories: cs.LG

Research Background: The rich information underlying graphs has inspired further investigation of unsupervised graph representation. Existing studies mainly depend on node features and topological properties within static graphs to create self-supervised signals, neglecting the temporal components carried by real-world graph data, such as timestamps of edges.
研究背景： 在機器學習與機器人領域，The rich information underlying graphs has inspired further investigation of unsupervised graph representation. Existing studies mainly depend on node features and topological prop

Technical Approach: To overcome this limitation, this paper explores how to model temporal evolution on dynamic graphs elegantly. Specifically, we introduce a new inductive bias, namely temporal translation invariance, which illustrates the tendency of the identical node to keep similar labels across different timespans. Based on this assumption, we develop a dynamic graph representation framework CLDG that encourages the node to maintain locally consistent temporal translation invariance through contrastive lea…
技術方法： 本文提出的方法：To overcome this limitation, this paper explores how to model temporal evolution on dynamic graphs elegantly. Specifically, we introduce a new inductive bias, namely temporal translation invariance, which illustrates the tendency of the identical nod

Key Takeaway: Moreover, CLDG significantly reduces time and space complexity by implicitly exploiting temporal cues instead of complicated sequence models.
核心發現： 核心結果：Moreover, CLDG significantly reduces time and space complexity by implicitly exploiting temporal cues instead of complicated sequence models.

Asynchronous Remote Sensing Time-Series Fusion for Cloud Removal and Anytime Reconstruction

Authors: Forouzan Fallah, Chia Yu Hsu, Wenwen Li et al. | Submitted: 2026-05-26 | arXiv: 2605.27726 Categories: cs.CV

Research Background: Frequent cloud cover severely limits the usability of Sentinel-2 (S2) optical time series for Earth surface monitoring. Sentinel-1 (S1) SAR provides all-weather complementary observations, but practical S1/S2 fusion remains difficult because acquisitions are irregular and asynchronous.
研究背景： 在電腦視覺與機器人領域，Frequent cloud cover severely limits the usability of Sentinel-2 (S2) optical time series for Earth surface monitoring. Sentinel-1 (S1) SAR provides all-weather complementary obser

Technical Approach: We propose AGFlow (Time Aligned Generative Flow Matching), a spatiotemporal flow-matching model for S1/S2 cloud removal and time-series reconstruction with three capabilities: (1) timestamp-conditioned internal alignment that fuses asynchronous S1 and cloudy S2 observations without preprocessing-based pairing; (2) spatiotemporal, context-aware denoising that models spatial structure jointly with temporal dynamics (rather than independent per-pixel time series); and (3) anytime querying, enabl…
技術方法： 本文提出的方法：We propose AGFlow (Time Aligned Generative Flow Matching), a spatiotemporal flow-matching model for S1/S2 cloud removal and time-series reconstruction with three capabilities: (1) timestamp-conditioned internal alignment that fuses asynchronous S1 an

Key Takeaway: AGFlow notably improves fully missing-frame reconstruction (MAE and RMSE reduce by 16-19% over RESTORE-DiT) and provides reliable reconstructions under persistent gaps, while also yielding competitive cloud removal performance and flexible temporal querying for downstream tasks such as dense vege…
核心發現： 核心結果：AGFlow notably improves fully missing-frame reconstruction (MAE and RMSE reduce by 16-19% over RESTORE-DiT) and provides reliable reconstructions under persistent gaps, while also yielding competitive

SPRINT: Efficient Spectral Priors for Humanoid Athletic Sprints

Authors: Yantong Wei, Kaihong Huang, Hainan Pan et al. | Submitted: 2026-05-27 | arXiv: 2605.28549 Categories: cs.RO, cs.LG

Research Background: The pursuit of humanoid athletic sprints is hindered by a scarcity of humanoid-viable kinematic reference data and the inability of existing frameworks to maintain stability during sprints. To overcome these limitations, we introduce SPRINT, a novel framework driven by efficient, frequency-adaptive spectral priors.
研究背景： 在機器人學習領域，The pursuit of humanoid athletic sprints is hindered by a scarcity of humanoid-viable kinematic reference data and the inability of existing frameworks to maintain stability during

Technical Approach: To overcome these limitations, we introduce SPRINT, a novel framework driven by efficient, frequency-adaptive spectral priors. Ultimately, this work establishes frequency-adaptive spectral priors as a highly data-efficient foundation for humanoid athletic sprints.
技術方法： 本文提出的方法：To overcome these limitations, we introduce SPRINT, a novel framework driven by efficient, frequency-adaptive spectral priors. Ultimately, this work establishes frequency-adaptive spectral priors as a highly data-efficient foundation for humanoid ath

Key Takeaway: Guided by these pretrained priors, the SPRINT policy achieves zero-shot sim-to-real transfer in field experiments on the Unitree G1 platform, reaching a peak sprinting velocity of 6 m/s and demonstrating seamless gait transitions while preserving biomimetic naturalness.
核心發現： 核心結果：Guided by these pretrained priors, the SPRINT policy achieves zero-shot sim-to-real transfer in field experiments on the Unitree G1 platform, reaching a peak sprinting velocity of 6 m/s and demonstrat

Authors: Ruiyan Gong, Meisheng Zhang, Yuxiang Zhao et al. | Submitted: 2026-05-27 | arXiv: 2605.28237 Categories: cs.RO, cs.CV

Research Background: Real-world navigation is fundamentally driven by Points of Interest (POIs), yet reaching a precise POI remains a critical “final-meters” challenge. Existing Vision-Language Navigation (VLN) benchmarks of POI-goal navigation often suffer from coarse granularity or significant sim-to-real gaps due to generated scene.
研究背景： 在機器人學習領域，Real-world navigation is fundamentally driven by Points of Interest (POIs), yet reaching a precise POI remains a critical “final-meters” challenge. Existing Vision-Language Navigat

Technical Approach: To bridge this gap, we present POINav-Bench, the first benchmark designed for closed-loop evaluation of real-world POI-goal navigation. Building on this, we propose the POINav Brain-Action Framework where a Brain module performs POI-grounded reasoning to guide an Action module in predicting continuous waypoints for real-world execution. Experiments show that our framework provides a viable path toward refining real-world POI-goal navigation.
技術方法： 本文提出的方法：To bridge this gap, we present POINav-Bench, the first benchmark designed for closed-loop evaluation of real-world POI-goal navigation. Building on this, we propose the POINav Brain-Action Framework where a Brain module performs POI-grounded reasonin

Key Takeaway: Experiments show that our framework provides a viable path toward refining real-world POI-goal navigation.
核心發現： 核心結果：Experiments show that our framework provides a viable path toward refining real-world POI-goal navigation.

Turning Video Models into Generalist Robot Policies

Authors: Sizhe Lester Li, Evan Kim, Xingjian Bai et al. | Submitted: 2026-05-27 | arXiv: 2605.27817 Categories: cs.RO, cs.AI, cs.CV, cs.LG

Research Background: Video generative models have emerged as a promising robotics backbone, capable of generating videos that depict the completion of complex tasks across embodiments and environments. Recent work proposes robot foundation models that jointly predict future observations and actions by finetuning video models with action-labeled data.
研究背景： 在機器人學習領域，Video generative models have emerged as a promising robotics backbone, capable of generating videos that depict the completion of complex tasks across embodiments and environments.

Technical Approach: In this paper, we test the limits of an alternative approach: leave the video planner as-is while training an embodiment-specific inverse dynamics model (IDM). We present a closed-loop, video-to-action policy that combines an action-free video world model with a carefully-designed IDM based on the robot embodiment Jacobian.
技術方法： 本文提出的方法：In this paper, we test the limits of an alternative approach: leave the video planner as-is while training an embodiment-specific inverse dynamics model (IDM). We present a closed-loop, video-to-action policy that combines an action-free video world

Key Takeaway: More results are available on our project website: https://vera.csail.mit.edu.
核心發現： 核心結果：More results are available on our project website: https://vera.csail.mit.edu.

Bridging the Sim-to-Real Gap in Reinforcement Learning-Based Industrial Dispatching through Execution Semantics

Authors: Jonathan Hoss, Noah Klarmann | Submitted: 2026-05-27 | arXiv: 2605.29078 Categories: cs.AI, cs.LG

Research Background: Event-driven scheduling policies are increasingly deployed in industrial environments, where decisions are made under asynchronous and partially observed system states. As a result, decision states are not temporally consistent, action admissibility is not explicitly defined, and the origin of execution errors remains ambiguous.
研究背景： 在人工智慧與機器人領域，Event-driven scheduling policies are increasingly deployed in industrial environments, where decisions are made under asynchronous and partially observed system states. As a result

Technical Approach: This enables a separation between decision semantics and execution behavior and makes deployment mismatch observable and structurally attributable. The proposed framework is evaluated using a discrete-event simulation.
技術方法： 本文提出的方法：This enables a separation between decision semantics and execution behavior and makes deployment mismatch observable and structurally attributable. The proposed framework is evaluated using a discrete-event simulation.

Key Takeaway: Overall, the layer turns execution uncertainty into supervisory data for evaluation and policy refinement.
核心發現： 核心結果：Overall, the layer turns execution uncertainty into supervisory data for evaluation and policy refinement.

Authors: Youting Wang, Yuan Tang, Bowen Liu et al. | Submitted: 2026-05-27 | arXiv: 2605.28918 Categories: cs.LG, cs.AI, cs.IR

Research Background: For sparse, structured reinforcement-learning tasks with semantic reward-function interfaces, LLM-generated reward shaping is better framed as debugging than one-shot generation. We study PPO-trained agents using MiniGrid as core evaluation and MuJoCo as boundary stress test.
研究背景： 在機器學習與機器人領域，For sparse, structured reinforcement-learning tasks with semantic reward-function interfaces, LLM-generated reward shaping is better framed as debugging than one-shot generation. W

Technical Approach: We propose diagnostic-driven iterative refinement, where training diagnostics and a failure-mode taxonomy guide targeted reward-function revision.
技術方法： 本文提出的方法：We propose diagnostic-driven iterative refinement, where training diagnostics and a failure-mode taxonomy guide targeted reward-function revision.

Key Takeaway: The low-call protocol is a cost contrast with population-based reward search, not a benchmark comparison.
核心發現： 核心結果：The low-call protocol is a cost contrast with population-based reward search, not a benchmark comparison.

Reward Transfer from Inverse Reinforcement Learning: A Coupled Minimax Approach

Authors: Guang-Yuan Hao, Lars van der Laan, Aurélien Bibaut et al. | Submitted: 2026-05-27 | arXiv: 2605.27834 Categories: cs.LG, stat.ML

Research Background: We study the transfer of rewards learned using inverse reinforcement learning from expert demonstrations in one environment to reinforcement learning in a new, different environment. This arises naturally when demonstrations are collected in a controlled environment.
研究背景： 在機器學習與機器人領域，We study the transfer of rewards learned using inverse reinforcement learning from expert demonstrations in one environment to reinforcement learning in a new, different environmen

Technical Approach: Whereas a sequential solution approach first estimates the source reward and then plugs it into the target control problem, a coupled approach solves the source and target system of equations jointly. We show that, in contrast to the sequential approach, the coupled approach removes the first-order influence of source Bellman residual error.
技術方法： 本文提出的方法：Whereas a sequential solution approach first estimates the source reward and then plugs it into the target control problem, a coupled approach solves the source and target system of equations jointly. We show that, in contrast to the sequential appro

Key Takeaway: We characterize the local behavior of each approach, develop finite-sample soft- $q$ -function error bounds, and prove regret guarantees for the resulting soft-control policy.
核心發現： 核心結果：We characterize the local behavior of each approach, develop finite-sample soft- $q$ -function error bounds, and prove regret guarantees for the resulting soft-control policy.

JECA^2: Judgment-Explanation Consistent Adversarial Attack against Forensic Vision-Language Models

Authors: Jiachen Qian | Submitted: 2026-05-27 | arXiv: 2605.28609 Categories: cs.CV

Research Background: Forensic vision-language models (VLMs) have recently been developed to detect image tampering and provide natural-language explanations. However, their robustness against adversarial manipulation remains underexplored.
研究背景： 在電腦視覺與機器人領域，Forensic vision-language models (VLMs) have recently been developed to detect image tampering and provide natural-language explanations. However, their robustness against adversari

Technical Approach: In this paper, we study judgment-explanation consistent adversarial attacks against forensic VLMs and propose JECA^2, a controlled white-box red-team diagnostic that jointly redirects visual attribution and aligns textual explanations with the target judgment.
技術方法： 本文提出的方法：In this paper, we study judgment-explanation consistent adversarial attacks against forensic VLMs and propose JECA^2, a controlled white-box red-team diagnostic that jointly redirects visual attribution and aligns textual explanations with the target

Key Takeaway: Our results highlight a consistency failure mode in explanation-based forensic VLMs and motivate future robustness evaluation beyond binary detection accuracy.
核心發現： 核心結果：Our results highlight a consistency failure mode in explanation-based forensic VLMs and motivate future robustness evaluation beyond binary detection accuracy.

REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detection

Authors: Jun Zhou, Bingwen Hu, Yaxiong Wang et al. | Submitted: 2026-05-27 | arXiv: 2605.28459 Categories: cs.CV

Research Background: Multimodal manipulation detection aims to simultaneously identify forged image—text pairs and localize tampered regions, yet existing methods typically rely on memorizing isolated artifacts and struggle with imperceptible manipulation traces or domain shifts. Inspired by human comparative reasoning, we reformulate this task as a reference-grounded verification problem, where authenticity is as…
研究背景： 在電腦視覺與機器人領域，Multimodal manipulation detection aims to simultaneously identify forged image—text pairs and localize tampered regions, yet existing methods typically rely on memorizing isolated

Technical Approach: We propose REVEAL Reference-Enabled Verification for Evidence Analysis and Localization), a framework explicitly designed for this comparative paradigm. Furthermore, we introduce a task-decoupled Mixture-of-Experts (MoE) architecture to jointly execute instance-level detection and fine-grained grounding, effectively mitigating optimization conflicts between these heterogeneous objectives.
技術方法： 本文提出的方法：We propose REVEAL Reference-Enabled Verification for Evidence Analysis and Localization), a framework explicitly designed for this comparative paradigm. Furthermore, we introduce a task-decoupled Mixture-of-Experts (MoE) architecture to jointly execu

Key Takeaway: Extensive experiments demonstrate that REVEAL significantly outperforms state-of-the-art methods, and notably enables \emph{training-free domain adaptation} by simply updating the reference library, offering a robust and practical solution for detecting evolving misinformation.
核心發現： 核心結果：Extensive experiments demonstrate that REVEAL significantly outperforms state-of-the-art methods, and notably enables \emph{training-free domain adaptation} by simply updating the reference library, o

Prior Availability in Industrial Visual Sim-to-Real: A Review of CAD-Guided and CAD-Unavailable Regimes

Authors: Chenxi Tao, Seung-Kyum Choi | Submitted: 2026-05-28 | arXiv: 2605.30581 Categories: cs.CV, cs.AI, cs.RO

Research Background: Industrial visual sim-to-real is often described as transferring from synthetic images to real images, but industrial deployment usually involves a broader mismatch between available evidence and required decisions. A system may be built from CAD renderings, simulated RGB-D observations, normal reference images, synthetic defects, pretrained feature spaces, or language prompts, yet deployed und…
研究背景： 在電腦視覺與機器人領域，Industrial visual sim-to-real is often described as transferring from synthetic images to real images, but industrial deployment usually involves a broader mismatch between availab

Technical Approach: This framing connects CAD-based detection and 6D pose-estimation literature with industrial anomaly and surface-inspection literature that is usually reviewed separately. To make the taxonomy concrete, we use empirical anchors on T-LESS/BOP, MVTec AD, and VisA.
技術方法： 本文提出的方法：This framing connects CAD-based detection and 6D pose-estimation literature with industrial anomaly and surface-inspection literature that is usually reviewed separately. To make the taxonomy concrete, we use empirical anchors on T-LESS/BOP, MVTec AD

Key Takeaway: They also show that CAD at test time creates a distinct verification channel through mask, pose, and depth consistency, whereas CAD-unavailable inspection relies on calibrated normality and feature deviation.
核心發現： 核心結果：They also show that CAD at test time creates a distinct verification channel through mask, pose, and depth consistency, whereas CAD-unavailable inspection relies on calibrated normality and feature de

Learning to Perceive the World Through Control: Empowerment-Based Representation Learning

Authors: Mahsa Bastankhah, Sophie Broderick, Benjamin Eysenbach | Submitted: 2026-05-28 | arXiv: 2605.30656 Categories: cs.LG

Research Background: In many practical reinforcement learning environments, observations are far higher-dimensional than the variables that matter for control. In this work, we ask: can we learn representations that capture only control-relevant features of the environment?
研究背景： 在機器學習與機器人領域，In many practical reinforcement learning environments, observations are far higher-dimensional than the variables that matter for control. In this work, we ask: can we learn repres

Technical Approach: In this work, we ask: can we learn representations that capture only control-relevant features of the environment?
技術方法： 本文提出的方法：In this work, we ask: can we learn representations that capture only control-relevant features of the environment?

Key Takeaway: We show that empowerment agents induce two distinct representations — forward and backward — that capture complementary aspects of the state, and both of which are invariant to control-irrelevant features.
核心發現： 核心結果：We show that empowerment agents induce two distinct representations — forward and backward — that capture complementary aspects of the state, and both of which are invariant to control-irrelevant fe

World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications

Authors: Arif Hassan Zidan, Yi Pan, Hanqi Jiang et al. | Submitted: 2026-05-28 | arXiv: 2606.00133 Categories: cs.LG, cs.ET

Research Background: World models, internal simulators that learn the structure and dynamics of an environment, have emerged as a central paradigm in the pursuit of artificial general intelligence, enabling agents to predict, plan, and reason within learned representations. Despite rapid progress across reinforcement learning, robotics, autonomous driving, and video generation, the field lacks a unified framework i…
研究背景： 在機器學習與機器人領域，World models, internal simulators that learn the structure and dynamics of an environment, have emerged as a central paradigm in the pursuit of artificial general intelligence, ena

Technical Approach: This survey addresses that gap with a multi-axis taxonomy organized along four dimensions: (i) architecture, encompassing representation format, dynamics formulation, input modality, learning paradigm, and downstream application; (ii) methodological family, including state-space and recurrent approaches, transformer-based models, diffusion-based generators, physics-informed networks, and language-augmented multimodal systems; (iii) reasoning strategy, covering imagination-based planning, late…
技術方法： 本文提出的方法：This survey addresses that gap with a multi-axis taxonomy organized along four dimensions: (i) architecture, encompassing representation format, dynamics formulation, input modality, learning paradigm, and downstream application; (ii) methodological

Key Takeaway: We review evaluation protocols and benchmarks, identify persistent challenges such as compounding prediction errors, sim-to-real transfer, and fragmented evaluation, and outline future directions toward unified multimodal world models, foundation-scale interactive simulators, and safe deployment …
核心發現： 核心結果：We review evaluation protocols and benchmarks, identify persistent challenges such as compounding prediction errors, sim-to-real transfer, and fragmented evaluation, and outline future directions towa

OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation

Authors: Haochen Yang, Ke Zhao, Mengyuan Ma et al. | Submitted: 2026-05-28 | arXiv: 2605.29829 Categories: cs.AI, cs.LG

Research Background: Leveraging Large Language Models (LLMs) to automatically formulate and solve optimization problems from natural language has emerged as an efficient paradigm for automated optimization. However, existing methods still exhibit limited generalization: they are sensitive to superficial narrative variations, reuse experience mainly at the case level, and struggle to adapt to shifted or emerging pro…
研究背景： 在人工智慧與機器人領域，Leveraging Large Language Models (LLMs) to automatically formulate and solve optimization problems from natural language has emerged as an efficient paradigm for automated optimiza

Technical Approach: We propose OptSkills, an archetype-centric skill learning and reasoning agent system for optimization modeling and solving. To improve robust generalization, our system clusters problems by their underlying archetypes rather than surface narratives. Our system achieves a state-of-the-art micro-averaged accuracy of 68.27% on datasets encompassing diverse problem types and scenarios.
技術方法： 本文提出的方法：We propose OptSkills, an archetype-centric skill learning and reasoning agent system for optimization modeling and solving. To improve robust generalization, our system clusters problems by their underlying archetypes rather than surface narratives.

Key Takeaway: After skill learning on Nano-CO, it reaches 72.79% on the OOD NLCO benchmark.
核心發現： 核心結果：After skill learning on Nano-CO, it reaches 72.79% on the OOD NLCO benchmark.

NeuroEdge: Real-Time Hand Gesture Recognition with High-Density EMG Using Deep Learning at the Edge

Authors: Peter Chudinov, Zhenyu Lin, Jay Motamarry et al. | Submitted: 2026-05-28 | arXiv: 2605.29326 Categories: cs.LG

Research Background: High-density electromyography (HD-EMG) has emerged as a powerful modality for decoding fine-grained neuromuscular activity, enabling real-time neural-machine interfaces (NMIs) for applications such as prosthetic control, rehabilitation, and augmented interaction. While deep learning approaches such as convolutional neural networks (CNNs)have demonstrated high classification accuracy for EMG-bas…
研究背景： 在機器學習與機器人領域，High-density electromyography (HD-EMG) has emerged as a powerful modality for decoding fine-grained neuromuscular activity, enabling real-time neural-machine interfaces (NMIs) for

Technical Approach: This paper presents NeuroEdge, a real-time HD EMG-based NMI system that performs gesture recognition entirely on resource-constrained microcontrollers. Our system demonstrates the feasibility of deploying complex HD-EMG-based gesture recognition on microcontroller-based edge devices, bridging the gap between high-resolution biosignal acquisition and deep learning-based embedded inference for next-generation NMIs.
技術方法： 本文提出的方法：This paper presents NeuroEdge, a real-time HD EMG-based NMI system that performs gesture recognition entirely on resource-constrained microcontrollers. Our system demonstrates the feasibility of deploying complex HD-EMG-based gesture recognition on m

Key Takeaway: Our system demonstrates the feasibility of deploying complex HD-EMG-based gesture recognition on microcontroller-based edge devices, bridging the gap between high-resolution biosignal acquisition and deep learning-based embedded inference for next-generation NMIs.
核心發現： 核心結果：Our system demonstrates the feasibility of deploying complex HD-EMG-based gesture recognition on microcontroller-based edge devices, bridging the gap between high-resolution biosignal acquisition and

YoCausal: How Far is Video Generation from World Model? A Causality Perspective

Authors: You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee et al. | Submitted: 2026-05-28 | arXiv: 2605.30346 Categories: cs.CV

Research Background: As video diffusion models (VDMs) advance toward world models, a key question arises: do they truly understand causality, or merely overfit to statistical temporal patterns? Existing benchmarks mostly rely on synthetic data, limiting real-world generalization due to the sim-to-real gap.
研究背景： 在電腦視覺與機器人領域，As video diffusion models (VDMs) advance toward world models, a key question arises: do they truly understand causality, or merely overfit to statistical temporal patterns? Existin

Technical Approach: We present YoCausal, a two-level benchmark inspired by the Violation of Expectation (VoE) paradigm from cognitive science.
技術方法： 本文提出的方法：We present YoCausal, a two-level benchmark inspired by the Violation of Expectation (VoE) paradigm from cognitive science.

Key Takeaway: Evaluation of 13 state-of-the-art VDMs reveals that perceiving the arrow of time does not imply understanding causality, and a significant gap persists relative to human-level causal cognition.
核心發現： 核心結果：Evaluation of 13 state-of-the-art VDMs reveals that perceiving the arrow of time does not imply understanding causality, and a significant gap persists relative to human-level causal cognition.

Masked Diffusion Vision-Language Models for Temporal Action Localization

Authors: Fengshun Wang, Zhengbo Zhang, Zhigang Tu | Submitted: 2026-05-28 | arXiv: 2605.29858 Categories: cs.CV

Research Background: Temporal action localization (TAL) requires recognizing the target event and localizing its start and end times precisely in untrimmed videos. Recent vision-language formulations improve semantic reasoning and support language-conditioned outputs, but their autoregressive decoders still generate tokens from left to right, preventing later semantic evidence from revising earlier timestamp predic…
研究背景： 在電腦視覺與機器人領域，Temporal action localization (TAL) requires recognizing the target event and localizing its start and end times precisely in untrimmed videos. Recent vision-language formulations i

Technical Approach: To address these mismatches, we introduce a Planned Training Objective that uses boundary-aware masking and step-weighted reconstruction to rehearse the late recovery of time tokens, together with a Step-Level IoU Reward that provides overlap-aware supervision during denoising.
技術方法： 本文提出的方法：To address these mismatches, we introduce a Planned Training Objective that uses boundary-aware masking and step-weighted reconstruction to rehearse the late recovery of time tokens, together with a Step-Level IoU Reward that provides overlap-aware s

Key Takeaway: Experiments on ActivityNet-RTL, ActivityNet-1.3, and THUMOS-14 show that MDVLM-TAL improves both temporal reasoning and boundary localization over autoregressive vision-language baselines, with especially strong gains under stricter temporal IoU criteria.
核心發現： 核心結果：Experiments on ActivityNet-RTL, ActivityNet-1.3, and THUMOS-14 show that MDVLM-TAL improves both temporal reasoning and boundary localization over autoregressive vision-language baselines, with especi

Authors: Naisha Minnah | Submitted: 2026-05-28 | arXiv: 2605.29353 Categories: cs.CR, cs.CV

Research Background: The proliferation of AI-generated synthetic media poses a critical threat to the integrity of digital evidence in legal and forensic contexts. Existing deepfake detection systems typically address a single modality and provide no mechanism for tamper-proof evidence preservation.
研究背景： 在機器人 AI領域，The proliferation of AI-generated synthetic media poses a critical threat to the integrity of digital evidence in legal and forensic contexts. Existing deepfake detection systems t

Technical Approach: We present DeepFake Forensics AI, a unified platform that detects synthetic media across image, video, and audio modalities, identifies generative architecture fingerprints, and anchors forensic evidence immutably on the Ethereum blockchain. Our system trains four independent neural networks from scratch: an EfficientNet-B4 image detector (AUC = 0.9868), a Bidirectional LSTM video detector (AUC= 0.9628), an ECAPA-TDNN audio detector (EER = 18.63%), and a novel GAN fingerprinting module (accur…
技術方法： 本文提出的方法：We present DeepFake Forensics AI, a unified platform that detects synthetic media across image, video, and audio modalities, identifies generative architecture fingerprints, and anchors forensic evidence immutably on the Ethereum blockchain. Our syst

Key Takeaway: To our knowledge, this is the first system to unify multi-modal deepfake detection with blockchain-based chain-of custody management.
核心發現： 核心結果：To our knowledge, this is the first system to unify multi-modal deepfake detection with blockchain-based chain-of custody management.

STAMP: Training Explicit Memory for Mobile GUI Agents in Controllable and Scalable Virtual Environments

Authors: Junyang Wang, Haiyang Xu, Xi Zhang et al. | Submitted: 2026-05-28 | arXiv: 2605.29324 Categories: cs.CL, cs.CV

Research Background: Mobile GUI agents excel at immediate reactive control but frequently fail in realistic, long-horizon tasks that require memory. This failure stems from a fundamental conflict between limited context windows and token-heavy screenshots.
研究背景： 在機器人 AI領域，Mobile GUI agents excel at immediate reactive control but frequently fail in realistic, long-horizon tasks that require memory. This failure stems from a fundamental conflict betwe

Technical Approach: To resolve this, we present STAMP, a framework that trains explicit memory in mobile agents through controllable virtual environments, where deterministic memory variables are programmatically injected into synthesized tasks to control what must be memorized, when it should be encoded, and when it must later be retrieved, thereby producing verifiable supervised data at scale and enabling online reinforcement learning through environment-driven reward feedback.
技術方法： 本文提出的方法：To resolve this, we present STAMP, a framework that trains explicit memory in mobile agents through controllable virtual environments, where deterministic memory variables are programmatically injected into synthesized tasks to control what must be m

Key Takeaway: Evaluated on our newly introduced Memory-World benchmark, the resulting Stamp-GUI agent achieves state-of-the-art performance among GUI-specialized models and sets a new high watermark on our Memory-World benchmark, demonstrating exceptional memory accuracy and task resilience while maintaining s…
核心發現： 核心結果：Evaluated on our newly introduced Memory-World benchmark, the resulting Stamp-GUI agent achieves state-of-the-art performance among GUI-specialized models and sets a new high watermark on our Memory-W

Literary Emotions in Motion: A Soft Robotics Installation for Tactile Storytelling

Authors: Carolina Silva-Plata, Abraham Villavicencio-Carmona, Miguel Silva Plata et al. | Submitted: 2026-05-29 | arXiv: 2606.00418 Categories: cs.RO, cs.HC

Research Background: Soft robotics is increasingly explored in artistic contexts, where tactile interaction provides audiences with embodied engagement beyond visual or auditory signals. This work presents an interactive installation that maps semantic emotion analysis of narrative text into variable stiffness of soft pneumatic modules.
研究背景： 在機器人學習領域，Soft robotics is increasingly explored in artistic contexts, where tactile interaction provides audiences with embodied engagement beyond visual or auditory signals. This work pres

Technical Approach: This work presents an interactive installation that maps semantic emotion analysis of narrative text into variable stiffness of soft pneumatic modules. We develop and mechanically characterize silicone actuators, called soft modules, featuring a thin membrane layer, demonstrating how this morphological control expands the achievable stiffness range while preserving simplicity and low-cost fabrication.
技術方法： 本文提出的方法：This work presents an interactive installation that maps semantic emotion analysis of narrative text into variable stiffness of soft pneumatic modules. We develop and mechanically characterize silicone actuators, called soft modules, featuring a thin

Key Takeaway: The results suggest that stiffness modulation accompanied by color change can support emotionally meaningful and engaging tactile interaction in soft robotic installations.
核心發現： 核心結果：The results suggest that stiffness modulation accompanied by color change can support emotionally meaningful and engaging tactile interaction in soft robotic installations.

SoFiE: Soft Finger Exoskeleton for Intelligent Grasping

Authors: Magnus Malthe Sigsgaard Nielsen, Nicklas Nikolaj Grønvall, Xiaofeng Xiong et al. | Submitted: 2026-05-29 | arXiv: 2606.00397 Categories: cs.RO, eess.SY

Research Background: Soft wearable robotic systems have emerged as a promising solution for assisting individuals with reduced hand function. This paper presents SoFiE, a modular soft finger exoskeleton designed to assist index-finger flexion during grasping tasks.
研究背景： 在機器人學習領域，Soft wearable robotic systems have emerged as a promising solution for assisting individuals with reduced hand function. This paper presents SoFiE, a modular soft finger exoskeleto

Technical Approach: This paper presents SoFiE, a modular soft finger exoskeleton designed to assist index-finger flexion during grasping tasks. Furthermore, a novel tactile sensing approach, MagSense, is introduced, using a magnet and magnetometer pair embedded in a soft fingertip structure to estimate contact force and object compliance. This paper details the design, fabrication, and sensing concepts of the proposed exoskeleton as a proof of concept toward modular, soft, and assistive wearable robotics.
技術方法： 本文提出的方法：This paper presents SoFiE, a modular soft finger exoskeleton designed to assist index-finger flexion during grasping tasks. Furthermore, a novel tactile sensing approach, MagSense, is introduced, using a magnet and magnetometer pair embedded in a sof

Key Takeaway: Experimental validation demonstrates the capability of the system to provide reliable pose estimation, distinguish between materials with different stiffness, and generate distinct sensor signatures across different grasping tasks.
核心發現： 核心結果：Experimental validation demonstrates the capability of the system to provide reliable pose estimation, distinguish between materials with different stiffness, and generate distinct sensor signatures a

DRL-Based Pose Control for Double-Ackermann Robots Under Actuation Uncertainties

Authors: Oussama Zaim, Mélodie Daniel, Aly Magassouba et al. | Submitted: 2026-05-29 | arXiv: 2606.00313 Categories: cs.RO, cs.AI

Research Background: Robust deployment of deep reinforcement learning (DRL) policies on real robots remains challenging due to discrepancies between simulation and real-world dynamics. We address this issue in the context of maneuvering with double-Ackermann-steering mobile robots, which introduce additional constraints due to their non-holonomic nature.
研究背景： 在機器人學習領域，Robust deployment of deep reinforcement learning (DRL) policies on real robots remains challenging due to discrepancies between simulation and real-world dynamics. We address this

Technical Approach: The use of simplified actuation models during training of the extended policy can lead to poor generalization, shown by a success rate drop from 100% in PyBullet to 25% in Gazebo under stricter evaluation conditions. To address this limitation, we adopt a sim-to-sim-to-real approach, where actuation effects observed in Gazebo are incorporated into the PyBullet training environment.
技術方法： 本文提出的方法：The use of simplified actuation models during training of the extended policy can lead to poor generalization, shown by a success rate drop from 100% in PyBullet to 25% in Gazebo under stricter evaluation conditions. To address this limitation, we ad

Key Takeaway: This approach can significantly reduce the performance gap across simulators, achieving up to 92% success rate in Gazebo and maintaining 69% under stricter thresholds, with successful transfer to a real robot without additional tuning.
核心發現： 核心結果：This approach can significantly reduce the performance gap across simulators, achieving up to 92% success rate in Gazebo and maintaining 69% under stricter thresholds, with successful transfer to a re

Series-Parallel Integrated Nonlinear Elastic Actuator applied to the lean motion of a bicycle simulator

Authors: Christina Kohler, Michiel Plooij, Nuria Peña-Perez et al. | Submitted: 2026-05-29 | arXiv: 2606.00201 Categories: cs.RO

Research Background: Designing robots for high-torque, high-fidelity haptic interaction is challenging. Parallel Elastic Actuators (PEAs) use elastic elements in parallel to smaller motors to complement torques, and Series Elastic Actuators (SEAs) use elastic elements in series to decouple motor impedance and improve force control.
研究背景： 在機器人學習領域，Designing robots for high-torque, high-fidelity haptic interaction is challenging. Parallel Elastic Actuators (PEAs) use elastic elements in parallel to smaller motors to complemen

Technical Approach: This paper presents the Series Parallel Integrated Nonlinear Elastic Actuator (SPINEA), which merges SEA and PEA such that a single elastic element takes on dual roles simultaneously, parallel and series.
技術方法： 本文提出的方法：This paper presents the Series Parallel Integrated Nonlinear Elastic Actuator (SPINEA), which merges SEA and PEA such that a single elastic element takes on dual roles simultaneously, parallel and series.

Key Takeaway: Our results confirm SPINEA’s low impedance and precise torque tracking, up to 4.25 Hz with the bicycle frame fixed and up to 4 Hz with riders.
核心發現： 核心結果：Our results confirm SPINEA’s low impedance and precise torque tracking, up to 4.25 Hz with the bicycle frame fixed and up to 4 Hz with riders.

Learning Controlled Separation of Small Objects Between Two Fingers with a Tactile Skin

Authors: Ulf Kasolowsky, Berthold Bäuml | Submitted: 2026-05-29 | arXiv: 2605.31486 Categories: cs.RO

Research Background: We introduce and solve the novel task of controlled separation of small objects with two fingers of a multi-purpose robotic hand: after grasping into a box of small objects, the task is to drop as many of them until a desired number remains between the fingers. The objects are small compared to the width of the fingers but also in absolute terms.
研究背景： 在機器人學習領域，We introduce and solve the novel task of controlled separation of small objects with two fingers of a multi-purpose robotic hand: after grasping into a box of small objects, the ta

Technical Approach: The separation policy is trained in simulation via reinforcement learning using a straightforward sparse reward, which basically checks if the desired number of objects is reached. In simulation experiments, we provide an exhaustive analysis of the benefits of using spatially-resolved tactile feedback: while an ideal (high-resolution) tactile sensor allows solving the task almost perfectly, a sensor with lower spatial resolution (here 4x4 taxels) still leads to an improvement of up to 20% com…
技術方法： 本文提出的方法：The separation policy is trained in simulation via reinforcement learning using a straightforward sparse reward, which basically checks if the desired number of objects is reached. In simulation experiments, we provide an exhaustive analysis of the b

Key Takeaway: Finally, we demonstrate the successful sim-to-real transfer for the DLR-Hand II equipped with a tactile skin.
核心發現： 核心結果：Finally, we demonstrate the successful sim-to-real transfer for the DLR-Hand II equipped with a tactile skin.

Actuator-Aware Inverse Kinematics with Joint-Limit Admissibility for Torque-Controlled Redundant Robots

Authors: Mohammad Dastranj, Mahdi Hejrati, Jouni Mattila | Submitted: 2026-05-29 | arXiv: 2605.31436 Categories: cs.RO

Research Background: This paper proposes actuator-aware inverse kinematics for torque-controlled redundant robots under joint-limit constraints. In the considered architecture, the inverse-kinematic output is not merely a purely kinematic joint-velocity command; it is the required joint velocity supplied to a downstream torque-level controller.
研究背景： 在機器人學習領域，This paper proposes actuator-aware inverse kinematics for torque-controlled redundant robots under joint-limit constraints. In the considered architecture, the inverse-kinematic ou

Technical Approach: Control barrier function style bounds impose reference-level joint-limit admissibility, while the task equation is handled through a penalized slack variable. Redundancy is resolved using a controller-compatibility objective that accounts for previous-command consistency and actuator torque-capacity weighting.
技術方法： 本文提出的方法：Control barrier function style bounds impose reference-level joint-limit admissibility, while the task equation is handled through a penalized slack variable. Redundancy is resolved using a controller-compatibility objective that accounts for previou

Key Takeaway: The results indicate lower limit-pushing commands, bounded admissible required velocities, and improved realized task behavior in the tested trajectory, without modifying the downstream controller.
核心發現： 核心結果：The results indicate lower limit-pushing commands, bounded admissible required velocities, and improved realized task behavior in the tested trajectory, without modifying the downstream controller.

Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model

Authors: Fengtao Zhou, Yingxue Xu, Zhengyu Zhang et al. | Submitted: 2026-05-29 | arXiv: 2606.03644 Categories: cs.LG

Research Background: Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times. While pathology foundation models (PFMs) have demonstrated potential for inferring molecular phenotypes from routine hematoxylin and eosin (H&E) whole-slide images (WSIs), current architectures primarily rely on vision-cent…
研究背景： 在機器學習與機器人領域，Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times. While

Technical Approach: In this study, we present a Spatial Transcriptomics-guided Alignment framework for Molecular Profiling (STAMP), which endows PFMs with intrinsic molecular awareness.
技術方法： 本文提出的方法：In this study, we present a Spatial Transcriptomics-guided Alignment framework for Molecular Profiling (STAMP), which endows PFMs with intrinsic molecular awareness.

Key Takeaway: The clinical utility of these augmented representations was validated through a multi-tier evaluation framework.
核心發現： 核心結果：The clinical utility of these augmented representations was validated through a multi-tier evaluation framework.

The Terminal Representation in Reinforcement Learning

Authors: Amir Esterhuysen, Anders Jonsson | Submitted: 2026-05-29 | arXiv: 2605.31289 Categories: cs.LG, cs.AI

Research Background: Representation learning is a powerful tool for spatio-temporal abstraction within reinforcement learning (RL). Two well established approaches are through the successor representation (SR) and the default representation (DR).
研究背景： 在機器學習與機器人領域，Representation learning is a powerful tool for spatio-temporal abstraction within reinforcement learning (RL). Two well established approaches are through the successor representat

Technical Approach: We introduce a structurally distinct formulation: the terminal representation (TR). In this work we develop the theoretical foundations of the TR: its derivation, convergence of two learning algorithms, its use for zero-shot compositionality, and equivalences between alternative reward formulations.
技術方法： 本文提出的方法：We introduce a structurally distinct formulation: the terminal representation (TR). In this work we develop the theoretical foundations of the TR: its derivation, convergence of two learning algorithms, its use for zero-shot compositionality, and equ

Key Takeaway: Additionally, we provide empirical evidence of the TR as a viable alternative to existing representations in subsidiary applications, while requiring less computational overhead to learn, store, and use.
核心發現： 核心結果：Additionally, we provide empirical evidence of the TR as a viable alternative to existing representations in subsidiary applications, while requiring less computational overhead to learn, store, and u

Inverse Reinforcement Learning without an Optimal Demonstrator: A Feasible Reward Set Approach

Authors: Kihyun Kim, Shripad Deshmukh, Nikos Vlassis et al. | Submitted: 2026-05-29 | arXiv: 2605.30903 Categories: cs.LG, cs.AI

Research Background: Inverse reinforcement learning (IRL) typically assumes demonstrations from a single optimal demonstrator, but in many applications data come from multiple imperfect demonstrators with heterogeneous suboptimality levels. We study reward learning in this setting through a feasible-reward-set framework: for each demonstrator, we encode its declared suboptimality level as a linear constraint and in…
研究背景： 在機器學習與機器人領域，Inverse reinforcement learning (IRL) typically assumes demonstrations from a single optimal demonstrator, but in many applications data come from multiple imperfect demonstrators w

Technical Approach: On the practical side, we introduce strategies to address the inherent reward ambiguity in the obtained reward set and provide an offline algorithm with function approximation for high-dimensional environments.
技術方法： 本文提出的方法：On the practical side, we introduce strategies to address the inherent reward ambiguity in the obtained reward set and provide an offline algorithm with function approximation for high-dimensional environments.

Key Takeaway: Experiments in tabular grid-world and large language model (LLM) fine-tuning settings are consistent with the theoretical predictions and demonstrate the effectiveness of the proposed framework over baselines.
核心發現： 核心結果：Experiments in tabular grid-world and large language model (LLM) fine-tuning settings are consistent with the theoretical predictions and demonstrate the effectiveness of the proposed framework over b

A Lecture Note on Offline RL and IRL, Part II: Foundations of Inverse Reinforcement Learning and Dynamic Discrete Choice Models

Authors: Enoch Hyunwook Kang | Submitted: 2026-05-29 | arXiv: 2605.30843 Categories: cs.LG, econ.EM

Research Background: In the forward reinforcement-learning problem, the reward is fixed and known; the learner is asked to find a good policy or value function. Here we turn the question around.
研究背景： 在機器學習與機器人領域，In the forward reinforcement-learning problem, the reward is fixed and known; the learner is asked to find a good policy or value function. Here we turn the question around.

Technical Approach: We begin by proving their equivalence. We then develop the classical identification result of Magnac and Thesmar and the classical computational paradigms that grew out of it: Rust’s nested fixed-point algorithm, the conditional-choice-probability approach of Hotz and Miller, and the two temporal-difference approaches of Adusumilli and Eckardt: linear semi-gradient TD and approximate value iteration.
技術方法： 本文提出的方法：We begin by proving their equivalence. We then develop the classical identification result of Magnac and Thesmar and the classical computational paradigms that grew out of it: Rust’s nested fixed-point algorithm, the conditional-choice-probability ap

Key Takeaway: We then develop the classical identification result of Magnac and Thesmar and the classical computational paradigms that grew out of it: Rust’s nested fixed-point algorithm, the conditional-choice-probability approach of Hotz and Miller, and the two temporal-difference approaches of Adusumilli an…
核心發現： 核心結果：We then develop the classical identification result of Magnac and Thesmar and the classical computational paradigms that grew out of it: Rust’s nested fixed-point algorithm, the conditional-choice-pro

Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction

Authors: Mungyeom Kim, Minkyeong Jeon, Honggyu An et al. | Submitted: 2026-05-29 | arXiv: 2605.31595 Categories: cs.CV

Research Background: Dynamic scene reconstruction from monocular video remains a fundamental challenge in computer vision. Existing feed-forward methods predict 3D Gaussians pixel-wise for each frame, suffering from duplicated Gaussians and view-dependent biases that hinder effective learning of scene motion.
研究背景： 在電腦視覺與機器人領域，Dynamic scene reconstruction from monocular video remains a fundamental challenge in computer vision. Existing feed-forward methods predict 3D Gaussians pixel-wise for each frame,

Technical Approach: We present C4G, a feed-forward 4D reconstruction framework built upon a compact set of timestamp-conditioned learnable Gaussian query tokens. Since our framework effectively aggregates features into Gaussians, we extend this capability to feature lifting, producing a 4D feature field that supports point tracking and dynamic scene understanding. C4G achieves strong novel-view synthesis performance using significantly fewer Gaussians and without requiring camera poses, while exhibiting stronger…
技術方法： 本文提出的方法：We present C4G, a feed-forward 4D reconstruction framework built upon a compact set of timestamp-conditioned learnable Gaussian query tokens. Since our framework effectively aggregates features into Gaussians, we extend this capability to feature lif

Key Takeaway: C4G achieves strong novel-view synthesis performance using significantly fewer Gaussians and without requiring camera poses, while exhibiting stronger motion modeling and robustness to large temporal gaps.
核心發現： 核心結果：C4G achieves strong novel-view synthesis performance using significantly fewer Gaussians and without requiring camera poses, while exhibiting stronger motion modeling and robustness to large temporal

MyoSem: Aligning Electromyography to Natural-Language Action Semantics for Hand Action Understanding

Authors: Chiyue Wang, Dong She, Yang Gao et al. | Submitted: 2026-05-29 | arXiv: 2606.00174 Categories: cs.CV, cs.AI

Research Background: Electromyography (EMG) directly reflects muscle activation and is a key sensing modality for gesture recognition, prosthetic control, and wearable interaction. Existing EMG methods, however, commonly formulate hand action understanding as classification over fixed labels, making it difficult to support querying, retrieval, and generalization based on action descriptions.
研究背景： 在電腦視覺與機器人領域，Electromyography (EMG) directly reflects muscle activation and is a key sensing modality for gesture recognition, prosthetic control, and wearable interaction. Existing EMG methods

Technical Approach: We present MyoSem, an EMG—action semantic alignment framework that maps low-level EMG signals into a shared semantic space constructed from multi-view action descriptions.
技術方法： 本文提出的方法：We present MyoSem, an EMG—action semantic alignment framework that maps low-level EMG signals into a shared semantic space constructed from multi-view action descriptions.

Key Takeaway: Results show that MyoSem performs well on EMG—text bidirectional retrieval, generally outperforms most baselines, and shows favorable generalization to unseen users, held-out action classes, and amputee-user transfer scenarios.
核心發現： 核心結果：Results show that MyoSem performs well on EMG—text bidirectional retrieval, generally outperforms most baselines, and shows favorable generalization to unseen users, held-out action classes, and ampu

TALON: Token-Aligned Lightweight Adapters for 6-DoF Spacecraft Pose Estimation

Authors: Abid Ali, Arunkumar Rathinam, Djamila Aouada | Submitted: 2026-05-29 | arXiv: 2605.31217 Categories: cs.CV

Research Background: Monocular 6-DoF spacecraft pose estimation methods predominantly process individual frames, discarding the temporal information present in an image sequence acquired during spacecraft manoeuvres. Few temporal approaches require full backbone fine-tuning or auxiliary optical flow networks, risking catastrophic forgetting or increasing computational cost, respectively.
研究背景： 在電腦視覺與機器人領域，Monocular 6-DoF spacecraft pose estimation methods predominantly process individual frames, discarding the temporal information present in an image sequence acquired during spacecr

Technical Approach: We propose TALON (Token-Aligned Lightweight adapters for Orbital Navigation): spatiotemporal 3D adapters injected before the self-attention layers of a frozen ViT vision transformer, combined with a patch-token alignment loss that geometrically grounds the adapted features to keypoint structure through a prototype-conditioned KL-divergence objective.
技術方法： 本文提出的方法：We propose TALON (Token-Aligned Lightweight adapters for Orbital Navigation): spatiotemporal 3D adapters injected before the self-attention layers of a frozen ViT vision transformer, combined with a patch-token alignment loss that geometrically groun

Key Takeaway: Zero-shot cross-domain evaluation from sim-to-real on SPARK real data reduces pose error by 4.7x, and ablations characterise the role of adapter depth across in-domain and cross-domain settings.
核心發現： 核心結果：Zero-shot cross-domain evaluation from sim-to-real on SPARK real data reduces pose error by 4.7x, and ablations characterise the role of adapter depth across in-domain and cross-domain settings.

Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation

Authors: Hanlin Chen, Jiaxin Wei, Xibin Song et al. | Submitted: 2026-05-29 | arXiv: 2605.30855 Categories: cs.CV

Research Background: Frame-wise action-controlled image-to-video generation is a promising paradigm for interactive world simulation, where each control signal should elicit an immediate visual response. However, maintaining visual fidelity and 3D consistency over long autoregressive rollouts remains challenging.
研究背景： 在電腦視覺與機器人領域，Frame-wise action-controlled image-to-video generation is a promising paradigm for interactive world simulation, where each control signal should elicit an immediate visual respons

Technical Approach: To address these challenges, we present \textbf{Robust Dreamer}, a memory-augmented framework built around how to design 3D memory and how to use it robustly. First, we introduce \textbf{Latent Gaussian Memory}, which anchors diffusion latents inherited from the generation process to Gaussian primitives and recalls them via latent-space Gaussian splatting. Second, we propose \textbf{Deviation Learning with Dynamic Deviation Archive}, which synthesizes rollout-induced latent deviations through…
技術方法： 本文提出的方法：To address these challenges, we present \textbf{Robust Dreamer}, a memory-augmented framework built around how to design 3D memory and how to use it robustly. First, we introduce \textbf{Latent Gaussian Memory}, which anchors diffusion latents inheri

Key Takeaway: Experiments on ScanNet, DL3DV, and OmniWorldGame demonstrate state-of-the-art long-horizon performance.
核心發現： 核心結果：Experiments on ScanNet, DL3DV, and OmniWorldGame demonstrate state-of-the-art long-horizon performance.

Too Much of a Good Thing: When sim2real Efforts Impede Policy Learning (And What to Do About It)

Authors: Kyle Morgenstein, Bharath Masetty, Stephen Welch et al. | Submitted: 2026-05-30 | arXiv: 2606.02636 Categories: cs.RO, cs.AI

Research Background: While sim2real efforts are necessary for effective policy transfer to hardware, there is such a thing as too much of a good thing. We argue that sim2real efforts have led to misaligned incentives with policy learning, resulting in simulator lock in and poor policy exploration due to the unreasonable constraints imposed by the real world.
研究背景： 在機器人學習領域，While sim2real efforts are necessary for effective policy transfer to hardware, there is such a thing as too much of a good thing. We argue that sim2real efforts have led to misali

Technical Approach: We argue that sim2real efforts have led to misaligned incentives with policy learning, resulting in simulator lock in and poor policy exploration due to the unreasonable constraints imposed by the real world. We offer a diagnosis and explanation of the current status of the problem, and propose a potential solution via a sim2sim2real paradigm that leverages the robot’s kinematics as the sole design constraint.
技術方法： 本文提出的方法：We argue that sim2real efforts have led to misaligned incentives with policy learning, resulting in simulator lock in and poor policy exploration due to the unreasonable constraints imposed by the real world. We offer a diagnosis and explanation of t

Key Takeaway: We argue that sim2real efforts have led to misaligned incentives with policy learning, resulting in simulator lock in and poor policy exploration due to the unreasonable constraints imposed by the real world.
核心發現： 核心結果：We argue that sim2real efforts have led to misaligned incentives with policy learning, resulting in simulator lock in and poor policy exploration due to the unreasonable constraints imposed by the rea

A Four-Tier Communication Architecture and Sim-to-Real Validation of a Graphical Open-Source Platform for Robotic Engineering Education

Authors: Thien Tran, Khang Duong, Minh Tran et al. | Submitted: 2026-05-30 | arXiv: 2606.00550 Categories: cs.HC, cs.ET, cs.RO

Research Background: The persistent challenge in scaling authentic manipulator education within university laboratories is a structural dichotomy: commercial digital twins are often cost-prohibitive and rigidly scripted, whereas open-source robotics middleware (ROS) imposes steep technical and syntax barriers for novices. To resolve this logistical and educational friction, this Work-in-Progress (WiP) paper propose…
研究背景： 在人機互動領域，The persistent challenge in scaling authentic manipulator education within university laboratories is a structural dichotomy: commercial digital twins are often cost-prohibitive an

Technical Approach: To resolve this logistical and educational friction, this Work-in-Progress (WiP) paper proposes a scalable four-tier communication architecture tailored for sustainable robotic curricula.
技術方法： 本文提出的方法：To resolve this logistical and educational friction, this Work-in-Progress (WiP) paper proposes a scalable four-tier communication architecture tailored for sustainable robotic curricula.

Key Takeaway: By bridging virtual design and physical execution, this architectural blueprint offers a viable infrastructure for engineering education.
核心發現： 核心結果：By bridging virtual design and physical execution, this architectural blueprint offers a viable infrastructure for engineering education.

Spectra-Guided Neural Tucker Factorization

Authors: Fusheng Wang, Yikai Hou | Submitted: 2026-05-30 | arXiv: 2606.00584 Categories: stat.ML, cs.LG

Research Background: This paper proposes Spectra-Guided Neural Tucker Factorization (SG-NTF) for High-Dimensional and Incomplete (HDI) tensor completion. Circumventing discrete representational limits, SG-NTF maps scalar timestamps into a continuous spectral space to abstract temporal periodicities.
研究背景： 在機器人 AI領域，This paper proposes Spectra-Guided Neural Tucker Factorization (SG-NTF) for High-Dimensional and Incomplete (HDI) tensor completion. Circumventing discrete representational limits,

Technical Approach: Concurrently, a Spatio-Temporal Co-Gating (STCG) mechanism explicitly filters latent interactions via multiplicative modulation on spatiotemporal contexts. Evaluations on real-world HDI tensors verify that SG-NTF maintains competitive completion accuracy with parameter efficiency.
技術方法： 本文提出的方法：Concurrently, a Spatio-Temporal Co-Gating (STCG) mechanism explicitly filters latent interactions via multiplicative modulation on spatiotemporal contexts. Evaluations on real-world HDI tensors verify that SG-NTF maintains competitive completion accu

Key Takeaway: Evaluations on real-world HDI tensors verify that SG-NTF maintains competitive completion accuracy with parameter efficiency.
核心發現： 核心結果：Evaluations on real-world HDI tensors verify that SG-NTF maintains competitive completion accuracy with parameter efficiency.

GraspGen-X: Cross-Embodiment 6-DOF Diffusion-based Grasping

Authors: Beining Han, Yu-Wei Chao, Erwin Coumans et al. | Submitted: 2026-05-31 | arXiv: 2606.00998 Categories: cs.RO

Research Background: We study cross-embodiment 6-DOF robot grasping. Unlike prior works, we require the model not only to generalize to novel objects / scenes but also to novel gripper morphologies and physical grasping processes.
研究背景： 在機器人學習領域，We study cross-embodiment 6-DOF robot grasping. Unlike prior works, we require the model not only to generalize to novel objects / scenes but also to novel gripper morphologies and

Technical Approach: Unlike prior works, we require the model not only to generalize to novel objects / scenes but also to novel gripper morphologies and physical grasping processes. Our method extends diffusion model based generative 6-DOF grasping models to condition on the additional gripper’s representation. We propose a swept-volume heuristic for encoding the gripper.
技術方法： 本文提出的方法：Unlike prior works, we require the model not only to generalize to novel objects / scenes but also to novel gripper morphologies and physical grasping processes. Our method extends diffusion model based generative 6-DOF grasping models to condition o

Key Takeaway: In ablations, we demonstrate the efficiency of our sweep-volume gripper representation and our procedural gripper training dataset.
核心發現： 核心結果：In ablations, we demonstrate the efficiency of our sweep-volume gripper representation and our procedural gripper training dataset.

MURMUR: An Efficient Inference System for Long-Form ASR

Authors: Wei-Tzu Lee, Keisuke Kamahori, Baris Kasikci | Submitted: 2026-05-31 | arXiv: 2606.01483 Categories: cs.LG, cs.AI, eess.AS

Research Background: Long-form automatic speech recognition (ASR) requires both high accuracy and low latency, but existing systems force a trade-off between the two. Chunk-based pipelines process audio in parallel windows for low latency, but lose cross-chunk context and need brittle heuristics to align speakers and timestamps at boundaries.
研究背景： 在機器學習與機器人領域，Long-form automatic speech recognition (ASR) requires both high accuracy and low latency, but existing systems force a trade-off between the two. Chunk-based pipelines process audi

Technical Approach: We propose Murmur, an inference system that overcomes this trade-off by operating at two levels.
技術方法： 本文提出的方法：We propose Murmur, an inference system that overcomes this trade-off by operating at two levels.

Key Takeaway: At the inter-chunk level, we revisit the chunk-based pipeline for modern long-context ASR, treating chunk size as a tunable hyperparameter, and show that intermediate chunk sizes strike a good balance of accuracy and latency.
核心發現： 核心結果：At the inter-chunk level, we revisit the chunk-based pipeline for modern long-context ASR, treating chunk size as a tunable hyperparameter, and show that intermediate chunk sizes strike a good balance

Learning-based Directed Graph Abstraction of Combinatorial Spaces for Order-Preserving Search in Mixed-Combinatorial Nonlinear Optimization

Authors: Gishnu Madhu, Feng Liu, Souma Chowdhury | Submitted: 2026-05-31 | arXiv: 2606.01425 Categories: cs.LG

Research Background: Mixed-combinatorial nonlinear programming (MCNLP) problems arise in many engineering design and planning applications, e.g., due to categorical, component, and geometric design choices, as well as joint task and motion planning. Traditional representations of combinatorial spaces, such as integer or binary encoding, often introduce spurious relations, increase dimensionality, and require additi…
研究背景： 在機器學習與機器人領域，Mixed-combinatorial nonlinear programming (MCNLP) problems arise in many engineering design and planning applications, e.g., due to categorical, component, and geometric design cho

Technical Approach: Instead, this paper draws on recent developments in robot planning and vehicle/network routing domains that aim to learn search heuristics over combinatorial spaces using graph neural networks (GNNs). More specifically, this paper presents a first-of-its-kind structured abstraction of the combinatorial space by learning a mapping from an undirected fully connected graph of combinations to a directed graph indicating improvement directions using an Edge Field Graph Network (EFGN).
技術方法： 本文提出的方法：Instead, this paper draws on recent developments in robot planning and vehicle/network routing domains that aim to learn search heuristics over combinatorial spaces using graph neural networks (GNNs). More specifically, this paper presents a first-of

Key Takeaway: Compared to baseline solvers using indexified combinations, the GNN-based recommender consistently achieves better mean optimum values and robustness across multiple runs.
核心發現： 核心結果：Compared to baseline solvers using indexified combinations, the GNN-based recommender consistently achieves better mean optimum values and robustness across multiple runs.

COLLIE: Guiding Skill Discovery in Semantically Coherent Latent Space

Authors: Yao Luan, Ni Mu, Hanfei Ge et al. | Submitted: 2026-05-31 | arXiv: 2606.00950 Categories: cs.LG

Research Background: Unsupervised skill discovery (USD) aims to learn diverse behaviors without reward functions, but often results in task-irrelevant or hazardous behaviors due to uniform exploration. Guided skill discovery (GSD) addresses this issue by incorporating human intent to focus exploration on meaningful regions.
研究背景： 在機器學習與機器人領域，Unsupervised skill discovery (USD) aims to learn diverse behaviors without reward functions, but often results in task-irrelevant or hazardous behaviors due to uniform exploration.

Technical Approach: To overcome this, we propose COLLIE, a GSD framework that leverages dense unsupervised data to construct a semantically coherent skill latent space.
技術方法： 本文提出的方法：To overcome this, we propose COLLIE, a GSD framework that leverages dense unsupervised data to construct a semantically coherent skill latent space.

Key Takeaway: Theoretical analysis justifies the effectiveness of our training-free guidance signal, while experiments across diverse state-based and pixel-based tasks show that COLLIE learns diverse, human-aligned skills, avoids hazardous behaviors, and achieves superior downstream performance with minimal hu…
核心發現： 核心結果：Theoretical analysis justifies the effectiveness of our training-free guidance signal, while experiments across diverse state-based and pixel-based tasks show that COLLIE learns diverse, human-aligned

Authors: Yuyang Sun, Yongliang Wu, Xingyu Zhu et al. | Submitted: 2026-05-31 | arXiv: 2606.01104 Categories: cs.CV

Research Background: VRR-QA evaluates whether video-language systems can infer spatial, temporal, viewpoint, depth, and visibility relations that are not always resolved by a single frame. We present an inference-only system built around adaptive test-time computation.
研究背景： 在電腦視覺與機器人領域，VRR-QA evaluates whether video-language systems can infer spatial, temporal, viewpoint, depth, and visibility relations that are not always resolved by a single frame. We present a

Technical Approach: We present an inference-only system built around adaptive test-time computation.
技術方法： 本文提出的方法：We present an inference-only system built around adaptive test-time computation.

Key Takeaway: VRR-QA evaluates whether video-language systems can infer spatial, temporal, viewpoint, depth, and visibility relations that are not always resolved by a single frame.
核心發現： 核心結果：VRR-QA evaluates whether video-language systems can infer spatial, temporal, viewpoint, depth, and visibility relations that are not always resolved by a single frame.

Authors: Zhengye Han, Quanyan Zhu | Submitted: 2026-05-25 | arXiv: 2605.26348 Categories: cs.RO

Research Background: Mobile robots can fail before they collide: a velocity that is safe now may commit the robot to a passage that moving obstacles will soon close. We study this predictive near-miss commitment problem and propose Risk-Sensitive Conjectural Scenario Planning (RCSP), a planning layer that evaluates candidate commands against plausible short-horizon obstacle futures.
研究背景： 在機器人學習領域，Mobile robots can fail before they collide: a velocity that is safe now may commit the robot to a passage that moving obstacles will soon close. We study this predictive near-miss

Technical Approach: In controlled MuJoCo bottleneck tasks, the RCSP planner reaches the goal without collisions and yields higher secondary safety and path-quality point estimates than a non-adaptive predictor, with additional latency. In ROS2/Gazebo, adding the local safety layer to a standard Nav2 stack reduces dynamic near-miss failures.
技術方法： 本文提出的方法：In controlled MuJoCo bottleneck tasks, the RCSP planner reaches the goal without collisions and yields higher secondary safety and path-quality point estimates than a non-adaptive predictor, with additional latency. In ROS2/Gazebo, adding the local s

Key Takeaway: These simulation results position RCSP as a predictive-risk module that complements existing navigation stacks in dynamic bottleneck regimes.
核心發現： 核心結果：These simulation results position RCSP as a predictive-risk module that complements existing navigation stacks in dynamic bottleneck regimes.

Authors: Deepak Singh, Brijan Vaghasiya, Shreyas Khobragade et al. | Submitted: 2026-05-25 | arXiv: 2605.26330 Categories: cs.RO

Research Background: Small aerial robots are particularly well-suited for search and rescue in confined and hazardous environments due to their agility, low cost, and ability to traverse through cluttered spaces that are inaccessible to larger platforms. However, enabling autonomous navigation in complete darkness remains a significant challenge, because small aerial robots cannot easily accommodate perception syst…
研究背景： 在機器人學習領域，Small aerial robots are particularly well-suited for search and rescue in confined and hazardous environments due to their agility, low cost, and ability to traverse through clutte

Technical Approach: In this work, we present a lightweight perception approach that combines a monocular event camera, a coded aperture lens, and an infrared dot projector to enable navigation in such conditions. Our system operates in real time at 20 Hz on a NVIDIA Jetson Orin Nano, demonstrating suitability for resource-constrained platforms. Our approach gives high accuracy (l1 error 7.0cm) upto 2.5m range (2.80% error).
技術方法： 本文提出的方法：In this work, we present a lightweight perception approach that combines a monocular event camera, a coded aperture lens, and an infrared dot projector to enable navigation in such conditions. Our system operates in real time at 20 Hz on a NVIDIA Jet

Key Takeaway: These results highlight the potential of combining structured illumination, coded optics, and event-based sensing for enabling robust perception and navigation in complete darkness.
核心發現： 核心結果：These results highlight the potential of combining structured illumination, coded optics, and event-based sensing for enabling robust perception and navigation in complete darkness.

Authors: Evangelos Psomiadis, Dipankar Maity, Panagiotis Tsiotras | Submitted: 2026-05-25 | arXiv: 2605.26304 Categories: cs.RO

Research Background: Collaborative navigation of heterogeneous robots in unknown environments poses significant challenges due to sensing, communication, and computational limitations. In this work, a lead robot navigates toward a target while a mobile sensor robot (e.g., a drone) assists by transmitting information about its locally observed map under bandwidth constraints.
研究背景： 在機器人學習領域，Collaborative navigation of heterogeneous robots in unknown environments poses significant challenges due to sensing, communication, and computational limitations. In this work, a

Technical Approach: In this work, a lead robot navigates toward a target while a mobile sensor robot (e.g., a drone) assists by transmitting information about its locally observed map under bandwidth constraints. We propose a framework that enables the sensor to jointly select its transmitted map points and navigation actions online, while also predicting unexplored regions of the environment. To this end, we present $β$ -Sparse Gaussian Processes, a robust variational sparse Gaussian Process model for task-aware…
技術方法： 本文提出的方法：In this work, a lead robot navigates toward a target while a mobile sensor robot (e.g., a drone) assists by transmitting information about its locally observed map under bandwidth constraints. We propose a framework that enables the sensor to jointly

Key Takeaway: Simulations on Mars and Earth maps show that the framework can reduce path cost by 18% relative to no communication and decrease transmitted information by 76% compared to raw-data transmission baselines.
核心發現： 核心結果：Simulations on Mars and Earth maps show that the framework can reduce path cost by 18% relative to no communication and decrease transmitted information by 76% compared to raw-data transmission baseli

RePlan-Bot: Multi-Level Replanning for Embodied Instruction Following

Authors: Xicheng Gong, Guozheng Sun, Peiran Xu et al. | Submitted: 2026-05-25 | arXiv: 2605.25851 Categories: cs.RO

Research Background: Embodied instruction following (EIF) requires agents to understand and execute complex natural language commands within interactive 3D environments. Despite recent advances, existing methods often fail in long-horizon planning and handling irreversible state changes, resulting in low task success rates.
研究背景： 在機器人學習領域，Embodied instruction following (EIF) requires agents to understand and execute complex natural language commands within interactive 3D environments. Despite recent advances, existi

Technical Approach: To address these challenges, we introduce RePlan-Bot, a novel EIF agent that performs multi-level, continuous replanning throughout task execution.
技術方法： 本文提出的方法：To address these challenges, we introduce RePlan-Bot, a novel EIF agent that performs multi-level, continuous replanning throughout task execution.

Key Takeaway: Evaluated on the ALFRED benchmark, RePlan-Bot achieves state-of-the-art performance in both seen and unseen environments, demonstrating superior adaptability and reliability.
核心發現： 核心結果：Evaluated on the ALFRED benchmark, RePlan-Bot achieves state-of-the-art performance in both seen and unseen environments, demonstrating superior adaptability and reliability.

HoLoArm: Deformable Arms for Collision-Tolerant Quadrotor Flight

Authors: Quang Ngoc Pham, Jonas Eschmann, Yang Zhou et al. | Submitted: 2026-05-25 | arXiv: 2605.25790 Categories: cs.RO

Research Background: The increasing use of drones in human-centric applications highlights the need for designs that can survive collisions and recover rapidly, minimizing risks to both humans and the environment. We present HoLoArm, a quadrotor with compliant arms inspired by the nodus structure of dragonfly wings.
研究背景： 在機器人學習領域，The increasing use of drones in human-centric applications highlights the need for designs that can survive collisions and recover rapidly, minimizing risks to both humans and the

Technical Approach: We present HoLoArm, a quadrotor with compliant arms inspired by the nodus structure of dragonfly wings. This work contributes to the morphological design of soft aerial robots with high agility and reliable safety, enabling operation in cluttered and human shared environments, and lays the groundwork for future fully soft drones that integrate compliant structures with intelligent control.
技術方法： 本文提出的方法：We present HoLoArm, a quadrotor with compliant arms inspired by the nodus structure of dragonfly wings. This work contributes to the morphological design of soft aerial robots with high agility and reliable safety, enabling operation in cluttered and

Key Takeaway: Experimental results demonstrate that HoLoArm can passively deform in any direction, including axial one, and recover within 0.3-0.6 s depending on the direction and level of the impact.
核心發現： 核心結果：Experimental results demonstrate that HoLoArm can passively deform in any direction, including axial one, and recover within 0.3-0.6 s depending on the direction and level of the impact.

Authors: Simon Schaefer, Joshua Näf, Stefan Leutenegger | Submitted: 2026-05-25 | arXiv: 2605.25685 Categories: cs.RO

Research Background: Robust and accurate perception of humans in their 3D scene context is essential for integrating robots into everyday environments. Existing approaches, however, often fail to predict plausible and accurate human motion estimates that are consistent with the surrounding scene, especially in the presence of heavy occlusions or partial visibility.
研究背景： 在機器人學習領域，Robust and accurate perception of humans in their 3D scene context is essential for integrating robots into everyday environments. Existing approaches, however, often fail to predi

Technical Approach: We introduce HumanFlow, a latent diffusion model that unifies human motion tracking and forecasting, conditioned on the 3D scene context.
技術方法： 本文提出的方法：We introduce HumanFlow, a latent diffusion model that unifies human motion tracking and forecasting, conditioned on the 3D scene context.

Key Takeaway: We validate our policy in simulation with real human trajectories for MAV social navigation, demonstrating superior navigation performance and remaining collision-free, even under partial observability of the human.
核心發現： 核心結果：We validate our policy in simulation with real human trajectories for MAV social navigation, demonstrating superior navigation performance and remaining collision-free, even under partial observabilit

Authors: Dongzhihan Wang, Yi Du, Jianan Sun et al. | Submitted: 2026-05-25 | arXiv: 2605.25646 Categories: cs.RO

Research Background: Autonomous ground robots operating in large-scale outdoor environments require both robust long-range navigation and fine-grained ”last-mile” exploration. Current advances in visual-language navigation (VLN) work well at short-range tasks, lacking geospatial grounding for long-distance missions.
研究背景： 在機器人學習領域，Autonomous ground robots operating in large-scale outdoor environments require both robust long-range navigation and fine-grained ”last-mile” exploration. Current advances in vis

Technical Approach: To address these challenges, we present G-DRAGON, a retrieval-augmented framework for outdoor, open-world navigation. Experimental results in simulation demonstrate our framework outperforms state-of-the-art baselines.
技術方法： 本文提出的方法：To address these challenges, we present G-DRAGON, a retrieval-augmented framework for outdoor, open-world navigation. Experimental results in simulation demonstrate our framework outperforms state-of-the-art baselines.

Key Takeaway: Experimental results in simulation demonstrate our framework outperforms state-of-the-art baselines.
核心發現： 核心結果：Experimental results in simulation demonstrate our framework outperforms state-of-the-art baselines.

OPAL: Omnidirectional Path-efficient Aerial 3D expLoration

Authors: Yoga Satwik Chappidi, Avideh Zakhor | Submitted: 2026-05-25 | arXiv: 2605.25423 Categories: cs.RO

Research Background: Autonomous exploration is critical for robot mapping unknown environments. Desirable characteristics of exploration algorithms include compute efficiency and small traversed distance during the exploration process.
研究背景： 在機器人學習領域，Autonomous exploration is critical for robot mapping unknown environments. Desirable characteristics of exploration algorithms include compute efficiency and small traversed distan

Technical Approach: Motivated by these, we present Omnidirectional Path-efficient Aerial 3D expLoration (OPAL), an exploration framework centered on deliberate 360-degree yaw rotation at ambiguous branch points rather than compute-heavy global tour planning.
技術方法： 本文提出的方法：Motivated by these, we present Omnidirectional Path-efficient Aerial 3D expLoration (OPAL), an exploration framework centered on deliberate 360-degree yaw rotation at ambiguous branch points rather than compute-heavy global tour planning.

Key Takeaway: We verify our results on a Modal AI drone in two indoor environments by comparing OPAL against FALCON, and find that the traveled distance for a variant of OPAL to be as much as 25% lower than FALCON.
核心發現： 核心結果：We verify our results on a Modal AI drone in two indoor environments by comparing OPAL against FALCON, and find that the traveled distance for a variant of OPAL to be as much as 25% lower than FALCON.

Prior Policy Guided Dual-Agent Coordinated Manipulation Planning of Spacecraft-Manipulator System

Authors: Yuhui Hu, Dong Zhou, Kaihong Ouyang et al. | Submitted: 2026-05-25 | arXiv: 2605.25362 Categories: cs.RO

Research Background: The strong dynamic coupling between the manipulator and the base poses a significant challenge to maintaining spacecraft attitude stability, potentially compromising mission safety. In this paper, we propose a Dual-Agent Coordinated Manipulation Planning (DACMP) framework that simultaneously achieves high-precision end-effector pose reaching for a 6-DoF space manipulator and attitude stabilizat…
研究背景： 在機器人學習領域，The strong dynamic coupling between the manipulator and the base poses a significant challenge to maintaining spacecraft attitude stability, potentially compromising mission safety

Technical Approach: In this paper, we propose a Dual-Agent Coordinated Manipulation Planning (DACMP) framework that simultaneously achieves high-precision end-effector pose reaching for a 6-DoF space manipulator and attitude stabilization of the base spacecraft. To enhance learning efficiency, we present a prior policy-guided Deep Reinforcement Learning algorithm incorporating the Timestep-level Expert Switching Guidance (TESG) mechanism, thereby promoting global convergence and improving task success rates.
技術方法： 本文提出的方法：In this paper, we propose a Dual-Agent Coordinated Manipulation Planning (DACMP) framework that simultaneously achieves high-precision end-effector pose reaching for a 6-DoF space manipulator and attitude stabilization of the base spacecraft. To enha

Key Takeaway: Extensive experiments demonstrate that DACMP significantly outperforms baseline DRL algorithms in terms of task success rate and control precision.
核心發現： 核心結果：Extensive experiments demonstrate that DACMP significantly outperforms baseline DRL algorithms in terms of task success rate and control precision.

Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers

Authors: Keyi Shen, Glen Chou | Submitted: 2026-05-25 | arXiv: 2605.25346 Categories: cs.RO, cs.AI, cs.LG, eess.SY

Research Background: Neural network (NN) dynamics models and control policies achieve strong performance in robotics, but providing sound guarantees under uncertainty remains difficult, especially for closed-loop NN systems. Existing reachability tools provide formal over-approximations, yet are often non-differentiable, overly conservative, or too slow for modern learning and online planning pipelines.
研究背景： 在機器人學習領域，Neural network (NN) dynamics models and control policies achieve strong performance in robotics, but providing sound guarantees under uncertainty remains difficult, especially for

Technical Approach: To address this, we present a parallelizable, differentiable reachability framework in JAX for continuous- and discrete-time systems with analytical and NN-based dynamics and controllers. Our framework combines Taylor-model flowpipe construction with CROWN-style linear bound propagation through a unified representation that preserves affine dependencies while supporting GPU-batched computation and automatic differentiation. Building on this reachability primitive, we develop (i) a certified t…
技術方法： 本文提出的方法：To address this, we present a parallelizable, differentiable reachability framework in JAX for continuous- and discrete-time systems with analytical and NN-based dynamics and controllers. Our framework combines Taylor-model flowpipe construction with

Key Takeaway: Experiments on non-prehensile manipulation and quadrotor tasks, including hardware and higher-dimensional evaluations (up to 72D), demonstrate practical online planning while maintaining certified reachable-set over-approximations under bounded uncertainty.
核心發現： 核心結果：Experiments on non-prehensile manipulation and quadrotor tasks, including hardware and higher-dimensional evaluations (up to 72D), demonstrate practical online planning while maintaining certified rea

Active Query Synthesis for Preference Learning

Authors: Namrata Nadagouda, Nauman Ahad, Maegan Tucker et al. | Submitted: 2026-05-25 | arXiv: 2605.26072 Categories: cs.LG

Research Background: Efficient learning of user preferences is crucial for many modern decision making systems but typically requires costly labeled data. Active learning reduces this cost, yet standard methods are computationally expensive due to pool-based evaluation.
研究背景： 在機器學習與機器人領域，Efficient learning of user preferences is crucial for many modern decision making systems but typically requires costly labeled data. Active learning reduces this cost, yet standar

Technical Approach: To address the issue of feedback reliability, we introduce a novel confidence aware response model that explicitly accounts for these ambiguous comparisons. To overcome the computational bottleneck of pool-based evaluation, we propose an active query synthesis framework, Info-Synth that generates optimal queries by maximizing a mutual information-based objective within a continuous space. Moreover, we propose two strategies, Pair M-dist and Pair Opt-dist, that extend Info-Synth to select effe…
技術方法： 本文提出的方法：To address the issue of feedback reliability, we introduce a novel confidence aware response model that explicitly accounts for these ambiguous comparisons. To overcome the computational bottleneck of pool-based evaluation, we propose an active query

Key Takeaway: We demonstrate our framework’s versatility and performance across synthetic preference learning, constrained text summary datasets, and subjective, continuous-space controller gain tuning for a simulated mobile robot.
核心發現： 核心結果：We demonstrate our framework’s versatility and performance across synthetic preference learning, constrained text summary datasets, and subjective, continuous-space controller gain tuning for a simula

Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation

Authors: Junwei Zhou, Yu-Wing Tai | Submitted: 2026-05-25 | arXiv: 2605.25326 Categories: cs.CV

Research Background: Building structured 3D scene layouts from a single image requires reconciling visual observations with physical and spatial constraints, a challenge that is difficult to address with direct prediction alone. In this work, we formulate monocular 3D layout estimation as a perceive-then-plan problem with vision-language models, where a Perceiver first grounds the 3D objects and then a Planner iter…
研究背景： 在電腦視覺與機器人領域，Building structured 3D scene layouts from a single image requires reconciling visual observations with physical and spatial constraints, a challenge that is difficult to address wi

Technical Approach: In this work, we formulate monocular 3D layout estimation as a perceive-then-plan problem with vision-language models, where a Perceiver first grounds the 3D objects and then a Planner iteratively refines the scene hypothesis through actions that improve physical plausibility while preserving consistency with the input image. We propose Layout-as-Policy (LaP), which casts the planning stage as a policy learning problem: 3D layouts are represented as structured states, and refined via discrete…
技術方法： 本文提出的方法：In this work, we formulate monocular 3D layout estimation as a perceive-then-plan problem with vision-language models, where a Perceiver first grounds the 3D objects and then a Planner iteratively refines the scene hypothesis through actions that imp

Key Takeaway: Experiments demonstrate that our approach produces layouts that are more physically coherent and better aligned with visual observations, while naturally supporting downstream tasks such as scene editing and manipulation.
核心發現： 核心結果：Experiments demonstrate that our approach produces layouts that are more physically coherent and better aligned with visual observations, while naturally supporting downstream tasks such as scene edit

AURA: Asymptotically Optimal Uncertainty-Robust Replanning Algorithm for Kinodynamic Systems

Authors: Seyedali Golestaneh, Zhuoyun Zhong, Donghyung Lee et al. | Submitted: 2026-05-26 | arXiv: 2605.27699 Categories: cs.RO

Research Background: Sampling-based motion planners offer a practical and scalable approach to kinodynamic motion planning, notably for high-dimensional, underactuated, or non-holonomic systems. However, these planners are typically used offline, requiring execution to begin only after the trajectory has been computed.
研究背景： 在機器人學習領域，Sampling-based motion planners offer a practical and scalable approach to kinodynamic motion planning, notably for high-dimensional, underactuated, or non-holonomic systems. Howeve

Technical Approach: In this work, these limitations were addressed within a unified framework, \method, an asymptotically-optimal meta-planner framework that improves both path quality and tracking performance during execution.
技術方法： 本文提出的方法：In this work, these limitations were addressed within a unified framework, \method, an asymptotically-optimal meta-planner framework that improves both path quality and tracking performance during execution.

Key Takeaway: The proposed approach is evaluated in both simulation and real-world environments across multiple systems, demonstrating consistent improvements in trajectory quality, tracking accuracy, and overall performance compared with baseline methods.
核心發現： 核心結果：The proposed approach is evaluated in both simulation and real-world environments across multiple systems, demonstrating consistent improvements in trajectory quality, tracking accuracy, and overall p

Simulation-Informed Diffusion for Decentralized Multi-robot Motion Planning

Authors: Jinhao Liang, Sven Koenig, Ferdinando Fioretto | Submitted: 2026-05-26 | arXiv: 2605.27697 Categories: cs.RO, cs.AI, cs.LG

Research Background: Decentralized multi-robot motion planning requires each robot to generate collision-free trajectories from local observations, without global sensing or reliable communication. However, most existing planners, whether classical or learning-based, generate trajectories from a static snapshot of the local observation, which limits their ability to anticipate the future behavior of neighboring rob…
研究背景： 在機器人學習領域，Decentralized multi-robot motion planning requires each robot to generate collision-free trajectories from local observations, without global sensing or reliable communication. How

Technical Approach: To overcome this challenge, this paper introduces Simulation-Informed Diffusion (SID), a decentralized framework built on constraint-aware diffusion models (CADM).
技術方法： 本文提出的方法：To overcome this challenge, this paper introduces Simulation-Informed Diffusion (SID), a decentralized framework built on constraint-aware diffusion models (CADM).

Key Takeaway: Experiments across diverse environments show that SID consistently outperforms baseline methods in terms of planning effectiveness and constraint satisfaction, and scales to scenarios with 108 robots and 160 obstacles.
核心發現： 核心結果：Experiments across diverse environments show that SID consistently outperforms baseline methods in terms of planning effectiveness and constraint satisfaction, and scales to scenarios with 108 robots

Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Data

Authors: Marcus G Müller, Wout Boerdijk, Maximilian Durner et al. | Submitted: 2026-05-26 | arXiv: 2605.27644 Categories: cs.RO, cs.AI, cs.LG

Research Background: Terrain understanding is fundamental for mobile robots operating in unstructured outdoor environments. Existing vision-based traversability estimation methods rely on robot-specific annotations or semantic class mappings, limiting transferability across platforms and requiring costly re-annotation when robot capabilities change, while standard semantic segmentation methods only focus on specifi…
研究背景： 在機器人學習領域，Terrain understanding is fundamental for mobile robots operating in unstructured outdoor environments. Existing vision-based traversability estimation methods rely on robot-specifi

Technical Approach: In this work, we propose a transformer-based architecture that jointly performs class-specific semantic segmentation and class-agnostic terrain segmentation within a unified network, called Trinity. Furthermore, we present the EXTerra Dataset, providing real-world images annotated with both class-specific and class-agnostic terrain labels.
技術方法： 本文提出的方法：In this work, we propose a transformer-based architecture that jointly performs class-specific semantic segmentation and class-agnostic terrain segmentation within a unified network, called Trinity. Furthermore, we present the EXTerra Dataset, provid

Key Takeaway: Experiments demonstrate the feasibility of the proposed task and the effectiveness of our joint segmentation approach in complex outdoor environments.
核心發現： 核心結果：Experiments demonstrate the feasibility of the proposed task and the effectiveness of our joint segmentation approach in complex outdoor environments.

SCALE-COMM: Shared, Contrastively-Aligned Latent Embeddings for MARL Communication

Authors: Mahmoud Abouelyazid, Eman Hammad | Submitted: 2026-05-26 | arXiv: 2605.27532 Categories: cs.RO

Research Background: Emergent communication enables partially observant Autonomous Mobile Robots (AMRs) to coordinate effectively in decentralized multi-agent reinforcement learning (MARL) settings. However, existing approaches often struggle with unstable communication protocols, ungrounded message semantics, and interference between communication learning and policy optimization, leading to degraded coordination …
研究背景： 在機器人學習領域，Emergent communication enables partially observant Autonomous Mobile Robots (AMRs) to coordinate effectively in decentralized multi-agent reinforcement learning (MARL) settings. Ho

Technical Approach: We propose SCALE-COMM (Shared, Contrastively-Aligned Latent Embeddings for COMMunication), a self-supervised framework for learning compact, stable, and policy-relevant communication representations.
技術方法： 本文提出的方法：We propose SCALE-COMM (Shared, Contrastively-Aligned Latent Embeddings for COMMunication), a self-supervised framework for learning compact, stable, and policy-relevant communication representations.

Key Takeaway: The learned communication space yields improved stability, sample efficiency, and throughput under policy fine-tuning, demonstrating the effectiveness of representation-driven communication for scalable multi-agent coordination.
核心發現： 核心結果：The learned communication space yields improved stability, sample efficiency, and throughput under policy fine-tuning, demonstrating the effectiveness of representation-driven communication for scalab

Towards Drone-based Mapping of Volcanic Gases using Gas Tomography

Authors: Marius Schaab, Niklas Karbach, Antonia Rabe et al. | Submitted: 2026-05-26 | arXiv: 2605.27180 Categories: cs.RO

Research Background: Volcanoes emit large amounts of CO2, directly influencing human lives. Mapping volcanic gas emissions helps to forecast eruptions and understand the impact of volcanoes on climate and the environment.
研究背景： 在機器人學習領域，Volcanoes emit large amounts of CO2, directly influencing human lives. Mapping volcanic gas emissions helps to forecast eruptions and understand the impact of volcanoes on climate

Technical Approach: We present a novel model-based gas tomographic reconstruction approach that incorporates a Lagrangian model to compensate for wind-induced advection.
技術方法： 本文提出的方法：We present a novel model-based gas tomographic reconstruction approach that incorporates a Lagrangian model to compensate for wind-induced advection.

Key Takeaway: The resulting gas distribution maps align with manually collected in-situ measurements, confirming that model-based gas tomography effectively overcomes downwash limitations and enables accurate mapping of volcanic emissions.
核心發現： 核心結果：The resulting gas distribution maps align with manually collected in-situ measurements, confirming that model-based gas tomography effectively overcomes downwash limitations and enables accurate mappi

TCBiRRT: Rapid Motion Planning for Tightly Coupled Dual-arm Space Manipulator Using Task-space Random Expansion

Authors: Jiawei Zhang, Xinhao Miao, Jifeng Guo et al. | Submitted: 2026-05-26 | arXiv: 2605.27167 Categories: cs.RO

Research Background: Planning the motion path for a tightly coupled dual-arm space manipulator under closed-chain constraints is a fundamental yet challenging problem in on-orbit assembly of large-scale space structures. The closed-chain constraints significantly reduce the feasible configuration space, making it difficult for existing planners to efficiently generate collision-free motions, especially in cluttered…
研究背景： 在機器人學習領域，Planning the motion path for a tightly coupled dual-arm space manipulator under closed-chain constraints is a fundamental yet challenging problem in on-orbit assembly of large-scal

Technical Approach: To address this issue, this paper proposes a task-space constrained bidirectional rapidly-exploring random tree algorithm, termed TCBiRRT.
技術方法： 本文提出的方法：To address this issue, this paper proposes a task-space constrained bidirectional rapidly-exploring random tree algorithm, termed TCBiRRT.

Key Takeaway: The results demonstrate that TCBiRRT achieves significantly higher success rates and orders-of-magnitude improvements in planning time compared to state-of-the-art planners.
核心發現： 核心結果：The results demonstrate that TCBiRRT achieves significantly higher success rates and orders-of-magnitude improvements in planning time compared to state-of-the-art planners.

YOLO26-RipeLoc Lite: A lightweight architecture for tomato ripeness detection and picking point localization in greenhouse robotic harvesting

Authors: Rajmeet Singh, Manveen Kaur, Shahpour Alirezaee et al. | Submitted: 2026-05-26 | arXiv: 2605.27129 Categories: cs.CV, cs.RO

Research Background: In greenhouse tomato production, automated harvesting requires accurate detection of ripe tomatoes, ripeness classification, and precise picking-point localization for robotic end-effectors. This paper proposes YOLO26-RipeLoc Lite, a lightweight deep learning architecture based on YOLO26 for simultaneous detection, ripeness classification, and center-point localization of greenhouse tomatoes.
研究背景： 在電腦視覺與機器人領域，In greenhouse tomato production, automated harvesting requires accurate detection of ripe tomatoes, ripeness classification, and precise picking-point localization for robotic end-

Technical Approach: This paper proposes YOLO26-RipeLoc Lite, a lightweight deep learning architecture based on YOLO26 for simultaneous detection, ripeness classification, and center-point localization of greenhouse tomatoes.
技術方法： 本文提出的方法：This paper proposes YOLO26-RipeLoc Lite, a lightweight deep learning architecture based on YOLO26 for simultaneous detection, ripeness classification, and center-point localization of greenhouse tomatoes.

Key Takeaway: Comparisons with YOLOv8n/s, YOLO11n/s, YOLO12n/s, and YOLO26s confirm superior accuracy-efficiency: 2.9 pp higher precision than YOLO12n with 7.0% fewer parameters and integrated center-point localization for robotic end-effector guidance.
核心發現： 核心結果：Comparisons with YOLOv8n/s, YOLO11n/s, YOLO12n/s, and YOLO26s confirm superior accuracy-efficiency: 2.9 pp higher precision than YOLO12n with 7.0% fewer parameters and integrated center-point localiza

Learning to Balance Motor Thermal Safety and Quadrupedal Locomotion Performance with Residual Policy

Authors: Yuhang Wan, Weixian Lin, Letian Qian et al. | Submitted: 2026-05-26 | arXiv: 2605.27046 Categories: cs.RO

Research Background: Motor thermal management is often overlooked in the context of electrically-actuated robots, particularly legged robots, but motor overheating is a key factor that limits long-duration locomotion especially under payload conditions. This paper integrates a whole-body thermal model of a quadruped robot into the reinforcement learning pipeline to update motor temperatures, and proposes a two-stag…
研究背景： 在機器人學習領域，Motor thermal management is often overlooked in the context of electrically-actuated robots, particularly legged robots, but motor overheating is a key factor that limits long-dura

Technical Approach: This paper integrates a whole-body thermal model of a quadruped robot into the reinforcement learning pipeline to update motor temperatures, and proposes a two-stage training framework for motor thermal management.
技術方法： 本文提出的方法：This paper integrates a whole-body thermal model of a quadruped robot into the reinforcement learning pipeline to update motor temperatures, and proposes a two-stage training framework for motor thermal management.

Key Takeaway: Real-world experiments on a Unitree A1 quadruped robot further validate the approach: under a 3 kg payload, the robot achieves stable locomotion across multiple terrains for over 13 minutes, while the nominal policy alone leads to motor overheating in about 5 minutes.
核心發現： 核心結果：Real-world experiments on a Unitree A1 quadruped robot further validate the approach: under a 3 kg payload, the robot achieves stable locomotion across multiple terrains for over 13 minutes, while the

Authors: Yuhang Zhang, Shuqi Chai, Yukang Zhang et al. | Submitted: 2026-05-26 | arXiv: 2605.26974 Categories: cs.RO

Research Background: Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea (COLREGs) remains a formidable challenge in dynamic maritime environments, particularly when perception systems exhibit miscalibrated uncertainty. Existing Reinforcement Learning (RL)-based methods often falter because state-estimation errors i…
研究背景： 在機器人學習領域，Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea (COLREGs) remains a formida

Technical Approach: To address these challenges, we propose a framework integrating credibility-aware learning, geometric safety shielding, and continuous rule-aware embedding.
技術方法： 本文提出的方法：To address these challenges, we propose a framework integrating credibility-aware learning, geometric safety shielding, and continuous rule-aware embedding.

Key Takeaway: Simulated encounter studies demonstrate improved training robustness against perceptual inconsistency and superior collision avoidance and COLREGs compliance over baselines.
核心發現： 核心結果：Simulated encounter studies demonstrate improved training robustness against perceptual inconsistency and superior collision avoidance and COLREGs compliance over baselines.

A Bioinspired Underwater Robot with a Latch-Mediated Soft Bistable Mechanism

Authors: Chongze Bi, Wenjie Wu, Zonghao Zuo et al. | Submitted: 2026-05-26 | arXiv: 2605.26936 Categories: cs.RO

Research Background: Underwater robotics has advanced significantly over recent decades. however, the development of miniaturized underwater robots remains limited by low energy densities of traditional power sources.
研究背景： 在機器人學習領域，Underwater robotics has advanced significantly over recent decades. however, the development of miniaturized underwater robots remains limited by low energy densities of traditiona

Technical Approach: In this work, we introduce a bioinspired, soft bistable actuator with an integrated latch mechanism that enables asymmetric energy input and release using a single motor. This study presents a novel, energy-efficient approach for controlling motion in compact underwater robots, paving the way for advanced biomimetic designs with potential applications in exploration, environmental monitoring, and inspection.
技術方法： 本文提出的方法：In this work, we introduce a bioinspired, soft bistable actuator with an integrated latch mechanism that enables asymmetric energy input and release using a single motor. This study presents a novel, energy-efficient approach for controlling motion i

Key Takeaway: By modulating fin angles, the robot achieves versatile motions, including vertical ascent, diagonal forward movement, and lateral translation.
核心發現： 核心結果：By modulating fin angles, the robot achieves versatile motions, including vertical ascent, diagonal forward movement, and lateral translation.

OSMa-Bench++: Toward Open-Ended Benchmarking of Semantic Mapping for Manipulation with Prompt-Generated Synthetic Scenes

Authors: Regina Kurkova, Maxim Popov, Sergey Kolyubin | Submitted: 2026-05-26 | arXiv: 2605.26831 Categories: cs.CV, cs.RO

Research Background: Semantic mapping methods are increasingly used as intermediate scene representations for downstream robotic reasoning and manipulation, yet their evaluation is still largely tied to fixed benchmark datasets with limited coverage of manipulation-relevant corner cases. In this work, we extend OSMa-Bench toward controllable benchmarking with prompt-generated synthetic indoor scenes.
研究背景： 在電腦視覺與機器人領域，Semantic mapping methods are increasingly used as intermediate scene representations for downstream robotic reasoning and manipulation, yet their evaluation is still largely tied t

Technical Approach: In this work, we extend OSMa-Bench toward controllable benchmarking with prompt-generated synthetic indoor scenes.
技術方法： 本文提出的方法：In this work, we extend OSMa-Bench toward controllable benchmarking with prompt-generated synthetic indoor scenes.

Key Takeaway: The resulting framework supports targeted stress-testing of semantic scene representations under conditions such as clutter, small objects, partial occlusions, and lighting variation, and makes benchmarking more extensible and better aligned with downstream manipulation requirements.
核心發現： 核心結果：The resulting framework supports targeted stress-testing of semantic scene representations under conditions such as clutter, small objects, partial occlusions, and lighting variation, and makes benchm

PEACE: A Planner-Executor Agent with Constraint Enforcement for UAVs

Authors: Erdem Uysal, Timo Kehrer, Sebastiano Panichella | Submitted: 2026-05-26 | arXiv: 2606.00104 Categories: cs.RO, cs.AI

Research Background: Foundation models are increasingly used to drive autonomous systems, yet existing approaches either keep the model in a tight control loop, raising latency and hallucination risk, or compile natural language into opaque end-to-end policies that are hard to explain, constraint and require domain-specific datasets and fine-tuning. We propose a planner-executor agent for PX4-based drones that deco…
研究背景： 在機器人學習領域，Foundation models are increasingly used to drive autonomous systems, yet existing approaches either keep the model in a tight control loop, raising latency and hallucination risk,

Technical Approach: We propose a planner-executor agent for PX4-based drones that decouples high-level mission planning from low-level control. We position our approach within three common design patterns for foundation-model-based robotics systems and demonstrate its feasibility in PX4 software-in-the-loop simulations in Gazebo.
技術方法： 本文提出的方法：We propose a planner-executor agent for PX4-based drones that decouples high-level mission planning from low-level control. We position our approach within three common design patterns for foundation-model-based robotics systems and demonstrate its f

Key Takeaway: Results highlight improved explainability, constraint enforcement, and reduced LLM calls compared to tightly coupled LLM control.
核心發現： 核心結果：Results highlight improved explainability, constraint enforcement, and reduced LLM calls compared to tightly coupled LLM control.

SteelDS: A High-Resolution Video Dataset of E40 Steel Scrap for Object Detection and Instance Segmentation

Authors: Melanie Neubauer, Christian Rauch, Gerald Koinig et al. | Submitted: 2026-05-26 | arXiv: 2605.26682 Categories: cs.RO, cs.CV

Research Background: This dataset provides high-resolution, annotated video sequences of shredded E40-grade steel and copper scrap on a conveyor belt. Captured in a controlled laboratory environment, the data reflects the industrial post-magnetic sorting stage, where manual intervention is typically required to remove copper contaminants.
研究背景： 在機器人學習領域，This dataset provides high-resolution, annotated video sequences of shredded E40-grade steel and copper scrap on a conveyor belt. Captured in a controlled laboratory environment, t

Technical Approach: It supports the development of machine learning models for material classification, object detection, and instance segmentation. Variations in object spacing and density are included to simulate realistic industrial sorting conditions.
技術方法： 本文提出的方法：It supports the development of machine learning models for material classification, object detection, and instance segmentation. Variations in object spacing and density are included to simulate realistic industrial sorting conditions.

Key Takeaway: This dataset serves as a benchmark for evaluating automated sorting algorithms aiming to identify copper impurities within complex, heterogeneous steel scrap streams.
核心發現： 核心結果：This dataset serves as a benchmark for evaluating automated sorting algorithms aiming to identify copper impurities within complex, heterogeneous steel scrap streams.

Enabling Extensible Embodied Capabilities with Tools

Authors: Xueyang Zhou, Zijia Wang, Qianjiang Li et al. | Submitted: 2026-05-26 | arXiv: 2605.26637 Categories: cs.RO

Research Background: Most existing embodied intelligence methods formulate perception, reasoning, planning, and control within a unified parameterized policy. Yet these capabilities are inherently hierarchical and heterogeneous, making them difficult to reliably learn and modularize within a single model.
研究背景： 在機器人學習領域，Most existing embodied intelligence methods formulate perception, reasoning, planning, and control within a unified parameterized policy. Yet these capabilities are inherently hier

Technical Approach: We propose a capability externalization approach that decouples heterogeneous capabilities into independently optimized tools, dynamically invoked at inference time. To this end, we introduce Embodied Tool Protocol (ETP), a standardized protocol for embodied tool registration, discovery, invocation, and execution, and curate 100+ validated tools spanning perception, cognition, reasoning, and execution as the tool base.
技術方法： 本文提出的方法：We propose a capability externalization approach that decouples heterogeneous capabilities into independently optimized tools, dynamically invoked at inference time. To this end, we introduce Embodied Tool Protocol (ETP), a standardized protocol for

Key Takeaway: Experiments across simulation and real-world platforms confirm that capability externalization consistently improves embodied performance (avg.
核心發現： 核心結果：Experiments across simulation and real-world platforms confirm that capability externalization consistently improves embodied performance (avg.

Provably Safe Motion Planning Under Unknown Disturbances

Authors: Ibon Gracia, Qi Heng Ho, Luca Laurenti et al. | Submitted: 2026-05-26 | arXiv: 2605.26625 Categories: cs.RO, eess.SY

Research Background: We present a provably safe sampling-based motion planning algorithm for robotic systems affected by random disturbances of unknown distribution. We consider systems with linear or linearizable dynamics evolving in workspace with arbitrary-shaped obstacles subject to state and control constraints.
研究背景： 在機器人學習領域，We present a provably safe sampling-based motion planning algorithm for robotic systems affected by random disturbances of unknown distribution. We consider systems with linear or

Technical Approach: Our approach leverages data from trajectories of the system to learn a Wasserstein ambiguity tube, i.e., a sequence of ambiguity sets, which contains the trajectory of the system’s state distribution with high confidence. Additionally, we design an efficient bandit-based validity checker that remarkably increases the empirical performance of our approach without sacrificing probabilistic completeness.
技術方法： 本文提出的方法：Our approach leverages data from trajectories of the system to learn a Wasserstein ambiguity tube, i.e., a sequence of ambiguity sets, which contains the trajectory of the system’s state distribution with high confidence. Additionally, we design an e

Key Takeaway: Case studies show our algorithm finds valid plans in cluttered environments under strict safety thresholds, outperforming state-of-the-art methods.
核心發現： 核心結果：Case studies show our algorithm finds valid plans in cluttered environments under strict safety thresholds, outperforming state-of-the-art methods.

Heterogeneous AAV Logistics Task Allocation: A Reinforcement Learning Enhanced Overlapping Coalition Formation Game Approach

Authors: Yuze Zhou, Jingliang Sun, Junzhi Li et al. | Submitted: 2026-05-26 | arXiv: 2605.26471 Categories: cs.RO

Research Background: In dynamic urban logistics, the stochastic emergence of time-sensitive tasks poses a significant optimality challenge for heterogeneous AAVs logistics task allocation. To address this problem, a reinforcement learning enhanced overlapping coalition formation game approach is proposed.
研究背景： 在機器人學習領域，In dynamic urban logistics, the stochastic emergence of time-sensitive tasks poses a significant optimality challenge for heterogeneous AAVs logistics task allocation. To address t

Technical Approach: On this basis, heterogeneous AAVs can form more efficient overlapping coalitions for dynamic logistics tasks. The resulting coalition formation process is proven to constitute an exact potential game, which guarantees convergence to a Nash-stable equilibrium within a finite number of iterations.
技術方法： 本文提出的方法：On this basis, heterogeneous AAVs can form more efficient overlapping coalitions for dynamic logistics tasks. The resulting coalition formation process is proven to constitute an exact potential game, which guarantees convergence to a Nash-stable equ

Key Takeaway: In a scenario with 32 AAVs and 80 tasks, our algorithm achieves a 39.76% cost reduction compared with the heuristic OCF baseline.
核心發現： 核心結果：In a scenario with 32 AAVs and 80 tasks, our algorithm achieves a 39.76% cost reduction compared with the heuristic OCF baseline.

Robust Koopman Control Barrier Filters for Safe Actor-Critic Reinforcement Learning

Authors: Dhruv S. Kushwaha, Zoleikha A. Biron | Submitted: 2026-05-26 | arXiv: 2605.26452 Categories: cs.RO, cs.LG, eess.SY

Research Background: Safe reinforcement learning (RL) for robotic systems requires policies that improve task performance while satisfying state and input constraints during both training and deployment. Control barrier functions (CBFs) provide a principled mechanism for enforcing forward invariance through minimally invasive safety filters, but their use in model-free RL is limited by the need for accurate dynamic…
研究背景： 在機器人學習領域，Safe reinforcement learning (RL) for robotic systems requires policies that improve task performance while satisfying state and input constraints during both training and deploymen

Technical Approach: We propose Robust Koopman-CBF SAC, a safety-filtered actor—critic framework that learns a finite-dimensional Koopman predictor from data, constructs affine CBF constraints in the lifted space, and enforces them through a quadratic-program safety layer.
技術方法： 本文提出的方法：We propose Robust Koopman-CBF SAC, a safety-filtered actor—critic framework that learns a finite-dimensional Koopman predictor from data, constructs affine CBF constraints in the lifted space, and enforces them through a quadratic-program safety lay

Key Takeaway: These results suggest that robust Koopman-CBF filters are a promising bridge between model-free RL and certifiable safety, while clarifying the structural conditions under which such filters remain effective.
核心發現： 核心結果：These results suggest that robust Koopman-CBF filters are a promising bridge between model-free RL and certifiable safety, while clarifying the structural conditions under which such filters remain ef

Ratio-Variance Regularized Policy Optimization

Authors: Yu Luo, Shuo Han, Yihan Hu et al. | Submitted: 2026-05-26 | arXiv: 2605.26784 Categories: cs.LG, cs.AI

Research Background: Standard on-policy reinforcement learning relies on heuristic clipping to enforce trust regions, but this mechanism imposes a severe cost by indiscriminately truncating high-return yet high-divergence updates. We demonstrate that explicitly constraining the policy ratio variance provides a principled local approximation to trust-region constraints, eliminating the need for binary hard clipping.
研究背景： 在機器學習與機器人領域，Standard on-policy reinforcement learning relies on heuristic clipping to enforce trust regions, but this mechanism imposes a severe cost by indiscriminately truncating high-return

Technical Approach: By acting as a distributional soft brake'', this approach preserves critical gradient signals from novel discoveries while naturally down-weighting and enabling the reuse of stale, off-policy data. We introduce ${\bf R}^2{\bf VPO}$ (Ratio-Variance Regularized Policy Optimization), which implements this constraint via a primal-dual optimization framework. **技術方法：** 本文提出的方法：By acting as a distributional soft brake”, this approach preserves critical gradient signals from novel discoveries while naturally down-weighting and enabling the reuse of stale, off-policy data. We introduce $R^{2} VPO$ (Ratio-Variance

Key Takeaway: Furthermore, it consistently outperforms PPO baselines in continuous control domains, particularly in sparse-reward and dynamic environments.
核心發現： 核心結果：Furthermore, it consistently outperforms PPO baselines in continuous control domains, particularly in sparse-reward and dynamic environments.

Authors: Jihyeon Kim, Sohee Kim, Soosan Lee et al. | Submitted: 2026-05-26 | arXiv: 2605.27348 Categories: cs.CV, cs.AI

Research Background: Recent generative models have largely closed the gap on low-level artifacts - pixel fingerprints, frequency anomalies, upsampling traces - particularly in person-centric and partial-edit settings where the manipulated region is small and surrounded by photometrically authentic content. We introduce Social Gaze Consistency, a high-level semantic cue defined as the mutual coherence of gaze direct…
研究背景： 在電腦視覺與機器人領域，Recent generative models have largely closed the gap on low-level artifacts - pixel fingerprints, frequency anomalies, upsampling traces - particularly in person-centric and partia

Technical Approach: We introduce Social Gaze Consistency, a high-level semantic cue defined as the mutual coherence of gaze direction, head-eye alignment, and pupil placement between interacting individuals, and show that it constitutes a previously underutilized detection axis orthogonal to existing low-level paradigms.
技術方法： 本文提出的方法：We introduce Social Gaze Consistency, a high-level semantic cue defined as the mutual coherence of gaze direction, head-eye alignment, and pupil placement between interacting individuals, and show that it constitutes a previously underutilized detect

Key Takeaway: We instantiate this insight through three coupled mechanisms: (i) a controlled diagnostic dataset with region-specific perturbations of gaze-consistent imagery, where strict pair-level grouping forecloses generator-fingerprint memorization as an optimization-time shortcut rather than relying on a…
核心發現： 核心結果：We instantiate this insight through three coupled mechanisms: (i) a controlled diagnostic dataset with region-specific perturbations of gaze-consistent imagery, where strict pair-level grouping forecl

DelowlightSplat: Feed-Forward Gaussian Splatting for Lowlight 3D Scene Reconstruction

Authors: Fuzhen Jiang, Zengtian Xie, Zhuoran Li | Submitted: 2026-05-26 | arXiv: 2605.26629 Categories: cs.CV

Research Background: Novel-view synthesis and 3D reconstruction from sparse posed images are central to robotics and AR/VR. Yet, feed-forward 3D Gaussian reconstruction fails under lowlight due to noise, color shifts, and unreliable correspondence.
研究背景： 在電腦視覺與機器人領域，Novel-view synthesis and 3D reconstruction from sparse posed images are central to robotics and AR/VR. Yet, feed-forward 3D Gaussian reconstruction fails under lowlight due to nois

Technical Approach: We propose DelowlightSplat, a lowlight-aware feed-forward Gaussian splatting framework for clean novel-view rendering. We build a controllable multi-view lowlight benchmark by degrading only context views while keeping target views clean. We introduce a lightweight Lowlight Adapter for residual enhancement to improve matchability, and couple it with cost-volume-based multi-view inference to directly predict clean 3D Gaussians.
技術方法： 本文提出的方法：We propose DelowlightSplat, a lowlight-aware feed-forward Gaussian splatting framework for clean novel-view rendering. We build a controllable multi-view lowlight benchmark by degrading only context views while keeping target views clean. We introduc

Key Takeaway: Experiments show that DelowlightSplat significantly outperforms previous feed-forward method and two-stage pipeline under lowlight conditions.
核心發現： 核心結果：Experiments show that DelowlightSplat significantly outperforms previous feed-forward method and two-stage pipeline under lowlight conditions.

CA-AC-MPC: CUDA-Accelerated Actor-Critic Model Predictive Control

Authors: Antoonio Buo, Vittorio Cammarota, Michele Avagnale et al. | Submitted: 2026-05-27 | arXiv: 2605.29155 Categories: cs.RO, cs.AI, cs.DC

Research Background: In the literature, actor-critic model predictive control (AC-MPC) integrates MPC with reinforcement learning to enable high-performance control of complex dynamical systems. However, its differentiable MPC layer requires repeatedly solving an optimization problem in both the forward and backward passes, leading to substantial training and inference latency.
研究背景： 在機器人學習領域，In the literature, actor-critic model predictive control (AC-MPC) integrates MPC with reinforcement learning to enable high-performance control of complex dynamical systems. Howeve

Technical Approach: This paper tackles this bottleneck introducing a CUDA-accelerated variant that significantly reduces end-to-end execution time while preserving the control performance of the baseline formulation. Simulation results on an agile drone racing task show that our approach achieves state-of-the-art lap times and near-limit dynamic behaviour with markedly reduced training and inference time.
技術方法： 本文提出的方法：This paper tackles this bottleneck introducing a CUDA-accelerated variant that significantly reduces end-to-end execution time while preserving the control performance of the baseline formulation. Simulation results on an agile drone racing task show

Key Takeaway: Simulation results on an agile drone racing task show that our approach achieves state-of-the-art lap times and near-limit dynamic behaviour with markedly reduced training and inference time.
核心發現： 核心結果：Simulation results on an agile drone racing task show that our approach achieves state-of-the-art lap times and near-limit dynamic behaviour with markedly reduced training and inference time.

Authors: Amar Halilovic, Vahidin Hasic, Senka Krivic | Submitted: 2026-05-27 | arXiv: 2606.00117 Categories: cs.RO

Research Background: This paper proposes ontology-guided reasoning for affordance-based explanations of robot navigation. In human environments, it is not sufficient for a robot to detect that its route is blocked.
研究背景： 在機器人學習領域，This paper proposes ontology-guided reasoning for affordance-based explanations of robot navigation. In human environments, it is not sufficient for a robot to detect that its rout

Technical Approach: This yields explanations that are not only semantically grounded but also actionable. We instantiate the approach in a lightweight benchmark centered on a robot librarian scenario and evaluate it on procedurally generated navigation cases.
技術方法： 本文提出的方法：This yields explanations that are not only semantically grounded but also actionable. We instantiate the approach in a lightweight benchmark centered on a robot librarian scenario and evaluate it on procedurally generated navigation cases.

Key Takeaway: The results show that ontology-guided reasoning identifies relevant explanation factors more accurately than a semantic-only baseline and remains robust as semantic clutter increases.
核心發現： 核心結果：The results show that ontology-guided reasoning identifies relevant explanation factors more accurately than a semantic-only baseline and remains robust as semantic clutter increases.

Integrated Exploration-Aware UAV Route Optimization and Path Planning

Authors: Jimin Choi, Grant Stagg, Cameron K. Peterson et al. | Submitted: 2026-05-27 | arXiv: 2605.28654 Categories: cs.RO, eess.SY, math.OC

Research Background: Uncrewed aerial vehicles (UAVs) are increasingly used for exploration-driven monitoring in hazardous environments such as disaster zones, contaminated sites, wildfire areas, and damaged infrastructure, where limited flight endurance must be allocated between visiting reported locations and gathering new information. In these settings, prior information regarding hazards is often incomplete, spa…
研究背景： 在機器人學習領域，Uncrewed aerial vehicles (UAVs) are increasingly used for exploration-driven monitoring in hazardous environments such as disaster zones, contaminated sites, wildfire areas, and da

Technical Approach: We present an integrated exploration-aware UAV route optimization and path planning framework for hazard monitoring under uncertain and evolving prior information.
技術方法： 本文提出的方法：We present an integrated exploration-aware UAV route optimization and path planning framework for hazard monitoring under uncertain and evolving prior information.

Key Takeaway: Across 48 scenario configurations, online replanning improves average KL reduction by 15.9% over the offline optimized planner and 48.6% over straight-line traversal.
核心發現： 核心結果：Across 48 scenario configurations, online replanning improves average KL reduction by 15.9% over the offline optimized planner and 48.6% over straight-line traversal.

SARAD: LLM-Based Safety-Aware Hybrid Reinforcement Learning with Collision Prediction for Autonomous Driving

Authors: Kangyu Wu, Peng Cui, Guoxi Chen et al. | Submitted: 2026-05-27 | arXiv: 2605.28583 Categories: cs.RO, cs.AI, cs.LG, eess.SY

Research Background: Ensuring both safety and efficiency in decision-making for autonomous driving systems remains a fundamental challenge. Traditional Deep Reinforcement Learning (DRL) suffers from unsafe random exploration and slow convergence, while Large Language Models (LLMs) demonstrate inherent latency in real-time inference operations.
研究背景： 在機器人學習領域，Ensuring both safety and efficiency in decision-making for autonomous driving systems remains a fundamental challenge. Traditional Deep Reinforcement Learning (DRL) suffers from un

Technical Approach: To address these limitations, this paper proposes SARAD, a novel safety-aware hybrid framework that synergizes LLMs and DRL for autonomous driving.
技術方法： 本文提出的方法：To address these limitations, this paper proposes SARAD, a novel safety-aware hybrid framework that synergizes LLMs and DRL for autonomous driving.

Key Takeaway: Extensive experiments show that SARAD achieves significant performance improvements in the Highway-Env simulator, validating the effectiveness of the proposed model in autonomous driving.
核心發現： 核心結果：Extensive experiments show that SARAD achieves significant performance improvements in the Highway-Env simulator, validating the effectiveness of the proposed model in autonomous driving.

Learning a Kinodynamic Trajectory Manifold for Impact-Aware Compliant Catching of Fast-Moving Objects

Authors: Guorui Pei, Mengshi Zhang, Xi Chen et al. | Submitted: 2026-05-27 | arXiv: 2605.28462 Categories: cs.RO

Research Background: Fast catching of free-flying objects is difficult because of short reaction time, impact uncertainty, and kinodynamic constraints. We use reinforcement learning in simulation to collect successful catching trajectories and learn a low-dimensional kinodynamic trajectory manifold.
研究背景： 在機器人學習領域，Fast catching of free-flying objects is difficult because of short reaction time, impact uncertainty, and kinodynamic constraints. We use reinforcement learning in simulation to co

Technical Approach: At run time, the estimated object initial state is mapped directly to a reference catching trajectory without online nonlinear optimization. The trajectory is tracked with compliant control near contact for improved impact absorption and capture stability.
技術方法： 本文提出的方法：At run time, the estimated object initial state is mapped directly to a reference catching trajectory without online nonlinear optimization. The trajectory is tracked with compliant control near contact for improved impact absorption and capture stab

Key Takeaway: The trajectory is tracked with compliant control near contact for improved impact absorption and capture stability.
核心發現： 核心結果：The trajectory is tracked with compliant control near contact for improved impact absorption and capture stability.

Self-Supervised Online Robot-Agnostic Traversability Estimation for Open-World Environments

Authors: Julia Hindel, Simon Bultmann, Houman Masnavi et al. | Submitted: 2026-05-27 | arXiv: 2605.28442 Categories: cs.RO, cs.CV

Research Background: Self-supervised online traversability estimation enables robots to continuously learn from unlabeled open-world experiences and adapt their navigation behavior toward safe and efficient trajectories. Existing approaches either rely on handcrafted proprioceptive traversability scores, limiting robot-agnosticism, or cluster prior data, preventing online learning.
研究背景： 在機器人學習領域，Self-supervised online traversability estimation enables robots to continuously learn from unlabeled open-world experiences and adapt their navigation behavior toward safe and effi

Technical Approach: We introduce COTRATE, an online learning framework for continuous traversability estimation from multimodal, unlabeled robot experience. Our method first infers robust traversability scores using a robot-agnostic, learning-based online terrain assessment module operating on proprioceptiveand inertial signals. These scores then supervise a visual traversability network through a novel alignment loss that associates visual embeddings with online terrain assessments.
技術方法： 本文提出的方法：We introduce COTRATE, an online learning framework for continuous traversability estimation from multimodal, unlabeled robot experience. Our method first infers robust traversability scores using a robot-agnostic, learning-based online terrain assess

Key Takeaway: We evaluate COTRATE on a dataset of $\approx$ 50,000 images collected with two robotic platforms across 11 outdoor terrains, and benchmark it on navigation tasks in three representative outdoor environments.
核心發現： 核心結果：We evaluate COTRATE on a dataset of $\approx$ 50,000 images collected with two robotic platforms across 11 outdoor terrains, and benchmark it on navigation tasks in three representative outdoor enviro

Accelerating Robot Path Planning via Connectivity-Preserving Region Proposal Network

Authors: Zhanzheng Ma, Cancan Zhao, Shuai Zhang et al. | Submitted: 2026-05-27 | arXiv: 2605.28362 Categories: cs.RO

Research Background: Mobile robot path planning methods are often constrained by vast search spaces, resulting in latency in samplingbased algorithms. Learning-based approaches frequently suffer from local region fragmentation and global topological inconsistency.
研究背景： 在機器人學習領域，Mobile robot path planning methods are often constrained by vast search spaces, resulting in latency in samplingbased algorithms. Learning-based approaches frequently suffer from l

Technical Approach: To tackle the problem, we present the Connectivity- Preserving Region Proposal Network (CP-RPN), a segmentationguided model designed to predict compact and topologically connected candidate regions, significantly compressing the search space. Specifically, we design a segmentation model that leverages a Deformable Attention Transformer (DAT) to capture long-range dependencies for global connectivity, with a Deconvolutional decoder to preserve fine-grained spatial details. To guarantee the con…
技術方法： 本文提出的方法：To tackle the problem, we present the Connectivity- Preserving Region Proposal Network (CP-RPN), a segmentationguided model designed to predict compact and topologically connected candidate regions, significantly compressing the search space. Specifi

Key Takeaway: 0.11s) with a 99.60% success rate, outperforming traditional sampling-based algorithms in stability.
核心發現： 核心結果：0.11s) with a 99.60% success rate, outperforming traditional sampling-based algorithms in stability.

Chance-Constrained MPPI under State and Dynamic Object Prediction Uncertainty and the Evaluation of Collision Risk Calibration

Authors: Benjamin Serfling, Konrad Doll, Kati Radkhah-Lens | Submitted: 2026-05-27 | arXiv: 2605.28330 Categories: cs.RO

Research Background: Chance-constrained Model Predictive Path Integral (MPPI) control is increasingly adopted for navigation in dynamic environments to explicitly bound collision risk. However, these probabilistic guarantees implicitly assume that upstream uncertainties from localization and perception are well-calibrated.
研究背景： 在機器人學習領域，Chance-constrained Model Predictive Path Integral (MPPI) control is increasingly adopted for navigation in dynamic environments to explicitly bound collision risk. However, these p

Technical Approach: Concurrently, Dual-Uncertainty Chance-Constrained Tube MPPI (DUCCT-MPPI) is proposed as a real-time, risk-aware planning architecture. DUCCT-MPPI jointly integrates localization uncertainty via a one-tube Unscented Transform (UT) approximation and dynamic obstacle prediction uncertainty via Monte Carlo aggregation.
技術方法： 本文提出的方法：Concurrently, Dual-Uncertainty Chance-Constrained Tube MPPI (DUCCT-MPPI) is proposed as a real-time, risk-aware planning architecture. DUCCT-MPPI jointly integrates localization uncertainty via a one-tube Unscented Transform (UT) approximation and dy

Key Takeaway: In highly cluttered environments, DUCCT-MPPI achieves superior robustness, outperforming established Monte Carlo MPPI baselines by nearly 28% in navigation success rate, while simultaneously recording the lowest travel times and minimizing induced social forces.
核心發現： 核心結果：In highly cluttered environments, DUCCT-MPPI achieves superior robustness, outperforming established Monte Carlo MPPI baselines by nearly 28% in navigation success rate, while simultaneously recordin

Identifying Explicit Parsimonious Piece-wise Polynomial Relationships in Industrial time-series: Application to manipulator robots

Authors: Mazen Alamir, Sacha Clavel | Submitted: 2026-05-27 | arXiv: 2605.28320 Categories: cs.RO, cs.AI

Research Background: This paper addresses the problem of identifying parsimonious explicit piece-wise polynomial relationships that might involve a relatively large number of raw features. The algorithm leverages a recently proposed identification algorithm that yields parsimonious implicit relationships enabling to derive normality characterization in the context of anomaly detection and localization.
研究背景： 在機器人學習領域，This paper addresses the problem of identifying parsimonious explicit piece-wise polynomial relationships that might involve a relatively large number of raw features. The algorith

Technical Approach: The algorithm proposed in this paper goes a step further by deriving explicit piece-wise representations that are built using the set of polynomials involved in the implicit representations.
技術方法： 本文提出的方法：The algorithm proposed in this paper goes a step further by deriving explicit piece-wise representations that are built using the set of polynomials involved in the implicit representations.

Key Takeaway: Moreover, further experiments on a 4-axis robot are also shown which are designed to investigate the generalization capability of parsimonious models compared to state-of-the-art DNNs structures, when models face unseen contexts of use.
核心發現： 核心結果：Moreover, further experiments on a 4-axis robot are also shown which are designed to investigate the generalization capability of parsimonious models compared to state-of-the-art DNNs structures, when

Visualizing Latent Phase Structures in Locomotion Policies: A Multi-Environment Study with Temporal Feature Extension

Authors: Daisuke Yasui, Toshitaka Matuki, Hiroshi Sato | Submitted: 2026-05-27 | arXiv: 2605.28186 Categories: cs.RO, cs.AI

Research Background: Deep reinforcement learning (DRL) has been shown to achieve high performance on locomotion control tasks in MuJoCo benchmarks such as HalfCheetah, Ant, and Walker2D. However, visualizing the motion structures internally obtained by a trained policy function implemented as a deep neural network remains challenging.
研究背景： 在機器人學習領域，Deep reinforcement learning (DRL) has been shown to achieve high performance on locomotion control tasks in MuJoCo benchmarks such as HalfCheetah, Ant, and Walker2D. However, visua

Technical Approach: In this study, we propose a framework for uncovering latent motion phase structures from trajectories generated by locomotion control policies through interaction with the environment.
技術方法： 本文提出的方法：In this study, we propose a framework for uncovering latent motion phase structures from trajectories generated by locomotion control policies through interaction with the environment.

Key Takeaway: Deep reinforcement learning (DRL) has been shown to achieve high performance on locomotion control tasks in MuJoCo benchmarks such as HalfCheetah, Ant, and Walker2D.
核心發現： 核心結果：Deep reinforcement learning (DRL) has been shown to achieve high performance on locomotion control tasks in MuJoCo benchmarks such as HalfCheetah, Ant, and Walker2D.

Provably Guaranteed Polytopic Uncertainty Quantification for SLAM

Authors: Guangyang Zeng, Yulong Gao, Yuan Shen et al. | Submitted: 2026-05-27 | arXiv: 2605.28172 Categories: cs.RO

Research Background: In safety-critical robotics applications, guaranteed and practical uncertainty quantification (UQ) in perception is vital. Many existing works either offer no formal containment guarantee, rely on restrictive modeling assumptions, or focus only on pose estimation rather than a complete SLAM pipeline.
研究背景： 在機器人學習領域，In safety-critical robotics applications, guaranteed and practical uncertainty quantification (UQ) in perception is vital. Many existing works either offer no formal containment gu

Technical Approach: This paper presents provably guaranteed UQ algorithms for 3D-3D landmark-based SLAM.
技術方法： 本文提出的方法：This paper presents provably guaranteed UQ algorithms for 3D-3D landmark-based SLAM.

Key Takeaway: Simulations and experiments demonstrate that the proposed algorithms provide both strong theoretical guarantees and practical usability.
核心發現： 核心結果：Simulations and experiments demonstrate that the proposed algorithms provide both strong theoretical guarantees and practical usability.

STR Robot: Design of an Autonomous Mobile Robot from Simulation to Reality

Authors: Vinh Nguyen, Gia-Uy Le, Tien-Dat Nguyen et al. | Submitted: 2026-05-27 | arXiv: 2605.28110 Categories: cs.RO

Research Background: With the rapid development of simulation tools, the development and validation of autonomous robotic systems have become more efficient before real-world deployment. This paper presents a simulation-to-real implementation of an autonomous mobile robot based on an existing mechanical platform.
研究背景： 在機器人學習領域，With the rapid development of simulation tools, the development and validation of autonomous robotic systems have become more efficient before real-world deployment. This paper pre

Technical Approach: This paper presents a simulation-to-real implementation of an autonomous mobile robot based on an existing mechanical platform.
技術方法： 本文提出的方法：This paper presents a simulation-to-real implementation of an autonomous mobile robot based on an existing mechanical platform.

Key Takeaway: The results demonstrate the feasibility of the proposed approach and show that simulation provides an effective foundation for developing reliable autonomous mobile robot systems.
核心發現： 核心結果：The results demonstrate the feasibility of the proposed approach and show that simulation provides an effective foundation for developing reliable autonomous mobile robot systems.

S-Cheetah: A Novel Quadrupedal Robot with a 3-DOF Active Spine Learning Agile Locomotion

Authors: Zimu Li, Weibang Bai | Submitted: 2026-05-27 | arXiv: 2605.27909 Categories: cs.RO

Research Background: The biological spine of quadrupeds enables sagittal flexion/extension, lateral bending, and axial rotation, playing a crucial role in highly agile and dexterous locomotion. While numerous studies have integrated active spinal joints into quadrupedal robots to enhance agility, most designs simplify control complexity by reducing spinal degrees of freedom (DOF), failing to achieve the spatial tri…
研究背景： 在機器人學習領域，The biological spine of quadrupeds enables sagittal flexion/extension, lateral bending, and axial rotation, playing a crucial role in highly agile and dexterous locomotion. While n

Technical Approach: In this study, we present S-Cheetah, a quadrupedal robot featuring a 3-DOF bio-inspired serial active spine capable of biomimetic spatial tri-axial rotation. To empower the robot to fully utilize this active spine, we developed a specialized reinforcement learning framework to actively promote the engagement of the introduced spine and maximize the robot’s locomotive capabilities by integrating an acceleration curriculum learning strategy with tailored reward functions, such as a gallop gait …
技術方法： 本文提出的方法：In this study, we present S-Cheetah, a quadrupedal robot featuring a 3-DOF bio-inspired serial active spine capable of biomimetic spatial tri-axial rotation. To empower the robot to fully utilize this active spine, we developed a specialized reinforc

Key Takeaway: Finally, through extensive evaluations across diverse locomotion tasks, we prove that the introduction of the proposed 3-DOF spine comprehensively enhances the locomotive agility of quadrupedal robots.
核心發現： 核心結果：Finally, through extensive evaluations across diverse locomotion tasks, we prove that the introduction of the proposed 3-DOF spine comprehensively enhances the locomotive agility of quadrupedal robots

Eulerian Gaussian Splatting using Hashed Probability Pyramids

Authors: Mia Gaia Polansky, George Kopanas, Stephan Garbin et al. | Submitted: 2026-05-27 | arXiv: 2605.29136 Categories: cs.CV, cs.LG

Research Background: We introduce a probabilistic splat-based radiance field framework that retains the fast rasterization and test-time efficiency of 3D Gaussian Splatting (3DGS) while replacing heuristic primitive manipulation with gradient-based optimization of a volumetric probability density. Rather than relocating, splitting, or culling Gaussians via hand-tuned densification (e.g., ADC), we treat primitive lo…
研究背景： 在電腦視覺與機器人領域，We introduce a probabilistic splat-based radiance field framework that retains the fast rasterization and test-time efficiency of 3D Gaussian Splatting (3DGS) while replacing heuri

Technical Approach: We instantiate this density using a novel, memory-efficient multi-scale hierarchical grid that enables end-to-end gradient-based optimization. By allowing probability mass to flow to where the loss demands, our framework eliminates brittle priors and naturally explores the volume, achieving state-of-the-art reconstruction quality on mip-NeRF 360 while preserving 3DGS-level rendering speed.
技術方法： 本文提出的方法：We instantiate this density using a novel, memory-efficient multi-scale hierarchical grid that enables end-to-end gradient-based optimization. By allowing probability mass to flow to where the loss demands, our framework eliminates brittle priors and

Key Takeaway: By allowing probability mass to flow to where the loss demands, our framework eliminates brittle priors and naturally explores the volume, achieving state-of-the-art reconstruction quality on mip-NeRF 360 while preserving 3DGS-level rendering speed.
核心發現： 核心結果：By allowing probability mass to flow to where the loss demands, our framework eliminates brittle priors and naturally explores the volume, achieving state-of-the-art reconstruction quality on mip-NeRF

Differentiable Belief-based Opponent Shaping

Authors: Aarav G Sane, Karthik Sivachandran, Rohan Paleja | Submitted: 2026-05-27 | arXiv: 2605.29042 Categories: cs.AI, cs.LG

Research Background: Human coordination often relies on the ability to influence the beliefs of others through strategic action. In multi-agent reinforcement learning, opponent shaping attempts to replicate this influence, though existing methods typically operate within an opponent’s parameter, policy, or value space.
研究背景： 在人工智慧與機器人領域，Human coordination often relies on the ability to influence the beliefs of others through strategic action. In multi-agent reinforcement learning, opponent shaping attempts to repl

Technical Approach: We propose Differentiable Belief-based Opponent Shaping (D-BOS), a first-order method that treats each observer’s belief as the shaped opponent state and differentiates through $k$ -step softmax-Bayes belief dynamics. Rather than explicitly rewarding deceptive or cooperative behavior, our method treats the belief state as the target for shaping.
技術方法： 本文提出的方法：We propose Differentiable Belief-based Opponent Shaping (D-BOS), a first-order method that treats each observer’s belief as the shaped opponent state and differentiates through $k$ -step softmax-Bayes belief dynamics. Rather than explicitly rewarding

Key Takeaway: Empirically, D-BOS outperforms PPO and BBM in hidden-role games, with the largest gains in mixed-motive settings.
核心發現： 核心結果：Empirically, D-BOS outperforms PPO and BBM in hidden-role games, with the largest gains in mixed-motive settings.

Designing Active Tether-Net Systems for Space Debris Capture with Graph-Learning-Aided Mixed-Combinatorial Optimization

Authors: Feng Liu, Achira Boonrath, Gishnu Madhu et al. | Submitted: 2026-05-27 | arXiv: 2605.29021 Categories: cs.LG

Research Background: Active tether-net systems are a promising solution for capturing large non-cooperative targets, such as space debris, by deploying a flexible net manipulated by maneuverable units (MUs). However, concurrent systematic explorations of design and control choices of the tether-net system to understand its full potential remain limited, partly due to the complex, constrained, nonlinear optimization…
研究背景： 在機器學習與機器人領域，Active tether-net systems are a promising solution for capturing large non-cooperative targets, such as space debris, by deploying a flexible net manipulated by maneuverable units

Technical Approach: Given the graph-structured characteristics of the combinatorial space, this paper adopts and extends a new graph-learning-aided optimization approach to solve this MCNLP problem.
技術方法： 本文提出的方法：Given the graph-structured characteristics of the combinatorial space, this paper adopts and extends a new graph-learning-aided optimization approach to solve this MCNLP problem.

Key Takeaway: Demonstrated on the problem of concurrently designing the morphology of the net, choice of mass and thrusters in the MUs and aiming points used by the controller of the tether-net system, the GNN-based recommender is shown to provide significantly faster convergence to similar optimal solutions, …
核心發現： 核心結果：Demonstrated on the problem of concurrently designing the morphology of the net, choice of mass and thrusters in the MUs and aiming points used by the controller of the tether-net system, the GNN-base

When Think-with-Image Meets Safety: What Determines Multimodal Jailbreak Robustness?

Authors: Yuan Tian, Bing Hu, Fang Wu et al. | Submitted: 2026-05-27 | arXiv: 2605.27932 Categories: cs.CV, cs.AI, cs.CL, cs.CR

Research Background: Think-with-image reasoning is emerging as a new inference paradigm for large vision-language models, but its safety implications remain poorly understood. Existing systems already span multiple process designs, including direct response generation, text-only prior turn, visual-state manipulation, and explicit external image-tool invocation.
研究背景： 在電腦視覺與機器人領域，Think-with-image reasoning is emerging as a new inference paradigm for large vision-language models, but its safety implications remain poorly understood. Existing systems already

Technical Approach: In this paper, we ask which of these evaluated paradigms improves multimodal jailbreak robustness, and why. To explain the pattern, we introduce an image-tool safety vector framework that models image-tool invocation as a residual shift in hidden representations toward a safety-relevant direction.
技術方法： 本文提出的方法：In this paper, we ask which of these evaluated paradigms improves multimodal jailbreak robustness, and why. To explain the pattern, we introduce an image-tool safety vector framework that models image-tool invocation as a residual shift in hidden rep

Key Takeaway: Overall, our results suggest that explicit image-tool interaction is a promising design pattern for improving jailbreak robustness, while also motivating pipeline-specific safety evaluation.
核心發現： 核心結果：Overall, our results suggest that explicit image-tool interaction is a promising design pattern for improving jailbreak robustness, while also motivating pipeline-specific safety evaluation.

VDSB-GWSyn: Diffusion Schrödinger Bridge for Controllable and Anatomically Feasible Guidewire Synthesis in Coronary Angiography

Authors: Haoyuan Tang, Zhuo Zhang, Jialin Li et al. | Submitted: 2026-05-27 | arXiv: 2606.00109 Categories: cs.CV, cs.AI, cs.LG

Research Background: Coronary guidewire endpoint localization is a fundamental capability for computer-assisted PCI, and its importance increases as robot-assisted PCI is progressively adopted to reduce operator radiation exposure. However, the scarcity of annotated CAG images with guidewires and the limited adaptability of existing guidewire synthesis models remain key bottlenecks for guidewire endpoint localization.
研究背景： 在電腦視覺與機器人領域，Coronary guidewire endpoint localization is a fundamental capability for computer-assisted PCI, and its importance increases as robot-assisted PCI is progressively adopted to reduc

Technical Approach: To address this issue, we propose VDSB-GWSyn, a Diffusion Schrödinger Bridge (DSB) model-based framework, enabling synthesis of controllable, high-fidelity guidewire samples under complex anatomical backgrounds.
技術方法： 本文提出的方法：To address this issue, we propose VDSB-GWSyn, a Diffusion Schrödinger Bridge (DSB) model-based framework, enabling synthesis of controllable, high-fidelity guidewire samples under complex anatomical backgrounds.

Key Takeaway: In addition, incorporating our synthesized data for synthetic pre-training followed by real fine-tuning substantially improves downstream guidewire endpoint localization, reducing MPE from 16.01~~px to 7.71~~px and increasing PCK at 3px from 52.63% to 86.27%, leading to more clinically reliable …
核心發現： 核心結果：In addition, incorporating our synthesized data for synthetic pre-training followed by real fine-tuning substantially improves downstream guidewire endpoint localization, reducing MPE from 16.01px to

Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players

Authors: Fangfu Liu, Kai He, Tianchang Shen et al. | Submitted: 2026-05-27 | arXiv: 2605.28816 Categories: cs.CV

Research Background: World models for interactive video generation have largely focused on single-agent settings, where future observations are generated from a single control signal. However, many generated environments require multi-agent interaction: multiple players, robots, or embodied agents act simultaneously within a shared space.
研究背景： 在電腦視覺與機器人領域，World models for interactive video generation have largely focused on single-agent settings, where future observations are generated from a single control signal. However, many gen

Technical Approach: In this paper, we present our generative multi-agent world model for interactive simulation. Experiments in multiplayer virtual environments show that our model improves video fidelity, action controllability, and inter-agent consistency over slot-based and dense-attention baselines, while generalizing from two to four players without additional training.
技術方法： 本文提出的方法：In this paper, we present our generative multi-agent world model for interactive simulation. Experiments in multiplayer virtual environments show that our model improves video fidelity, action controllability, and inter-agent consistency over slot-ba

Key Takeaway: Experiments in multiplayer virtual environments show that our model improves video fidelity, action controllability, and inter-agent consistency over slot-based and dense-attention baselines, while generalizing from two to four players without additional training.
核心發現： 核心結果：Experiments in multiplayer virtual environments show that our model improves video fidelity, action controllability, and inter-agent consistency over slot-based and dense-attention baselines, while ge

CogPortrait: Fine-Grained Eye-Region Control in Portrait Animation via Hierarchical Agent Planning

Authors: He Feng, Yongjia Ma, Donglin Di et al. | Submitted: 2026-05-27 | arXiv: 2605.28056 Categories: cs.CV

Research Background: Portrait animation methods have achieved substantial visual quality and lip synchronization, but fine-grained manipulation of the eye region still faces a trade-off between input granularity and motion accuracy. Existing methods using emotion labels or coarse text prompts are insufficient for describing subtle ocular dynamics, whereas approaches based on Action Units or driving videos provide h…
研究背景： 在電腦視覺與機器人領域，Portrait animation methods have achieved substantial visual quality and lip synchronization, but fine-grained manipulation of the eye region still faces a trade-off between input g

Technical Approach: In light of the above, we propose CogPortrait, a two-stage framework that generates portrait animations from high-level labels.
技術方法： 本文提出的方法：In light of the above, we propose CogPortrait, a two-stage framework that generates portrait animations from high-level labels.

Key Takeaway: Extensive experiments on HDTF and the EMH benchmark demonstrate that CogPortrait achieves more precise eye-region control than existing methods while maintaining supe- rior visual quality and identity consistency
核心發現： 核心結果：Extensive experiments on HDTF and the EMH benchmark demonstrate that CogPortrait achieves more precise eye-region control than existing methods while maintaining supe- rior visual quality and identity

Exploiting Chordal Sparsity for Globally Optimal Estimation with Factor Graphs

Authors: Avinash Subramanian, Connor Holmes, Timothy D. Barfoot et al. | Submitted: 2026-05-28 | arXiv: 2605.30617 Categories: cs.RO, math.OC

Research Background: Robust and efficient state estimation is crucial for perception, navigation, and control in robotics. State estimation problems are conveniently modeled using the factor-graph framework as enabled by modern software packages such as GTSAM or g2o.
研究背景： 在機器人學習領域，Robust and efficient state estimation is crucial for perception, navigation, and control in robotics. State estimation problems are conveniently modeled using the factor-graph fram

Technical Approach: In this work, we address both shortcomings by 1) creating a new procedure within the GTSAM framework for automatically constructing convex SDP relaxations for any factor graphs with common factor and variable types, and by 2) exploiting the Bayes tree constructions native to GTSAM to decompose the SDP problem, leading to significant speedup in solver time for chordally sparse problems.
技術方法： 本文提出的方法：In this work, we address both shortcomings by 1) creating a new procedure within the GTSAM framework for automatically constructing convex SDP relaxations for any factor graphs with common factor and variable types, and by 2) exploiting the Bayes tre

Key Takeaway: We demonstrate the favorable scaling of this structure-exploiting global estimator compared to standard local solvers for two case studies: A 3D pose-graph SLAM problem with a ring factor graph and a 2D localization problem with a chain factor graph.
核心發現： 核心結果：We demonstrate the favorable scaling of this structure-exploiting global estimator compared to standard local solvers for two case studies: A 3D pose-graph SLAM problem with a ring factor graph and a

ZAPS-DA: Zero-Phase Action Policy Smoothing with Decoupled Actor for Continuous Control in Reinforcement Learning

Authors: Faiq Shamass | Submitted: 2026-05-28 | arXiv: 2605.30612 Categories: cs.RO, cs.LG, eess.SY

Research Background: Continuous control policies trained with off-policy reinforcement learning frequently exhibit high-frequency action jitter, rendering direct deployment on physical actuators impractical. Post-hoc filtering attenuates jitter but introduces phase lag; embedding smoothness penalties in the actor’s loss couples them with the RL gradient and conflates reward regression with over-aggressive smoothing.
研究背景： 在機器人學習領域，Continuous control policies trained with off-policy reinforcement learning frequently exhibit high-frequency action jitter, rendering direct deployment on physical actuators imprac

Technical Approach: We present ZAPS-DA, a framework that reduces action jitter at deployment with negligible phase lag and no post-processing.
技術方法： 本文提出的方法：We present ZAPS-DA, a framework that reduces action jitter at deployment with negligible phase lag and no post-processing.

Key Takeaway: Validated with Soft Actor-Critic and a Savitzky—Golay filter in two driving simulators using paired n=150 evaluation protocols: on MetaDrive, ZAPS-DA reduces steering jitter by 14—21x and throttle jitter by 3—5x (all $p < 1 0^{- 4}$ , Bonferroni-corrected) while matching task-completion (p=0.28 s…
核心發現： 核心結果：Validated with Soft Actor-Critic and a Savitzky—Golay filter in two driving simulators using paired n=150 evaluation protocols: on MetaDrive, ZAPS-DA reduces steering jitter by 14—21x and throttle j

VLM-GLoc: Vision-Language Model Enhanced Monte Carlo Localization for Robust Semantic Global Localization in Cluttered Quasi-Static Environments

Authors: Shivendra Agrawal, Bradley Hayes | Submitted: 2026-05-28 | arXiv: 2605.30506 Categories: cs.RO, cs.CV

Research Background: Global localization in geometrically aliased, quasi-static environments such as grocery stores, offices, schools, and hospitals poses a significant challenge for mobile robots. Grocery stores with parallel aisles and a long tailed distribution of products, as well as offices and labs with repetitive furniture such as chairs, desks, monitors, and doors, exemplify common indoor environments that …
研究背景： 在機器人學習領域，Global localization in geometrically aliased, quasi-static environments such as grocery stores, offices, schools, and hospitals poses a significant challenge for mobile robots. Gro

Technical Approach: We present VLM-GLoc, a method for hierarchical semantic Monte Carlo Localization (MCL) that leverages open-vocabulary Vision-Language Models (VLMs) as a unified semantic observation front-end. We introduce an inverse semantic proposal mechanism that seeds particles via text-to-map retrieval.
技術方法： 本文提出的方法：We present VLM-GLoc, a method for hierarchical semantic Monte Carlo Localization (MCL) that leverages open-vocabulary Vision-Language Models (VLMs) as a unified semantic observation front-end. We introduce an inverse semantic proposal mechanism that

Key Takeaway: lab space with a quadruped, VLM-GLoc achieves 70% and 74% global localization success respectively, substantially outperforming traditional geometry-only and domain-specific baselines.
核心發現： 核心結果：lab space with a quadruped, VLM-GLoc achieves 70% and 74% global localization success respectively, substantially outperforming traditional geometry-only and domain-specific baselines.

CoMo3R-SLAM: Collaborative Monocular Dense SLAM with Learned 3D Reconstruction Priors for Outdoor Multi-Agent Systems

Authors: Zhihao Cao, Qi Shao, Shuhao Zhai et al. | Submitted: 2026-05-28 | arXiv: 2605.30488 Categories: cs.RO

Research Background: Collaborative dense SLAM is essential for multi-robot teams to achieve scalable and consistent 3D perception across large-scale outdoor environments. Existing systems typically depend on depth sensors, incurring significant payload, power, and calibration costs.
研究背景： 在機器人學習領域，Collaborative dense SLAM is essential for multi-robot teams to achieve scalable and consistent 3D perception across large-scale outdoor environments. Existing systems typically dep

Technical Approach: We propose CoMo3R-SLAM, the first collaborative monocular dense RGB SLAM system that leverages robust learned feed-forward 3D reconstruction priors for outdoor multi-agent mapping. Requiring neither depth sensors nor parametric intrinsics, our system produces robust cross-agent constraints and globally consistent metric maps from monocular RGB alone.
技術方法： 本文提出的方法：We propose CoMo3R-SLAM, the first collaborative monocular dense RGB SLAM system that leverages robust learned feed-forward 3D reconstruction priors for outdoor multi-agent mapping. Requiring neither depth sensors nor parametric intrinsics, our system

Key Takeaway: On Tanks and Temples and Waymo sequences, CoMo3R-SLAM achieves the best ATE on three of four Tanks and Temples scenes and competitive Waymo accuracy, matching or exceeding state-of-the-art RGB-D methods while running online at 8 FPS.
核心發現： 核心結果：On Tanks and Temples and Waymo sequences, CoMo3R-SLAM achieves the best ATE on three of four Tanks and Temples scenes and competitive Waymo accuracy, matching or exceeding state-of-the-art RGB-D metho

Replicable Simulation-Based Robot Validation through Provenance

Authors: Argentina Ortega, Samuel Wiest, Frederik Pasch et al. | Submitted: 2026-05-28 | arXiv: 2605.29973 Categories: cs.RO

Research Background: Robot behavior is often validated through simulation-based testing, yet the replicability of such campaigns depends critically on transparent documentation of how tests are configured, executed, and post-processed. We argue that data provenance, coupled with the FAIR principles (findability, accessibility, interoperability, and reusability), addresses this gap by explicitly tracking links betwe…
研究背景： 在機器人學習領域，Robot behavior is often validated through simulation-based testing, yet the replicability of such campaigns depends critically on transparent documentation of how tests are configu

Technical Approach: Moreover, provenance and metadata cannot be treated as an afterthought confined to final datasets; they must be integrated into the testing processes that generate those datasets so that evidence can be reconstructed end-to-end. We demonstrate this by augmenting an existing simulation-based testing framework with provenance tracking and metadata collection mechanisms, and by using these extensions to enrich a mobile robot navigation dataset with structured provenance and FAIR-aligned metadata.
技術方法： 本文提出的方法：Moreover, provenance and metadata cannot be treated as an afterthought confined to final datasets; they must be integrated into the testing processes that generate those datasets so that evidence can be reconstructed end-to-end. We demonstrate this b

Key Takeaway: We demonstrate this by augmenting an existing simulation-based testing framework with provenance tracking and metadata collection mechanisms, and by using these extensions to enrich a mobile robot navigation dataset with structured provenance and FAIR-aligned metadata.
核心發現： 核心結果：We demonstrate this by augmenting an existing simulation-based testing framework with provenance tracking and metadata collection mechanisms, and by using these extensions to enrich a mobile robot nav

FLIP: Real-Time and Resilient Formation Planning for Large-Scale DIstributed Swarms via Point Cloud Registration

Authors: Yuan Zhou, Guangtong Xu, Zhenyu Hou et al. | Submitted: 2026-05-28 | arXiv: 2605.29704 Categories: cs.RO

Research Background: Traditional large-scale formation planning either oversimplify the formation representation which leads to poor performance, or they employ complete collaborative relationships, which results in excessive computational load. To achieve high-performance and large-scale formation planning, we transform the Optimal Formation Position Sequence \cite{c1} (OFPS) calculation problem into a spatiotempo…
研究背景： 在機器人學習領域，Traditional large-scale formation planning either oversimplify the formation representation which leads to poor performance, or they employ complete collaborative relationships, wh

Technical Approach: We leverage the PCR method with outlier rejection to rapidly perform large-scale formation position registration. This prevents suboptimal trajectories and failed agents from propagating through the cooperative network and affecting more agents.
技術方法： 本文提出的方法：We leverage the PCR method with outlier rejection to rapidly perform large-scale formation position registration. This prevents suboptimal trajectories and failed agents from propagating through the cooperative network and affecting more agents.

Key Takeaway: The effectiveness and the superiority of the proposed method are demonstrated through large-scale simulations of 120-drone formation, and rigorous benchmarking against state-of-the-art (SOTA) methods.
核心發現： 核心結果：The effectiveness and the superiority of the proposed method are demonstrated through large-scale simulations of 120-drone formation, and rigorous benchmarking against state-of-the-art (SOTA) methods.

Authors: Chen Peng, Zhikang Ge, Wenwu Lu et al. | Submitted: 2026-05-28 | arXiv: 2605.29663 Categories: cs.RO

Research Background: Ground robots often carry payloads, implements, or other attachments that turn their effective footprint into complex, non-convex shapes. Navigating safely through clutter then requires reasoning about this true geometry, yet most local planners simplify it with convex or inflated proxies and rasterize sensor data into occupancy grids or distance fields.
研究背景： 在機器人學習領域，Ground robots often carry payloads, implements, or other attachments that turn their effective footprint into complex, non-convex shapes. Navigating safely through clutter then req

Technical Approach: We present EXACT-MPPI, a training-free local navigation framework that maps local point-cloud observations and sparse guidance directly to motion commands, without any intermediate map representation.
技術方法： 本文提出的方法：We present EXACT-MPPI, a training-free local navigation framework that maps local point-cloud observations and sparse guidance directly to motion commands, without any intermediate map representation.

Key Takeaway: Experiments show that EXACT-MPPI accelerates batched distance evaluation over a learned point-to-robot baseline, preserves feasible motion where convex-footprint planners fail, and remains robust under dense static and moving obstacles.
核心發現： 核心結果：Experiments show that EXACT-MPPI accelerates batched distance evaluation over a learned point-to-robot baseline, preserves feasible motion where convex-footprint planners fail, and remains robust unde

How to Relieve Distribution Shifts in Semantic Segmentation for Off-Road Environments

Authors: Ji-Hoon Hwang, Daeyoung Kim, Hyung-Suk Yoon et al. | Submitted: 2026-05-28 | arXiv: 2605.29599 Categories: cs.RO, cs.CV

Research Background: Semantic segmentation is crucial for autonomous navigation in off-road environments, enabling precise classification of surroundings to identify traversable regions. However, distinctive factors inherent to off-road conditions, such as source-target domain discrepancies and sensor corruption from rough terrain, can result in distribution shifts that alter the data differently from the trained c…
研究背景： 在機器人學習領域，Semantic segmentation is crucial for autonomous navigation in off-road environments, enabling precise classification of surroundings to identify traversable regions. However, disti

Technical Approach: To address this, we propose ST-Seg, a novel framework that expands the source distribution through style expansion (SE) and texture regularization (TR).
技術方法： 本文提出的方法：To address this, we propose ST-Seg, a novel framework that expands the source distribution through style expansion (SE) and texture regularization (TR).

Key Takeaway: These results highlight the robustness of ST-Seg, enhancing the real-world applicability of semantic segmentation for off-road navigation.
核心發現： 核心結果：These results highlight the robustness of ST-Seg, enhancing the real-world applicability of semantic segmentation for off-road navigation.

A Progress-Aware Leader-Follower Midair Docking System for Dual-Drone Aerial Manipulation

Authors: Yifan Cai, Jan Ming Kevin Tan, Xiangqi Li et al. | Submitted: 2026-05-28 | arXiv: 2605.29410 Categories: cs.RO

Research Background: Reliable midair docking between small unmanned aerial vehicles (UAVs) is essential for modular aerial cooperation and manipulation, but it requires precise relative-pose control and repeatable platform under tight thrust and payload constraints. We present a dual-drone docking platform where two quadrotors operate in a leader-follower formation and dock using a lightweight modular frame with pa…
研究背景： 在機器人學習領域，Reliable midair docking between small unmanned aerial vehicles (UAVs) is essential for modular aerial cooperation and manipulation, but it requires precise relative-pose control an

Technical Approach: We present a dual-drone docking platform where two quadrotors operate in a leader-follower formation and dock using a lightweight modular frame with passive magnetic latching.
技術方法： 本文提出的方法：We present a dual-drone docking platform where two quadrotors operate in a leader-follower formation and dock using a lightweight modular frame with passive magnetic latching.

Key Takeaway: The platform enables statistically grounded comparison of docking supervision and synchronization strategies and provides a practical testbed for modular aerial cooperation and repeatable midair aerial manipulation.
核心發現： 核心結果：The platform enables statistically grounded comparison of docking supervision and synchronization strategies and provides a practical testbed for modular aerial cooperation and repeatable midair aeria

The Open Motion Planning Library 2.0

Authors: Weihang Guo, Theodoros Tyrovouzis, Emiliano Flores et al. | Submitted: 2026-05-28 | arXiv: 2605.29301 Categories: cs.RO

Research Background: The Open Motion Planning Library (OMPL), first released in 2008, has become a cornerstone of the motion planning community, providing implementations of a wide range of state-of-the-art sampling-based algorithms. Over almost two decades of continuous development, we have steadily expanded the library with new planners, state spaces, and problem formulations.
研究背景： 在機器人學習領域，The Open Motion Planning Library (OMPL), first released in 2008, has become a cornerstone of the motion planning community, providing implementations of a wide range of state-of-th

Technical Approach: Building on this foundation, we introduce OMPL 2.0, a major evolution of the library that targets real-time motion planning through hardware acceleration and integrates seamlessly with modern AI research workflows.
技術方法： 本文提出的方法：Building on this foundation, we introduce OMPL 2.0, a major evolution of the library that targets real-time motion planning through hardware acceleration and integrates seamlessly with modern AI research workflows.

Key Takeaway: The Open Motion Planning Library (OMPL), first released in 2008, has become a cornerstone of the motion planning community, providing implementations of a wide range of state-of-the-art sampling-based algorithms.
核心發現： 核心結果：The Open Motion Planning Library (OMPL), first released in 2008, has become a cornerstone of the motion planning community, providing implementations of a wide range of state-of-the-art sampling-based

V2I Work Zone Geometry Reconstruction with Pose-Conditioned UWB Range Denoising

Authors: Jiaxi Liu, Hangyu Li, Yang Cheng et al. | Submitted: 2026-05-28 | arXiv: 2606.00119 Categories: cs.RO, cs.AI

Research Background: Reliable work zone mapping is important for connected and autonomous vehicles (CAVs) to navigate safely and smoothly through work zone areas. Cone-mounted ultra-wideband (UWB) roadside units (RSU) offer a cost-effective way for work zone layout inference, as roadside anchors and vehicle tags provide direct vehicle-to-infrastructure (V2I) range constraints for work zone geometry reconstruction.
研究背景： 在機器人學習領域，Reliable work zone mapping is important for connected and autonomous vehicles (CAVs) to navigate safely and smoothly through work zone areas. Cone-mounted ultra-wideband (UWB) road

Technical Approach: The model employs shared anchor-wise temporal prediction to capture range dynamics, symmetric set aggregation to handle unordered and missing anchors, and pose-conditioned residual decoding to incorporate vehicle motion as a geometric prior. A two-stage training strategy first learns prediction from observed ranges, and then fine-tunes the denoiser with NLOS-weighted supervision.
技術方法： 本文提出的方法：The model employs shared anchor-wise temporal prediction to capture range dynamics, symmetric set aggregation to handle unordered and missing anchors, and pose-conditioned residual decoding to incorporate vehicle motion as a geometric prior. A two-st

Key Takeaway: Results show that the proposed method substantially improves range accuracy, cone localization, and work zone geometry reconstruction in challenging NLOS-dominated regimes, remains robust to anchor re-indexing and moderate anchor dropout, and reduces measurement-weighted field MSE by 66.9% relati…
核心發現： 核心結果：Results show that the proposed method substantially improves range accuracy, cone localization, and work zone geometry reconstruction in challenging NLOS-dominated regimes, remains robust to anchor re

Embodied Virtual Reality Feedback Reshapes Neural Representations to Support Continuous Three-Dimensional Motor Imagery Decoding

Authors: Niall McShane, Attila Korik, Karl McCreadie et al. | Submitted: 2026-05-28 | arXiv: 2605.29677 Categories: cs.HC, eess.SP, q-bio.NC

Research Background: Continuous brain-computer interfaces (BCIs) that decode motion trajectories from imagined movement offer intuitive motor control, yet how feedback modality and longitudinal training shape neural representations and decoding performance remains poorly understood. We present the first systematic investigation of embodied virtual reality (VR) feedback during real-time 3D virtual limb control drive…
研究背景： 在人機互動領域，Continuous brain-computer interfaces (BCIs) that decode motion trajectories from imagined movement offer intuitive motor control, yet how feedback modality and longitudinal trainin

Technical Approach: We present the first systematic investigation of embodied virtual reality (VR) feedback during real-time 3D virtual limb control driven by motor imagery, across ten longitudinal sessions in ten participants.
技術方法： 本文提出的方法：We present the first systematic investigation of embodied virtual reality (VR) feedback during real-time 3D virtual limb control driven by motor imagery, across ten longitudinal sessions in ten participants.

Key Takeaway: Neurophysiologically, VR produced stronger sensorimotor-parietal desynchronisation and enhanced motor-frontal functional connectivity, with pervasive anterior insula engagement across all frequency bands and increased superior parietal lobule coupling, paralleling patterns associated with real mo…
核心發現： 核心結果：Neurophysiologically, VR produced stronger sensorimotor-parietal desynchronisation and enhanced motor-frontal functional connectivity, with pervasive anterior insula engagement across all frequency ba

GenClaw: Code-Driven Agentic Image Generation

Authors: Junyan Ye, Jun He, Zilong Huang et al. | Submitted: 2026-05-28 | arXiv: 2605.30248 Categories: cs.CV

Research Background: Image generation models have evolved from text-conditioned pixel synthesis toward multimodal agents endowed with visual comprehension and tool invocation capabilities. Yet, existing agents remain at the mercy of underlying black-box image models.
研究背景： 在電腦視覺與機器人領域，Image generation models have evolved from text-conditioned pixel synthesis toward multimodal agents endowed with visual comprehension and tool invocation capabilities. Yet, existin

Technical Approach: In this paper, we propose GenClaw, a code-driven agentic image generation paradigm that empowers the agent to create like a human artist: first conceptualizing, then sketching, and finally coloring. In this workflow, code serves as a controllable intermediate canvas bridging linguistic reasoning and pixel synthesis, seamlessly integrating programmatic logic with the visual expressiveness of generative models.
技術方法： 本文提出的方法：In this paper, we propose GenClaw, a code-driven agentic image generation paradigm that empowers the agent to create like a human artist: first conceptualizing, then sketching, and finally coloring. In this workflow, code serves as a controllable int

Key Takeaway: By transforming image generation from a black-box paradigm into a staged process akin to authentic human creation, GenClaw offers a step toward for highly controllable and interpretable visual generation systems.
核心發現： 核心結果：By transforming image generation from a black-box paradigm into a staged process akin to authentic human creation, GenClaw offers a step toward for highly controllable and interpretable visual generat

AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modeling

Authors: Yiheng Li, Zhuo Li, Ruibing Hou et al. | Submitted: 2026-05-28 | arXiv: 2605.29488 Categories: cs.CV, cs.AI

Research Background: Conditional human motion generation remains a fundamental challenge in computer vision and robotics. Despite significant progress, current methods are often constrained by fixed modality configurations and task-specific architectures, leaving cross-modal interactions and the scaling laws of multimodal-conditioned synthesis largely underexplored.
研究背景： 在電腦視覺與機器人領域，Conditional human motion generation remains a fundamental challenge in computer vision and robotics. Despite significant progress, current methods are often constrained by fixed mo

Technical Approach: In this work, we introduce OmniHuMo, a large-scale, high-quality dataset comprising over 5,000 hours of motion and 3.2 million sequences with precisely aligned multimodal annotations (e.g., text, speech, music, and trajectory). Leveraging OmniHuMo, we propose AnyMo, a unified multimodal framework combining a Residual FSQ-based motion tokenizer with a scalable masked modeling transformer, enabling high-quality motion synthesis under arbitrary modality combinations.
技術方法： 本文提出的方法：In this work, we introduce OmniHuMo, a large-scale, high-quality dataset comprising over 5,000 hours of motion and 3.2 million sequences with precisely aligned multimodal annotations (e.g., text, speech, music, and trajectory). Leveraging OmniHuMo, w

Key Takeaway: Extensive experiments show that AnyMo achieves high-fidelity synthesis while offering flexible control over both spatial and stylistic attributes.
核心發現： 核心結果：Extensive experiments show that AnyMo achieves high-fidelity synthesis while offering flexible control over both spatial and stylistic attributes.

FAIR^2 Drones: An AI-Ready Standard for Cross-Domain Wildlife Drone Datasets

Authors: Jenna Kline, Kilian Meier, Vandita Shukla et al. | Submitted: 2026-05-29 | arXiv: 2606.00355 Categories: cs.RO

Research Background: Animal ecology data collection using drones represents a substantial investment of time, expertise, and financial resources. Yet most existing datasets serve only a single research community, limiting interdisciplinary reuse.
研究背景： 在機器人學習領域，Animal ecology data collection using drones represents a substantial investment of time, expertise, and financial resources. Yet most existing datasets serve only a single research

Technical Approach: We propose a unified drone dataset standard, FAIR^2 Drones, that bridges ecology, robotics, and computer vision by building on existing FAIR and AI-ready data frameworks while adding essential platform metadata and annotation specifications.
技術方法： 本文提出的方法：We propose a unified drone dataset standard, FAIR^2 Drones, that bridges ecology, robotics, and computer vision by building on existing FAIR and AI-ready data frameworks while adding essential platform metadata and annotation specifications.

Key Takeaway: Our standard enables datasets to simultaneously support ecological analysis, robotics algorithm development, and computer vision benchmarking.
核心發現： 核心結果：Our standard enables datasets to simultaneously support ecological analysis, robotics algorithm development, and computer vision benchmarking.

ScaRF-SLAM: Scale-Consistent Reconstruction with Feed-Forward Models and Classical Visual SLAM

Authors: Yuhao Zhang, Yifu Tao, Frank Dellaert et al. | Submitted: 2026-05-29 | arXiv: 2606.00307 Categories: cs.RO

Research Background: Recent works have explored unifying SLAM with geometric foundation models (GFMs). However, directly using GFM predictions for tracking is highly sensitive to model capability and uncertainty, as geometric inaccuracies in the predictions can adversely affect pose estimation.
研究背景： 在機器人學習領域，Recent works have explored unifying SLAM with geometric foundation models (GFMs). However, directly using GFM predictions for tracking is highly sensitive to model capability and u

Technical Approach: To address this limitation, we present a decoupled framework that integrates classical feature-based SLAM with GFMs, which achieves higher quality and more consistent dense reconstruction. To evaluate tracking and reconstruction of our method, we introduce a loop-rich, building-scale indoor dataset with accurate sensor trajectories and LiDAR ground-truth. Experiments show that our approach achieves superior trajectory accuracy while improving reconstruction precision by 10%-20% over existing …
技術方法： 本文提出的方法：To address this limitation, we present a decoupled framework that integrates classical feature-based SLAM with GFMs, which achieves higher quality and more consistent dense reconstruction. To evaluate tracking and reconstruction of our method, we int

Key Takeaway: Experiments show that our approach achieves superior trajectory accuracy while improving reconstruction precision by 10%-20% over existing methods, with about 2 cm reconstruction error per 10 m chunk on building-scale dataset.
核心發現： 核心結果：Experiments show that our approach achieves superior trajectory accuracy while improving reconstruction precision by 10%-20% over existing methods, with about 2 cm reconstruction error per 10 m chunk

Batched Differentiable Rigid Body Dynamics in PyTorch for GPU-Accelerated Robot Learning

Authors: Yue Wang, Yanran Xu, Wenbo Wu et al. | Submitted: 2026-05-29 | arXiv: 2605.31481 Categories: cs.RO

Research Background: As robot control shifts toward large-scale reinforcement learning with in-loop dynamics computation, the community’s reliance on CPU-bound libraries such as Pinocchio creates a throughput bottleneck in GPU-based training pipelines. We present BARD (Batched Articulated Rigid-body Dynamics), a self-contained PyTorch implementation of Featherstone’s rigid-body dynamics algorithms, optimized for ba…
研究背景： 在機器人學習領域，As robot control shifts toward large-scale reinforcement learning with in-loop dynamics computation, the community’s reliance on CPU-bound libraries such as Pinocchio creates a thr

Technical Approach: We present BARD (Batched Articulated Rigid-body Dynamics), a self-contained PyTorch implementation of Featherstone’s rigid-body dynamics algorithms, optimized for batched GPU evaluation and automatic differentiation.
技術方法： 本文提出的方法：We present BARD (Batched Articulated Rigid-body Dynamics), a self-contained PyTorch implementation of Featherstone’s rigid-body dynamics algorithms, optimized for batched GPU evaluation and automatic differentiation.

Key Takeaway: Three design choices make this efficient: a tiered lazy-evaluation cache that avoids redundant tree traversals, matmul-free joint transforms via pre-computed Rodrigues constants, and level-parallel propagation that reduces sequential operations to tree-depth batched steps.
核心發現： 核心結果：Three design choices make this efficient: a tiered lazy-evaluation cache that avoids redundant tree traversals, matmul-free joint transforms via pre-computed Rodrigues constants, and level-parallel pr

IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving

Authors: Chenghao Zhang, Timin Li, Dongmei Li | Submitted: 2026-05-29 | arXiv: 2605.31476 Categories: cs.RO

Research Background: End-to-end autonomous driving has emerged as a compelling paradigm for learning planning directly from sensor observations, while recent world-model-based approaches further enrich this paradigm by enabling explicit reasoning about how the scene may evolve in the future. Yet future prediction alone does not guarantee better planning unless the predicted evolution can be converted into planning-…
研究背景： 在機器人學習領域，End-to-end autonomous driving has emerged as a compelling paradigm for learning planning directly from sensor observations, while recent world-model-based approaches further enrich

Technical Approach: To address this limitation, we propose \mathbf{IDOL}, an inverse-dynamics-guided future prediction framework for world-model-based end-to-end planning in latent BEV space, where inverse dynamics serves as the key bridge between future prediction and trajectory optimization.
技術方法： 本文提出的方法：To address this limitation, we propose \mathbf{IDOL}, an inverse-dynamics-guided future prediction framework for world-model-based end-to-end planning in latent BEV space, where inverse dynamics serves as the key bridge between future prediction and

Key Takeaway: Extensive experiments on the NAVSIM v1 and NAVSIM v2 benchmarks show that IDOL achieves state-of-the-art performance among comparable methods.
核心發現： 核心結果：Extensive experiments on the NAVSIM v1 and NAVSIM v2 benchmarks show that IDOL achieves state-of-the-art performance among comparable methods.

Shaft-integrated Force Sensing with Transformer-based Dynamics Compensation for Telesurgery

Authors: Shuyuan Yang, Grant Boone, Timo Markert et al. | Submitted: 2026-05-29 | arXiv: 2605.31434 Categories: cs.RO

Research Background: Robot-Assisted Minimally Invasive Surgery (RAMIS) enhances surgeon dexterity, with newer platforms leveraging haptic feedback to further improve performance. Such force information has broader potential to inform performance assessment, tactile localization, and surgical autonomy.
研究背景： 在機器人學習領域，Robot-Assisted Minimally Invasive Surgery (RAMIS) enhances surgeon dexterity, with newer platforms leveraging haptic feedback to further improve performance. Such force information

Technical Approach: This work presents a method for integrating a six-axis commercial force sensor into the distal end of a standard cable-driven surgical instrument, enabling end-effector force measurement while preserving the original mechanical functionality of the device.
技術方法： 本文提出的方法：This work presents a method for integrating a six-axis commercial force sensor into the distal end of a standard cable-driven surgical instrument, enabling end-effector force measurement while preserving the original mechanical functionality of the d

Key Takeaway: Given current levels of performance, the balance of system integrability and performance enables applications and research into timely topics of haptic feedback, skill assessment, and force-informed autonomy in RAMIS.
核心發現： 核心結果：Given current levels of performance, the balance of system integrability and performance enables applications and research into timely topics of haptic feedback, skill assessment, and force-informed a

LiftNav: Path Planning via Semantic Lifting in TSDF-Guided Gaussian Splatting

Authors: Hannah Schieber, Dominik Frischmann, Victor Schaack et al. | Submitted: 2026-05-29 | arXiv: 2605.31376 Categories: cs.RO, cs.CV, cs.GR

Research Background: Autonomous robots in unknown indoor environments require both reliable collision avoidance and object-level understanding. Classical representations such as TSDF support safe planning but lack semantics, while photorealistic methods like Gaussian Splatting (GS) provide rich appearance yet suffer from soft geometry, limiting precise obstacle avoidance.
研究背景： 在機器人學習領域，Autonomous robots in unknown indoor environments require both reliable collision avoidance and object-level understanding. Classical representations such as TSDF support safe plann

Technical Approach: We present LiftNav, a hybrid navigation framework built on GSFusion’s TSDF+GS dual map, augmented with a real-time pipeline of YOLO-based detection, TSDF-based 3D lifting, and B-spline trajectory optimization. We evaluate our approach in a simulation using the Replica dataset.
技術方法： 本文提出的方法：We present LiftNav, a hybrid navigation framework built on GSFusion’s TSDF+GS dual map, augmented with a real-time pipeline of YOLO-based detection, TSDF-based 3D lifting, and B-spline trajectory optimization. We evaluate our approach in a simulation

Key Takeaway: Compared against a state-of-the-art radiance field baseline we show a 100% feasibility rate and shorter trajectories.
核心發現： 核心結果：Compared against a state-of-the-art radiance field baseline we show a 100% feasibility rate and shorter trajectories.

Haptic Sorter: A Unified Planning Framework for Online Shape Estimation and Real-Time Pose Inference

Authors: Zhuoyi Lu, Lin Yang, Sri Harsha Turlapati et al. | Submitted: 2026-05-29 | arXiv: 2605.31352 Categories: cs.RO

Research Background: Robotics manipulation usually assumes that the shape and pose of the object are known to the robot prior to motion planning. However, precise geometric information is not always available in practice, and pose inference suffers from sensor uncertainties and view occlusion.
研究背景： 在機器人學習領域，Robotics manipulation usually assumes that the shape and pose of the object are known to the robot prior to motion planning. However, precise geometric information is not always av

Technical Approach: In this work, we propose a unified model-based geometric framework integrating robotic haptic perception, modeling, and manipulation planning. Our novelties involve: \textit{i)} Introducing Bayesian Optimization (BO) to guide the haptic exploration for object shape inference, where superellipses are used to approximate geometric boundary; \textit{ii)} Adaptive formulation of manipulation potential encoding object geometry for quasi-static robot-object interaction; \textit{iii)} Proposing an o…
技術方法： 本文提出的方法：In this work, we propose a unified model-based geometric framework integrating robotic haptic perception, modeling, and manipulation planning. Our novelties involve: \textit{i)} Introducing Bayesian Optimization (BO) to guide the haptic exploration f

Key Takeaway: We deploy our system on a 2D robotic sorting task, and vary object geometries to validate the robustness and generalizability of our framework in both simulation and a real-world multi-arm setup.
核心發現： 核心結果：We deploy our system on a 2D robotic sorting task, and vary object geometries to validate the robustness and generalizability of our framework in both simulation and a real-world multi-arm setup.

Authors: Yifei Yang, Zehua Fan, Huan Li et al. | Submitted: 2026-05-29 | arXiv: 2605.31314 Categories: cs.RO

Research Background: The diffusion based robot navigation world models are typically trained using parallel supervision, while autoregressive inference is employed during path planning. This results in a distribution shift between training and inference, which destabilizes the performance over long-horizon prediction.
研究背景： 在機器人學習領域，The diffusion based robot navigation world models are typically trained using parallel supervision, while autoregressive inference is employed during path planning. This results in

Technical Approach: We propose AR Forcing, an autoregressive training strategy, which integrates the standard diffusion loss into the autoregressive training loop. Our method does not require additional discriminators or distribution-matching losses, retains the original diffusion framework and sampler, and is easy to integrate.
技術方法： 本文提出的方法：We propose AR Forcing, an autoregressive training strategy, which integrates the standard diffusion loss into the autoregressive training loop. Our method does not require additional discriminators or distribution-matching losses, retains the origina

Key Takeaway: Experiments on multi-domain navigation datasets (RECON, SCAND, HuRoN, TartanDrive) show that compared with strong baselines, AR Forcing improved the consistency of generated images during long-horizon navigation and the accuracy of predicted trajectories, enhancing robustness of the model in comp…
核心發現： 核心結果：Experiments on multi-domain navigation datasets (RECON, SCAND, HuRoN, TartanDrive) show that compared with strong baselines, AR Forcing improved the consistency of generated images during long-horizon

TARIC: Memory-Augmented Traversability-Aware Outdoor VLN under Interrupted Semantic Cues

Authors: Tianle Zeng, Hanjing Ye, Jianwei Peng et al. | Submitted: 2026-05-29 | arXiv: 2605.31121 Categories: cs.RO, cs.AI

Research Background: Outdoor vision-language navigation (VLN) in long-range, open-world environments is frequently disrupted by semantic-cue interruptions, where informative goal cues become sparse, occluded, or leave the field of view. Once such cues disappear, agents enter a cue-free phase and often degrade into backtracking, oscillatory headings, or aimless exploration.
研究背景： 在機器人學習領域，Outdoor vision-language navigation (VLN) in long-range, open-world environments is frequently disrupted by semantic-cue interruptions, where informative goal cues become sparse, oc

Technical Approach: We propose a unified outdoor VLN framework that survives semantic-cue interruptions by maintaining traversability-consistent executable guidance throughout prolonged cue-free phases. Specifically, our method extracts semantic bearings from visibility-gated goal or exploration cues and grounds them into executable headings using a real-time near-field traversability profile, providing goal-consistent feasible guidance beyond reject-only safety filtering. Our method improves simulation success …
技術方法： 本文提出的方法：We propose a unified outdoor VLN framework that survives semantic-cue interruptions by maintaining traversability-consistent executable guidance throughout prolonged cue-free phases. Specifically, our method extracts semantic bearings from visibility

Key Takeaway: Our method improves simulation success rate by over 10 percentage points over the strongest baseline and achieves a real-world success rate of 40%, compared to 17.5% for the strongest baseline, with substantially higher robustness during prolonged cue-free intervals.
核心發現： 核心結果：Our method improves simulation success rate by over 10 percentage points over the strongest baseline and achieves a real-world success rate of 40%, compared to 17.5% for the strongest baseline, with s

Enhancing Human-Likeness in Reinforcement Learning Agents via Hierarchical Macro Action Quantization

Authors: Usman Nizamani, M. Shaheer Luqman, Fawad Javed Fateh et al. | Submitted: 2026-05-29 | arXiv: 2605.30928 Categories: cs.RO

Research Background: Human-like agents are a long-standing goal of artificial intelligence. Despite strong performance, most reinforcement learning (RL) agents remain reward-driven and often exhibit behaviors that differ from humans, limiting interpretability and reliability.
研究背景： 在機器人學習領域，Human-like agents are a long-standing goal of artificial intelligence. Despite strong performance, most reinforcement learning (RL) agents remain reward-driven and often exhibit be

Technical Approach: In this work, we introduce a novel human-like RL framework that predicts action sequences closely aligned with human behaviors while maximizing rewards.
技術方法： 本文提出的方法：In this work, we introduce a novel human-like RL framework that predicts action sequences closely aligned with human behaviors while maximizing rewards.

Key Takeaway: The improvements generalize across integrations with various RL algorithms, namely IQL, SAC, and RLPD.
核心發現： 核心結果：The improvements generalize across integrations with various RL algorithms, namely IQL, SAC, and RLPD.

Trajectory Planning for Non-Communicating Mobile Robots using Inverse Optimal Control

Authors: Nina Majer, Yannick Epple, Xin Ye et al. | Submitted: 2026-05-29 | arXiv: 2605.30906 Categories: cs.RO, eess.SY

Research Background: To enable an efficient interaction of non-communicating mobile robots in collision avoidance scenarios, we present a novel combined trajectory planning and prediction algorithm. Inverse optimal control is used to estimate unknown goal states of all robots based on observed past trajectories.
研究背景： 在機器人學習領域，To enable an efficient interaction of non-communicating mobile robots in collision avoidance scenarios, we present a novel combined trajectory planning and prediction algorithm. In

Technical Approach: The resulting predictions are then considered for planning. Simulation results of scenarios with 2-8 robots show that the median of the durations until all vehicles reach their goals is 9.8 % faster compared to planning with constant acceleration based estimated goal states.
技術方法： 本文提出的方法：The resulting predictions are then considered for planning. Simulation results of scenarios with 2-8 robots show that the median of the durations until all vehicles reach their goals is 9.8 % faster compared to planning with constant acceleration bas

Key Takeaway: Simulation results of scenarios with 2-8 robots show that the median of the durations until all vehicles reach their goals is 9.8 % faster compared to planning with constant acceleration based estimated goal states.
核心發現： 核心結果：Simulation results of scenarios with 2-8 robots show that the median of the durations until all vehicles reach their goals is 9.8 % faster compared to planning with constant acceleration based estimat

GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation

Authors: Beichen Shao, Mengying Xie, Heng Su et al. | Submitted: 2026-05-29 | arXiv: 2605.30740 Categories: cs.RO, cs.AI

Research Background: Articulated object manipulation is a unique challenge for service robots. Existing methods employ end-to-end policy learning, visionmotion planning, and large-language/visual-language model (LLM/VLM), but often overlook the diversity of articulated objects and the complexity of interactions between end-effector and handle, leading to limited generalization and destructive collisions.
研究背景： 在機器人學習領域，Articulated object manipulation is a unique challenge for service robots. Existing methods employ end-to-end policy learning, visionmotion planning, and large-language/visual-langu

Technical Approach: To address this, we propose GSAM, a generalizable and safe robotic framework for articulated object manipulation. Considering that pre-trained markers in perceiver yield raw estimations that may deviate from commonsense, we present a f ine-tuned VLM-based refiner, using chain-of-thought (COT) commonsense reasoning to refine perception. To prevent destructive collisions, we design an interaction constraint function generator, integrating articulated object, interaction pose, and obstacle avoid…
技術方法： 本文提出的方法：To address this, we propose GSAM, a generalizable and safe robotic framework for articulated object manipulation. Considering that pre-trained markers in perceiver yield raw estimations that may deviate from commonsense, we present a f ine-tuned VLM-

Key Takeaway: Experiments on 50 hinge tasks across 5 object categories and 50 randomly initialized end-effectorhandle configurations show that GSAM reduces standard deviation by 3.1% and improves manipulation success rate by 36.0% compared to the best baseline, respectively demonstrating the superior object ge…
核心發現： 核心結果：Experiments on 50 hinge tasks across 5 object categories and 50 randomly initialized end-effectorhandle configurations show that GSAM reduces standard deviation by 3.1% and improves manipulation succe

Geometry-Aware Control Barrier Functions for Collision Avoidance via Bernstein Polynomial Approximations

Authors: Siwon Jo, Yanze Zhang, Yupeng Yang et al. | Submitted: 2026-05-29 | arXiv: 2605.30696 Categories: cs.RO, eess.SY

Research Background: Safe navigation often relies on well-defined conditions based on the shape of robots and obstacles, and can be challenging when they have irregular geometries. While Control Barrier Functions (CBFs) offer an efficient mechanism to enforce safe set forward invariance, common shape surrogates (e.g., spheres or super-ellipsoids) either are overly conservative in unstructured scenes or require many…
研究背景： 在機器人學習領域，Safe navigation often relies on well-defined conditions based on the shape of robots and obstacles, and can be challenging when they have irregular geometries. While Control Barrie

Technical Approach: In this paper, we introduce a novel geometry-aware Control Barrier Function (CBF) based on Bernstein-Polynomial Signed Distance Fields (BP-SDFs).
技術方法： 本文提出的方法：In this paper, we introduce a novel geometry-aware Control Barrier Function (CBF) based on Bernstein-Polynomial Signed Distance Fields (BP-SDFs).

Key Takeaway: We validate the method’s efficiency and performance to guarantee safety in single-robot navigation and heterogeneous multi-robot collision avoidance via simulations under different environments.
核心發現： 核心結果：We validate the method’s efficiency and performance to guarantee safety in single-robot navigation and heterogeneous multi-robot collision avoidance via simulations under different environments.

Constrained Multi-Objective Reinforcement Learning with Max-Min Criterion

Authors: Giseung Park, Hyunyoung Nam, Woohyeon Byeon et al. | Submitted: 2026-05-29 | arXiv: 2605.31388 Categories: cs.LG

Research Background: Multi-Objective Reinforcement Learning (MORL) extends standard RL by optimizing policies with respect to multiple, often conflicting, objectives. While max-min MORL has emerged as an effective approach for promoting fairness, its applicability remains limited, particularly when constraints must be incorporated.
研究背景： 在機器學習與機器人領域，Multi-Objective Reinforcement Learning (MORL) extends standard RL by optimizing policies with respect to multiple, often conflicting, objectives. While max-min MORL has emerged as

Technical Approach: In this paper, we propose a MORL framework that integrates the max-min criterion with explicit constraint satisfaction. We further demonstrate the practical relevance of our approach in simulated building thermal control, multi-objective locomotion control, and greenhouse-gas-emission-aware traffic management. Across these domains, our method effectively balances fairness and constraint satisfaction in multi-objective decision-making.
技術方法： 本文提出的方法：In this paper, we propose a MORL framework that integrates the max-min criterion with explicit constraint satisfaction. We further demonstrate the practical relevance of our approach in simulated building thermal control, multi-objective locomotion c

Key Takeaway: We further demonstrate the practical relevance of our approach in simulated building thermal control, multi-objective locomotion control, and greenhouse-gas-emission-aware traffic management.
核心發現： 核心結果：We further demonstrate the practical relevance of our approach in simulated building thermal control, multi-objective locomotion control, and greenhouse-gas-emission-aware traffic management.

Survival Reinforcement Learning: Toward Scalable Self-Supervised RL

Authors: Franki Nguimatsia-Tiofack, Fabian Schramm, Théotime Le Hellard et al. | Submitted: 2026-05-29 | arXiv: 2605.31273 Categories: cs.LG

Research Background: While self-supervised Contrastive Reinforcement Learning (CRL) has shown remarkable depth-scaling capabilities, successfully using networks over 64 layers, scaled CRL still struggles with long-horizon goal-conditioned planning due to the uniformity-tolerance dilemma inherent in contrastive losses. We introduce Survival Reinforcement Learning (SRL), an online classification-based alternative tha…
研究背景： 在機器學習與機器人領域，While self-supervised Contrastive Reinforcement Learning (CRL) has shown remarkable depth-scaling capabilities, successfully using networks over 64 layers, scaled CRL still struggl

Technical Approach: We introduce Survival Reinforcement Learning (SRL), an online classification-based alternative that extends the survival value learning framework by maximizing the agent’s dwell time at target goals.
技術方法： 本文提出的方法：We introduce Survival Reinforcement Learning (SRL), an online classification-based alternative that extends the survival value learning framework by maximizing the agent’s dwell time at target goals.

Key Takeaway: Our results provide strong additional evidence that classification-based methods may serve as a key primitive in the broader effort to scale reinforcement learning.
核心發現： 核心結果：Our results provide strong additional evidence that classification-based methods may serve as a key primitive in the broader effort to scale reinforcement learning.

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks?

Authors: Stephane Hatgis-Kessell, Emma Brunskill | Submitted: 2026-05-29 | arXiv: 2605.30719 Categories: cs.LG, cs.AI

Research Background: We study when large language models (LLMs) can serve as effective black-box policy optimizers for reinforcement learning (RL) tasks, i.e., when can we replace classical RL algorithms with an LLM? We explore this question by introducing Prompted Policy Optimization (PromptPO), an iterative method that prompts an LLM with Python descriptions of the state space, action space, and reward function, …
研究背景： 在機器學習與機器人領域，We study when large language models (LLMs) can serve as effective black-box policy optimizers for reinforcement learning (RL) tasks, i.e., when can we replace classical RL algorith

Technical Approach: To maximize expected return, and without further explicit prompting, the policies PromptPO outputs range from tuned proportional controllers or rule-based plans to policies that run planning algorithms like value iteration. Our results demonstrate that LLM-based policy optimization is sufficient when the LLM can leverage prior knowledge about the environment or optimization strategy.
技術方法： 本文提出的方法：To maximize expected return, and without further explicit prompting, the policies PromptPO outputs range from tuned proportional controllers or rule-based plans to policies that run planning algorithms like value iteration. Our results demonstrate th

Key Takeaway: This demonstrates possible limitations of LLM-based policy optimization to settings that requiring fine-grained continuous control.
核心發現： 核心結果：This demonstrates possible limitations of LLM-based policy optimization to settings that requiring fine-grained continuous control.

TokTalk: Expressive Real-time Facial Animation from Audio-LLM Tokens

Authors: Qingcheng Zhao, Yifang Pan, Karan Singh | Submitted: 2026-05-29 | arXiv: 2605.31294 Categories: cs.CV

Research Background: Recent advances in Audio-LLMs like GPT-4o have ushered in an era of conversational interaction with language models. Conversational avatars however, still seem robotic in facial expression and conversational flow, in part due to sequential stages of speech recognition, text generation, turn-based text response, speech synthesis, and audio driven facial animation.
研究背景： 在電腦視覺與機器人領域，Recent advances in Audio-LLMs like GPT-4o have ushered in an era of conversational interaction with language models. Conversational avatars however, still seem robotic in facial ex

Technical Approach: Based on our insight that audio-tokens produced by current Audio-LLMs carry sufficient information to reconstruct a plausible facial performance, we present TokTalk, a system that directly outputs expressive facial animation in real-time from streaming audio-tokens. We construct a novel audio-token to 3D facial motion dataset, on which TokTalk is trained using a Chunk-based Conditional Flow Matching model.
技術方法： 本文提出的方法：Based on our insight that audio-tokens produced by current Audio-LLMs carry sufficient information to reconstruct a plausible facial performance, we present TokTalk, a system that directly outputs expressive facial animation in real-time from streami

Key Takeaway: We further show that the real-time performance of TokTalk is comparable in latency to prior art solutions, and significantly favorable (via a perceptual study) in terms of quality, expressivity and control of the 3D facial performance.
核心發現： 核心結果：We further show that the real-time performance of TokTalk is comparable in latency to prior art solutions, and significantly favorable (via a perceptual study) in terms of quality, expressivity and co

Generative Multi-Robot Motion Planning via Diffusion Modeling with Multi-Agent Reinforcement Learning Guidance

Authors: Suk Ki Lee, Venkata Sai Deepak Mutta, Hyunwoong Ko | Submitted: 2026-05-30 | arXiv: 2606.00933 Categories: cs.RO

Research Background: Coordinating multiple robots in shared environments requires generating feasible trajectories for each agent while accounting for interactions among agents. Centralized planning approaches become difficult to scale as the number of robots increases, while decentralized approaches that allow each agent to plan independently do not inherently account for inter-agent interactions.
研究背景： 在機器人學習領域，Coordinating multiple robots in shared environments requires generating feasible trajectories for each agent while accounting for interactions among agents. Centralized planning ap

Technical Approach: This paper presents a framework for coordinated multi-robot motion planning that combines decentralized generative trajectory planning with multi-agent reinforcement learning (MARL)-based coordination.
技術方法： 本文提出的方法：This paper presents a framework for coordinated multi-robot motion planning that combines decentralized generative trajectory planning with multi-agent reinforcement learning (MARL)-based coordination.

Key Takeaway: These results suggest that MARL-based value guidance can effectively introduce coordination into decentralized generative planners without requiring a fully joint multi-robot model.
核心發現： 核心結果：These results suggest that MARL-based value guidance can effectively introduce coordination into decentralized generative planners without requiring a fully joint multi-robot model.

From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction

Authors: Xinyi Ning, Zilin Bian, Dachuan Zuo et al. | Submitted: 2026-05-30 | arXiv: 2606.00857 Categories: cs.RO, cs.AI

Research Background: Accurate and reliable vehicle trajectory prediction is essential for safe autonomous driving. Recent studies have incorporated safety risk into trajectory prediction to quantify dangers posed by surrounding agents.
研究背景： 在機器人學習領域，Accurate and reliable vehicle trajectory prediction is essential for safe autonomous driving. Recent studies have incorporated safety risk into trajectory prediction to quantify da

Technical Approach: In this paper, we propose a risk horizon profiling (RHP) module that incorporates a continuous, learnable potential field model for risk-aware trajectory prediction. We evaluate our method on two datasets from different driving settings, highD for highway corridors and SHRP2 for urban streets, which cover diverse risk scenarios including safe, near-crash, and crash events. Compared to the baseline methods, our framework achieves a 25.0% reduction in 5s RMSE on the highD dataset and a 29.1% …
技術方法： 本文提出的方法：In this paper, we propose a risk horizon profiling (RHP) module that incorporates a continuous, learnable potential field model for risk-aware trajectory prediction. We evaluate our method on two datasets from different driving settings, highD for hi

Key Takeaway: The proposed method enables more realistic AV path planning and strategic selection, thereby supporting safer autonomous driving and more advanced driver-assistance systems.
核心發現： 核心結果：The proposed method enables more realistic AV path planning and strategic selection, thereby supporting safer autonomous driving and more advanced driver-assistance systems.

STEM: Semantic Target Search and Exploration using MAVs in Cluttered Environments

Authors: Nikhil Sethi, Max Lodel, Laura Ferranti et al. | Submitted: 2026-05-30 | arXiv: 2606.00762 Categories: cs.RO

Research Background: Autonomous target search is crucial for deploying Micro Aerial Vehicles (MAVs) in emergency response and rescue missions. Existing approaches either focus on 2D semantic navigation in structured environments — which is less effective in complex 3D settings, or on robotic exploration in cluttered spaces — which often lacks the semantic reasoning needed for efficient target search.
研究背景： 在機器人學習領域，Autonomous target search is crucial for deploying Micro Aerial Vehicles (MAVs) in emergency response and rescue missions. Existing approaches either focus on 2D semantic navigation

Technical Approach: This paper overcomes these limitations by proposing a novel framework that utilizes a semantically-guided viewpoint planner to minimize target search and exploration time in unstructured 3D environments using an MAV. Specifically, we develop a combinatorial planner that generates efficient semantic exploration plans by prioritizing viewpoints that likely lead to the target.
技術方法： 本文提出的方法：This paper overcomes these limitations by proposing a novel framework that utilizes a semantically-guided viewpoint planner to minimize target search and exploration time in unstructured 3D environments using an MAV. Specifically, we develop a combin

Key Takeaway: Real-world experiments with an MAV further demonstrate the method’s ability to handle practical constraints like limited battery life, small sensor range, and semantic uncertainty.
核心發現： 核心結果：Real-world experiments with an MAV further demonstrate the method’s ability to handle practical constraints like limited battery life, small sensor range, and semantic uncertainty.

Beyond Pure Sampling: Hybrid Optimization Mechanisms for Non-Convex Model Predictive Control

Authors: Yuichiro Aoyama, Minchan Jung, Akash Ratheesh et al. | Submitted: 2026-05-30 | arXiv: 2606.00737 Categories: cs.RO, math.OC

Research Background: This paper investigates the optimization mechanisms of non-convex Model Predictive Control (MPC) using the Maximum Entropy Differential Dynamic Programming (ME-DDP) framework. Navigating non-convex cost landscapes induced by nonlinear dynamics, multiple obstacles, etc.
研究背景： 在機器人學習領域，This paper investigates the optimization mechanisms of non-convex Model Predictive Control (MPC) using the Maximum Entropy Differential Dynamic Programming (ME-DDP) framework. Navi

Technical Approach: The results show that in low-dimensional systems where the cost landscapes are relatively simple and local information is sufficiently representative, our framework consistently outperforms MPPIs. In high-dimensional systems, MPPI can occasionally discover aggressive maneuvers that enable it to steer the systems faster than DDP-based methods, whereas our method maintains a higher, more stable success rate.
技術方法： 本文提出的方法：The results show that in low-dimensional systems where the cost landscapes are relatively simple and local information is sufficiently representative, our framework consistently outperforms MPPIs. In high-dimensional systems, MPPI can occasionally di

Key Takeaway: In high-dimensional systems, MPPI can occasionally discover aggressive maneuvers that enable it to steer the systems faster than DDP-based methods, whereas our method maintains a higher, more stable success rate.
核心發現： 核心結果：In high-dimensional systems, MPPI can occasionally discover aggressive maneuvers that enable it to steer the systems faster than DDP-based methods, whereas our method maintains a higher, more stable s

Authors: Mohit Singh, Shehryar Khattak, Ashish Goel et al. | Submitted: 2026-05-30 | arXiv: 2606.00709 Categories: cs.RO

Research Background: Visual-Inertial Odometry (VIO) provides smooth, high-rate state estimates and has been widely used for robotic navigation in both terrestrial and planetary applications. However, its performance is typically dependent on the frequency of visual updates, which is a challenge for planetary rovers operating under extreme resource constraints and low frame rates.
研究背景： 在機器人學習領域，Visual-Inertial Odometry (VIO) provides smooth, high-rate state estimates and has been widely used for robotic navigation in both terrestrial and planetary applications. However, i

Technical Approach: This work investigates enabling reliable VIO with very sparse visual updates for lunar rover applications, addressing both day and night-time operations where feature associations become especially difficult under self-illumination conditions. We propose a Bird’s Eye View (BEV)-based image matching scheme that remains robust to larger inter-frame motions and more reliable feature matching despite significant visual appearance changes. The results demonstrate that our method enables reliable d…
技術方法： 本文提出的方法：This work investigates enabling reliable VIO with very sparse visual updates for lunar rover applications, addressing both day and night-time operations where feature associations become especially difficult under self-illumination conditions. We pro

Key Takeaway: The results demonstrate that our method enables reliable day and nighttime self-illuminated traverses at visual update rates as low as 0.25 Hz, underscoring its suitability for navigation on power- and compute-limited lunar rovers.
核心發現： 核心結果：The results demonstrate that our method enables reliable day and nighttime self-illuminated traverses at visual update rates as low as 0.25 Hz, underscoring its suitability for navigation on power- an

Shape Your Body: Value Gradients for Multi-Embodiment Robot Design

Authors: Nico Bohlinger, Jan Peters | Submitted: 2026-05-30 | arXiv: 2606.00702 Categories: cs.RO, cs.AI

Research Background: We propose to turn generalist multi-embodiment value functions into reusable models for robot design. Instead of running a new reinforcement learning co-design loop for each robot, we first train an embodiment-aware policy and value function across many robot designs.
研究背景： 在機器人學習領域，We propose to turn generalist multi-embodiment value functions into reusable models for robot design. Instead of running a new reinforcement learning co-design loop for each robot,

Technical Approach: We evaluate our approach across different robot design settings, from perturbed single robots to held-out robots across morphology classes, with single models trained on up to 50 robots and design spaces of over 1100 continuous embodiment parameters.
技術方法： 本文提出的方法：We evaluate our approach across different robot design settings, from perturbed single robots to held-out robots across morphology classes, with single models trained on up to 50 robots and design spaces of over 1100 continuous embodiment parameters.

Key Takeaway: Beyond optimizing complete embodiments, we show that value gradients can identify performance-limiting design and control parameters, enabling both the optimization and the analysis of new robot designs.
核心發現： 核心結果：Beyond optimizing complete embodiments, we show that value gradients can identify performance-limiting design and control parameters, enabling both the optimization and the analysis of new robot desig

Dynamic Resilient Spatio-Semantic Memory with Hybrid Localization for Mobile Manipulation

Authors: Zhijie Yan, Shufei Li, Ze Zhang et al. | Submitted: 2026-05-30 | arXiv: 2606.00576 Categories: cs.RO

Research Background: Reliable mobile manipulation in dynamic indoor environments requires a scene representation that remains geometrically consistent, semantically queryable, and computationally bounded as the environment changes. Existing systems often rely on pre-built maps, static-scene assumptions, or highly accurate camera poses, which can lead to stale or misaligned scene information when target objects are …
研究背景： 在機器人學習領域，Reliable mobile manipulation in dynamic indoor environments requires a scene representation that remains geometrically consistent, semantically queryable, and computationally bound

Technical Approach: This paper presents DREAM, a real-robot mobile manipulation framework that integrates perception, memory, localization, navigation, and manipulation in previously unseen indoor environments without a pre-built map.
技術方法： 本文提出的方法：This paper presents DREAM, a real-robot mobile manipulation framework that integrates perception, memory, localization, navigation, and manipulation in previously unseen indoor environments without a pre-built map.

Key Takeaway: Real-robot experiments in four dynamic indoor laboratory scenes show that DREAM improves long-horizon task success rates from 40%-60% with DynaMem to 55%-70%, while maintaining a memory footprint of 0.37-0.63 GB and an online memory-update time of 0.43-0.53 s across scenes.
核心發現： 核心結果：Real-robot experiments in four dynamic indoor laboratory scenes show that DREAM improves long-horizon task success rates from 40%-60% with DynaMem to 55%-70%, while maintaining a memory footprint of 0

DriveAnchor: Progressive Anchor-based Flow Learning for Autonomous Driving Planning

Authors: Limin Yan, Haoyun Tang, Yutao Qiu et al. | Submitted: 2026-05-30 | arXiv: 2606.00519 Categories: cs.RO

Research Background: We present DriveAnchor, a three-stage framework for autonomous driving planning that achieves behavioral diversity, controllability, and safety in a composable pipeline. Demonstration Flow Pretraining replaces the unstructured Gaussian prior with a vocabulary of 2,398 trajectory shapes constructed by farthest-point sampling, structurally grounding behavioral diversity in vocabulary coverage.
研究背景： 在機器人學習領域，We present DriveAnchor, a three-stage framework for autonomous driving planning that achieves behavioral diversity, controllability, and safety in a composable pipeline. Demonstrat

Technical Approach: Reward-Refined Flow Fine-tuning applies zeroth-order reinforcement learning to align each anchor’s output with collision-avoidance objectives: because the flow-matching model is a deterministic feedforward network in single-step mode, each anchor uniquely determines the output trajectory, reducing reward optimization to a direction search in anchor space without log-likelihood computation or ODE-to-SDE conversion. Evaluated on approximately 2 million held-out driving scenarios, DriveAnchor re…
技術方法： 本文提出的方法：Reward-Refined Flow Fine-tuning applies zeroth-order reinforcement learning to align each anchor’s output with collision-avoidance objectives: because the flow-matching model is a deterministic feedforward network in single-step mode, each anchor uni

Key Takeaway: Evaluated on approximately 2 million held-out driving scenarios, DriveAnchor reduces near-range collision rates by 89% and improves mean reward by 32% without degradation in imitation accuracy, with 2.06 ms inference on NVIDIA Drive Orin.
核心發現： 核心結果：Evaluated on approximately 2 million held-out driving scenarios, DriveAnchor reduces near-range collision rates by 89% and improves mean reward by 32% without degradation in imitation accuracy, with 2

DeepLatent: Think with Images via Parallel Latent Visual Reasoning

Authors: Dongchen Lu, Zhimo Li, Mao Shu et al. | Submitted: 2026-05-30 | arXiv: 2606.00562 Categories: cs.CV, cs.LG

Research Background: The emerging paradigm of “thinking with images” embeds visual states into intermediate reasoning steps, defining a new frontier for Vision-Language Models. Existing approaches diverge along two lines.
研究背景： 在電腦視覺與機器人領域，The emerging paradigm of “thinking with images” embeds visual states into intermediate reasoning steps, defining a new frontier for Vision-Language Models. Existing approaches dive

Technical Approach: In this work, we propose DeepLatent, a parallel framework for latent visual reasoning. First, we introduce LatentFormer. Second, we design a continuous-space reinforcement learning algorithm.
技術方法： 本文提出的方法：In this work, we propose DeepLatent, a parallel framework for latent visual reasoning. First, we introduce LatentFormer. Second, we design a continuous-space reinforcement learning algorithm.

Key Takeaway: Extensive evaluations across multiple benchmarks demonstrate that DeepLatent achieves state-of-the-art performance.
核心發現： 核心結果：Extensive evaluations across multiple benchmarks demonstrate that DeepLatent achieves state-of-the-art performance.

Knowing When to Move: Evidence Accumulation Models of Human Behavior in Traffic

Authors: Floor Bontje, Felix van Waveren, Leendert van Maanen et al. | Submitted: 2026-05-30 | arXiv: 2606.00727 Categories: cs.HC

Research Background: Evidence accumulation models provide a formal framework for studying decision making as a dynamic process unfolding over time. While these models have been extensively developed and reviewed in laboratory paradigms, their structured application in complex, ecologically valid domains has received comparatively little attention.
研究背景： 在人機互動領域，Evidence accumulation models provide a formal framework for studying decision making as a dynamic process unfolding over time. While these models have been extensively developed an

Technical Approach: This semi-systematic review synthesizes 28 studies (2014-2026) applying EAMs to traffic-related behavior. We organize the literature along two dimensions: 1) modelling level, distinguishing models at the level of discrete decision-making and models at the level of continuous action control, and 2) model architecture, distinguishing evidence accumulation as either a stand-alone decision model or an embedded component within broader perception-action or interaction frameworks.
技術方法： 本文提出的方法：This semi-systematic review synthesizes 28 studies (2014-2026) applying EAMs to traffic-related behavior. We organize the literature along two dimensions: 1) modelling level, distinguishing models at the level of discrete decision-making and models a

Key Takeaway: Promising directions include laboratory work on evidence accumulation in sustained and time-varying tasks, interactive multi-individual decision-making, and the use of neurophysiological measures to identify the perceptual evidence underlying complex perception-action behavior.
核心發現： 核心結果：Promising directions include laboratory work on evidence accumulation in sustained and time-varying tasks, interactive multi-individual decision-making, and the use of neurophysiological measures to i

Physical Object Understanding with a Physically Controllable World Model

Authors: Rahul Venkatesh, Klemen Kotar, Lilian Naing Chen et al. | Submitted: 2026-05-30 | arXiv: 2606.00439 Categories: cs.CV

Research Background: A central challenge in visual intelligence is learning the physical structure of scenes from raw videos: how regions form objects and the laws that govern their interactions. Solving these tasks requires world models capable of inferring distributional states of the world from partial observations - capabilities that current architectures do not provide.
研究背景： 在電腦視覺與機器人領域，A central challenge in visual intelligence is learning the physical structure of scenes from raw videos: how regions form objects and the laws that govern their interactions. Solvi

Technical Approach: We introduce a new class of probabilistic world models that support estimation of the probability of any visual variable, such as appearance and dynamics, conditioned on any other variables. First, we demonstrate that our model captures the physical laws governing how objects move by generating multiple plausible future states of the world through sequential inference.
技術方法： 本文提出的方法：We introduce a new class of probabilistic world models that support estimation of the probability of any visual variable, such as appearance and dynamics, conditioned on any other variables. First, we demonstrate that our model captures the physical

Key Takeaway: Finally, we demonstrate how physical relationships between objects can be computed from the world model, enabling applications such as Visual Jenga.
核心發現： 核心結果：Finally, we demonstrate how physical relationships between objects can be computed from the world model, enabling applications such as Visual Jenga.

Crazyflow: An Accurate, GPU-Accelerated, Differentiable Drone Simulator in JAX

Authors: Martin Schuck, Marcel P. Rath, Yufei Hua et al. | Submitted: 2026-05-31 | arXiv: 2606.01478 Categories: cs.RO, cs.AI, cs.MA, eess.SY

Research Background: High-quality, large-scale synthetic data from simulations is becoming a cornerstone for pushing the capabilities of robot algorithms. While aerial robotics simulators have evolved to support specialized needs such as fidelity, differentiability, and swarms independently, a unified platform that can synthesize data across all these domains is missing.
研究背景： 在機器人學習領域，High-quality, large-scale synthetic data from simulations is becoming a cornerstone for pushing the capabilities of robot algorithms. While aerial robotics simulators have evolved

Technical Approach: In this work, we propose Crazyflow, a simulator designed to push the limits of aerial-robotics algorithm development, from model-based to data-driven methods, gradient-based to sampling-based approaches, and single-agent to multi-agent systems. By pushing accuracy, speed, and differentiability simultaneously, Crazyflow serves as an open-source resource for synthetic data generation, with emerging capabilities for large-scale parallelization for online, in-execution learning and optimization, …
技術方法： 本文提出的方法：In this work, we propose Crazyflow, a simulator designed to push the limits of aerial-robotics algorithm development, from model-based to data-driven methods, gradient-based to sampling-based approaches, and single-agent to multi-agent systems. By pu

Key Takeaway: Crazyflow supports multiple levels of simulation abstraction, is directly compatible with all open-source Crazyflie models, and enables rapid reconfiguration across custom drone platforms and applications by providing a light-weight system identification pipeline.
核心發現： 核心結果：Crazyflow supports multiple levels of simulation abstraction, is directly compatible with all open-source Crazyflie models, and enables rapid reconfiguration across custom drone platforms and applicat

Authors: Weitung Chen, Phil Tinn, Per Gunnar Auran et al. | Submitted: 2026-05-31 | arXiv: 2606.01398 Categories: cs.RO

Research Background: Underwater robots typically use both cameras and sonar for perception to leverage the rich semantic details of vision and the robust range measurements of acoustics. However, learning to map between these modalities via cross-modal prediction remains underexplored due to limited sonar-visual paired datasets.
研究背景： 在機器人學習領域，Underwater robots typically use both cameras and sonar for perception to leverage the rich semantic details of vision and the robust range measurements of acoustics. However, learn

Technical Approach: We present SOVIS, a sonar-visual dataset for cross-modal underwater perception.
技術方法： 本文提出的方法：We present SOVIS, a sonar-visual dataset for cross-modal underwater perception.

Key Takeaway: Finally, we demonstrate a proof-of-concept cross-modal fish detection task using a small subset of labeled data, achieving a 7x improvement in mAP@0.10 over a monocular camera baseline.
核心發現： 核心結果：Finally, we demonstrate a proof-of-concept cross-modal fish detection task using a small subset of labeled data, achieving a 7x improvement in mAP@0.10 over a monocular camera baseline.

Autopilot-Preserving Residual Q-Learning with HJB-Inspired Finite-Action Risk Filtering for Fixed-Wing UAV Command Supervision

Authors: Mehmet Iscan, Batuhan Temiz | Submitted: 2026-05-31 | arXiv: 2606.01397 Categories: cs.RO, cs.LG, eess.SY

Research Background: A fixed-wing UAV must hold airspeed, altitude, and heading references under wind, gusts, and turbulence, channels coupled so that correcting one can degrade another. Classical autopilots stabilize the airframe well but adapt poorly when a hard crosswind meets an aggressive turn, while reinforcement-learning (RL) policies acting directly on the surfaces concentrate exploration risk at the actuat…
研究背景： 在機器人學習領域，A fixed-wing UAV must hold airspeed, altitude, and heading references under wind, gusts, and turbulence, channels coupled so that correcting one can degrade another. Classical auto

Technical Approach: We present this autopilot-preserving residual command-supervision design and benchmark with its trade-offs reported intact.
技術方法： 本文提出的方法：We present this autopilot-preserving residual command-supervision design and benchmark with its trade-offs reported intact.

Key Takeaway: We present this autopilot-preserving residual command-supervision design and benchmark with its trade-offs reported intact.
核心發現： 核心結果：We present this autopilot-preserving residual command-supervision design and benchmark with its trade-offs reported intact.

ActMVS: Active Scene Reconstruction with Monocular Multi-View Stereo

Authors: Guo Pu, Yixuan Han, Zhouhui Lian | Submitted: 2026-05-31 | arXiv: 2606.01367 Categories: cs.RO, cs.CV

Research Background: Active scene reconstruction enables robots/UAVs to autonomously plan trajectories and reconstruct environments without costly manual data acquisition. Unlike passive methods, active reconstruction requires real-time construction of high-confidence occupancy maps for collision-free navigation.
研究背景： 在機器人學習領域，Active scene reconstruction enables robots/UAVs to autonomously plan trajectories and reconstruct environments without costly manual data acquisition. Unlike passive methods, activ

Technical Approach: To bridge this gap, we introduce ActMVS, the first framework for monocular active reconstruction. Our framework integrates a view factor graph construction for informed Multi-View Stereo depth prediction, along with a global depth optimization, to enable the online generation of high-quality, globally consistent dense depth maps.
技術方法： 本文提出的方法：To bridge this gap, we introduce ActMVS, the first framework for monocular active reconstruction. Our framework integrates a view factor graph construction for informed Multi-View Stereo depth prediction, along with a global depth optimization, to en

Key Takeaway: Experiments on Replica datasets demonstrate performance competitive with RGB-D methods.
核心發現： 核心結果：Experiments on Replica datasets demonstrate performance competitive with RGB-D methods.

Authors: Rufeng Chen, Yue Chang, Xiaqiang Tang et al. | Submitted: 2026-05-31 | arXiv: 2606.01313 Categories: cs.RO, cs.AI

Research Background: Open-vocabulary navigation requires embodied agents to manage significant perception uncertainty stemming from semantic ambiguity and model errors. However, most existing works settle for local optimal deterministic approaches, depriving complex navigation decision-making over multiple composite possibilities that are critical for globally better solutions.
研究背景： 在機器人學習領域，Open-vocabulary navigation requires embodied agents to manage significant perception uncertainty stemming from semantic ambiguity and model errors. However, most existing works set

Technical Approach: In this paper, we propose Probabilistic Scene Graph Navigation (PSG-Nav), which constructs a 3D Probabilistic Scene Graph that uses full semantic categorical distributions to account for perception uncertainty. To efficiently use the local distributions to compose and reason about the optimal navigation landmarks, we propose Multiverse Decision to sample multiple most likely world settings from the joint distribution, and evaluate navigation landmarks based on the compatibility between landma…
技術方法： 本文提出的方法：In this paper, we propose Probabilistic Scene Graph Navigation (PSG-Nav), which constructs a 3D Probabilistic Scene Graph that uses full semantic categorical distributions to account for perception uncertainty. To efficiently use the local distributi

Key Takeaway: Extensive experiments on widely-used benchmarks MP3D, HM3D, and HSSD demonstrate that PSG-Nav establishes new state-of-the-art results, achieving Success Rates of 66.1%, 44.8%, and 67.9%, respectively.
核心發現： 核心結果：Extensive experiments on widely-used benchmarks MP3D, HM3D, and HSSD demonstrate that PSG-Nav establishes new state-of-the-art results, achieving Success Rates of 66.1%, 44.8%, and 67.9%, respectively

Authors: Oskar Natan, Andi Dharmawan, Aufaclav Zatu Kusuma Frisky et al. | Submitted: 2026-05-31 | arXiv: 2606.01277 Categories: cs.RO, cs.AI, cs.CV, eess.IV

Research Background: Current end-to-end autonomous driving systems predominantly rely on frame-based sensors, which suffer from inherent perception latency and motion blur during highly dynamic encounters, specifically sudden pedestrian crossings. To address this critical safety vulnerability, we propose DeepIPCv3, a novel multi-modal autonomous navigation framework that synergizes the dense 3D spatial geometry of …
研究背景： 在機器人學習領域，Current end-to-end autonomous driving systems predominantly rely on frame-based sensors, which suffer from inherent perception latency and motion blur during highly dynamic encount

Technical Approach: To address this critical safety vulnerability, we propose DeepIPCv3, a novel multi-modal autonomous navigation framework that synergizes the dense 3D spatial geometry of LiDAR point clouds with the microsecond-level asynchronous event streams of a Dynamic Vision Sensor (DVS). We introduce a Transformer-inspired cross-modal attention mechanism to dynamically correlate these distinct modalities, allowing the network to instantaneously prioritize high-speed dynamic updates without sacrificing st…
技術方法： 本文提出的方法：To address this critical safety vulnerability, we propose DeepIPCv3, a novel multi-modal autonomous navigation framework that synergizes the dense 3D spatial geometry of LiDAR point clouds with the microsecond-level asynchronous event streams of a Dy

Key Takeaway: Extensive comparative and ablation studies demonstrate that DeepIPCv3 achieves state-of-the-art predictive performance.
核心發現： 核心結果：Extensive comparative and ablation studies demonstrate that DeepIPCv3 achieves state-of-the-art predictive performance.

Robust Integrated Planning and Control for Quadrotors in Dynamic Environments via NMPC with CBF Penalties

Authors: Zeinab Shayan, Mohammadreza Izadi, Reza Faieghi | Submitted: 2026-05-31 | arXiv: 2606.01038 Categories: cs.RO

Research Background: This paper presents a new robust integrated planning and control (IPC) strategy for multirotor uncrewed aerial vehicles. We propose a nonlinear model predictive control (NMPC) formulation that embeds control barrier functions (CBFs) as exponential penalties, improving feasibility while ensuring smooth obstacle avoidance under tight input bounds.
研究背景： 在機器人學習領域，This paper presents a new robust integrated planning and control (IPC) strategy for multirotor uncrewed aerial vehicles. We propose a nonlinear model predictive control (NMPC) form

Technical Approach: We propose a nonlinear model predictive control (NMPC) formulation that embeds control barrier functions (CBFs) as exponential penalties, improving feasibility while ensuring smooth obstacle avoidance under tight input bounds.
技術方法： 本文提出的方法：We propose a nonlinear model predictive control (NMPC) formulation that embeds control barrier functions (CBFs) as exponential penalties, improving feasibility while ensuring smooth obstacle avoidance under tight input bounds.

Key Takeaway: To the best of our knowledge, this is the first hardware-validated NMPC-CBF IPC framework, offering a practical step toward safe quadrotor deployment in dynamic environments.
核心發現： 核心結果：To the best of our knowledge, this is the first hardware-validated NMPC-CBF IPC framework, offering a practical step toward safe quadrotor deployment in dynamic environments.

Authors: Hshmat Sahak, Aoran Jiao, Nicholas Rhinehart et al. | Submitted: 2026-05-31 | arXiv: 2606.00990 Categories: cs.RO

Research Background: A mobile robot following a graph of known routes can make costly navigation errors when a temporary obstacle blocks a critical edge: waiting too long behind a parked cart wastes time, but immediately rerouting around a person who would move in a few seconds is also inefficient. Standard reactive obstacle avoidance addresses local motion around obstacles, while fixed wait-or-reroute rules ignore…
研究背景： 在機器人學習領域，A mobile robot following a graph of known routes can make costly navigation errors when a temporary obstacle blocks a critical edge: waiting too long behind a parked cart wastes ti

Technical Approach: We propose OSCAR: an adaptive survival-modeling framework for graph-based navigation with temporary blockages.
技術方法： 本文提出的方法：We propose OSCAR: an adaptive survival-modeling framework for graph-based navigation with temporary blockages.

Key Takeaway: Real-world deployment confirms that the policy improves online, adapting its patience thresholds from experience across 50 navigation episodes.
核心發現： 核心結果：Real-world deployment confirms that the policy improves online, adapting its patience thresholds from experience across 50 navigation episodes.

All Models are Wrong, Knowing Where is Useful: On Model Uncertainty in Reinforcement Learning

Authors: Bernd Frauenknecht, Devdutt Subhasish, Artur Eisele et al. | Submitted: 2026-05-31 | arXiv: 2606.01363 Categories: cs.LG, eess.SY

Research Background: Model-based reinforcement learning (MBRL) infers information about the environment from a learned dynamics model and bears the potential to address open problems such as data efficient and safe learning in robotics. However, inaccuracies of the learned dynamics model are typically exploited by the agent, substantially hampering the capabilities of MBRL methods.
研究背景： 在機器學習與機器人領域，Model-based reinforcement learning (MBRL) infers information about the environment from a learned dynamics model and bears the potential to address open problems such as data effic

Technical Approach: We present a framework for dealing with inaccuracies of probabilistic models through targeted handling of uncertainty that effectively mitigates model exploitation. We present recent successes in learning directly on hardware and safe exploration, and discuss future directions for uncertainty-aware MBRL.
技術方法： 本文提出的方法：We present a framework for dealing with inaccuracies of probabilistic models through targeted handling of uncertainty that effectively mitigates model exploitation. We present recent successes in learning directly on hardware and safe exploration, an

Key Takeaway: We present recent successes in learning directly on hardware and safe exploration, and discuss future directions for uncertainty-aware MBRL.
核心發現： 核心結果：We present recent successes in learning directly on hardware and safe exploration, and discuss future directions for uncertainty-aware MBRL.

A Minimalist Brain-Computer Musical Interface for Real-Time Emotion-Driven Sonification: System Design and Preliminary Evaluation

Authors: Pablo A. Monroy-D’Croz, Rafael Ramirez-Melendez, Julian Cespedes-Guevara | Submitted: 2026-05-31 | arXiv: 2606.01473 Categories: cs.AI, cs.HC

Research Background: This paper presents a minimalist brain-computer Musical Interface (BCMI) that functions as a real-time affective sonification system, translating prefrontal EEG activity into adaptive music. Emotional valence is estimated from frontal alpha asymmetry (AF7/AF8) and mapped to musical features such as mode, tempo, rhythmic density, and pitch register through a stochastic generative algorithm.
研究背景： 在人工智慧與機器人領域，This paper presents a minimalist brain-computer Musical Interface (BCMI) that functions as a real-time affective sonification system, translating prefrontal EEG activity into adapt

Technical Approach: An experiment with 22 participants investigated whether intentional emotional self-induction could modulate the BCMI neurofeedback signal. Linear mixed-effects analyses found no significant effects of target emotion or time, indicating that the frontal alpha asymmetry signal did not reliably distinguish instructed emotional states.
技術方法： 本文提出的方法：An experiment with 22 participants investigated whether intentional emotional self-induction could modulate the BCMI neurofeedback signal. Linear mixed-effects analyses found no significant effects of target emotion or time, indicating that the front

Key Takeaway: Linear mixed-effects analyses found no significant effects of target emotion or time, indicating that the frontal alpha asymmetry signal did not reliably distinguish instructed emotional states.
核心發現： 核心結果：Linear mixed-effects analyses found no significant effects of target emotion or time, indicating that the frontal alpha asymmetry signal did not reliably distinguish instructed emotional states.

From Craft Practice to Aesthetic Cognition Transmission: Workflow Cognition Translation for AI-native Intangible Cultural Heritage Education

Authors: Annie Yuan | Submitted: 2026-05-31 | arXiv: 2606.01203 Categories: cs.HC

Research Background: Intangible Cultural Heritage (ICH) education has traditionally relied on apprenticeship, embodied participation, and long-term engagement with masters, materials, and cultural environments. While these modes of transmission remain essential, they are difficult to scale.
研究背景： 在人機互動領域，Intangible Cultural Heritage (ICH) education has traditionally relied on apprenticeship, embodied participation, and long-term engagement with masters, materials, and cultural envi

Technical Approach: This paper argues that the future challenge of ICH education is not only the transmission of craft techniques, but the scalable transmission of aesthetic cognition: the perception, judgement, interpretation, and culturally situated meaning-making through which aesthetic expertise develops. Drawing on aesthetic education, tacit knowledge, cognitive apprenticeship, and expert cognition, we propose a shift from craft transmission to Aesthetic Cognition Transmission. To support this shift, we int…
技術方法： 本文提出的方法：This paper argues that the future challenge of ICH education is not only the transmission of craft techniques, but the scalable transmission of aesthetic cognition: the perception, judgement, interpretation, and culturally situated meaning-making thr

Key Takeaway: Rather than replacing masters, workshops, or embodied practice, the framework positions AI as a cognition mediation infrastructure for expanding access to heritage expertise.
核心發現： 核心結果：Rather than replacing masters, workshops, or embodied practice, the framework positions AI as a cognition mediation infrastructure for expanding access to heritage expertise.

Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends

Authors: Jiuming Liu, Chaojun Ni, Mengmeng Liu et al. | Submitted: 2026-05-31 | arXiv: 2606.01164 Categories: cs.CV

Research Background: With rapid development of large language models and diffusion-based content generation, world modeling has attracted increasing research attention, benefiting various downstream domains such as game engines, embodied AI, autonomous driving, etc. Through explicitly incorporating user actions into world state transition, recent literature empowers world modeling with interactivity in an action-co…
研究背景： 在電腦視覺與機器人領域，With rapid development of large language models and diffusion-based content generation, world modeling has attracted increasing research attention, benefiting various downstream do

Technical Approach: In this paper, we aim to systematically review recent research trends, technical developments, evaluation benchmarks, and also propose future potential directions in interactive world modeling.
技術方法： 本文提出的方法：In this paper, we aim to systematically review recent research trends, technical developments, evaluation benchmarks, and also propose future potential directions in interactive world modeling.

Key Takeaway: Finally, we discuss several promising future directions in achieving next-generation interactive world modeling.
核心發現： 核心結果：Finally, we discuss several promising future directions in achieving next-generation interactive world modeling.

AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond

Authors: Haiming Zhang, Junfei Zhou, Feng Jiang et al. | Submitted: 2026-05-25 | arXiv: 2605.26113 Categories: cs.RO, cs.CV

Research Background: Generating high-fidelity and controllable synthetic data is critical for advancing end-to-end autonomous driving, particularly for addressing the long tail of rare safety-critical scenarios. Existing occupancy-guided methods typically rely on shallow conditioning mechanisms and reference-frame-dependent video synthesis, which limits fine-grained controllability from arbitrary BEV layouts and re…
研究背景： 在機器人學習領域，Generating high-fidelity and controllable synthetic data is critical for advancing end-to-end autonomous driving, particularly for addressing the long tail of rare safety-critical

Technical Approach: In this paper, we propose AnyScene, a unified occupancy-centric framework for driving scene generation.
技術方法： 本文提出的方法：In this paper, we propose AnyScene, a unified occupancy-centric framework for driving scene generation.

Key Takeaway: Extensive experiments demonstrate that AnyScene achieves state-of-the-art performance in both occupancy and video generation.
核心發現： 核心結果：Extensive experiments demonstrate that AnyScene achieves state-of-the-art performance in both occupancy and video generation.

RocketSmith: An Agentic System for High-Powered Rocket Design and Manufacturing

Authors: Peter Pak, Jesse Barkley, Rumi Loghmani et al. | Submitted: 2026-05-25 | arXiv: 2606.00097 Categories: cs.RO

Research Background: This work presents RocketSmith, an agentic system capable of the design, manufacturing, and optimization processes in high powered rocket development. The system enables the intelligent automation of software tools as to not only validate factors such as flight stability but also generate the parametric design components for the rocket assembly.
研究背景： 在機器人學習領域，This work presents RocketSmith, an agentic system capable of the design, manufacturing, and optimization processes in high powered rocket development. The system enables the intell

Technical Approach: With this system, four distinct high power rockets with various motor and assembly configurations were developed utilizing the unique design capabilities of additive manufacturing. These assembly components were fabricated using various FDM printers, manually evaluated for flight readiness, and flight tested at a launch event.
技術方法： 本文提出的方法：With this system, four distinct high power rockets with various motor and assembly configurations were developed utilizing the unique design capabilities of additive manufacturing. These assembly components were fabricated using various FDM printers,

Key Takeaway: Within the collected flight data, an 84% accuracy was achieved when comparing measured apogee to that calculated in flight simulations.
核心發現： 核心結果：Within the collected flight data, an 84% accuracy was achieved when comparing measured apogee to that calculated in flight simulations.

When Search Becomes Memory: Turning Robot Design Trials into Transferable Skills

Authors: Yunfei Wang, Xiaohao Xu, Yang Li et al. | Submitted: 2026-05-25 | arXiv: 2605.25832 Categories: cs.RO, cs.AI, cs.CL, cs.CV

Research Background: Large language models (LLMs) are increasingly used as proposal generators for evolutionary robot design, yet most loops remain memoryless: simulator results shape the next population but are not preserved as reusable design knowledge. We present Auto-Robotist, a self-evolving LLM agent that distills morphology-search traces into an explicit natural-language skill library.
研究背景： 在機器人學習領域，Large language models (LLMs) are increasingly used as proposal generators for evolutionary robot design, yet most loops remain memoryless: simulator results shape the next populati

Technical Approach: We present Auto-Robotist, a self-evolving LLM agent that distills morphology-search traces into an explicit natural-language skill library.
技術方法： 本文提出的方法：We present Auto-Robotist, a self-evolving LLM agent that distills morphology-search traces into an explicit natural-language skill library.

Key Takeaway: These results suggest that LLM agents can convert expensive physical evaluations into reusable, auditable design principles.
核心發現： 核心結果：These results suggest that LLM agents can convert expensive physical evaluations into reusable, auditable design principles.

Extending Embodied Question Answering from Perception to Decision

Authors: Xicheng Gong, Qiwei Li, Peiran Xu et al. | Submitted: 2026-05-25 | arXiv: 2605.25813 Categories: cs.RO

Research Background: Embodied Question Answering (EQA) connects perception, reasoning, and interaction within embodied environments. However, existing datasets and benchmarks remain fragmented, each focusing on a limited subset of reasoning skills such as spatial understanding or procedural reasoning, without offering a unified large-scale framework for comprehensive evaluation.
研究背景： 在機器人學習領域，Embodied Question Answering (EQA) connects perception, reasoning, and interaction within embodied environments. However, existing datasets and benchmarks remain fragmented, each fo

Technical Approach: We present EQA-Decision, a large-scale embodied QA dataset that systematically covers four complementary dimensions of embodied reasoning: static scene construction, spatial understanding, task dynamics reasoning, and instant decision. In addition, we develop RoboDecision, a strong baseline model aligned with the EQA-Decision Benchmark, providing a unified framework that jointly evaluates perception, reasoning, and action-level decision-making in embodied environments.
技術方法： 本文提出的方法：We present EQA-Decision, a large-scale embodied QA dataset that systematically covers four complementary dimensions of embodied reasoning: static scene construction, spatial understanding, task dynamics reasoning, and instant decision. In addition, w

Key Takeaway: Results demonstrate that EQA-Decision effectively benchmarks and enhances VLM capabilities in spatial and interaction reasoning, providing a solid foundation for advancing embodied intelligence research.
核心發現： 核心結果：Results demonstrate that EQA-Decision effectively benchmarks and enhances VLM capabilities in spatial and interaction reasoning, providing a solid foundation for advancing embodied intelligence resear

Implicit Null-space Manifold Generation for Redundant Robotic Systems

Authors: Taiki Ishigaki, Teresa Vidal-Calleja, Ko Ayusawa et al. | Submitted: 2026-05-25 | arXiv: 2605.25770 Categories: cs.RO

Research Background: Robotic systems with redundant degrees of freedom can achieve the same task outcome using multiple configurations, resulting in solution sets that form manifolds in the configuration space. Existing approaches typically exploit such redundancy locally through Jacobian-based techniques to compute individual solutions or trajectories.
研究背景： 在機器人學習領域，Robotic systems with redundant degrees of freedom can achieve the same task outcome using multiple configurations, resulting in solution sets that form manifolds in the configurati

Technical Approach: In this work, we adopt a representation-centric approach to estimate the geometric structure of the solution space.
技術方法： 本文提出的方法：In this work, we adopt a representation-centric approach to estimate the geometric structure of the solution space.

Key Takeaway: Furthermore, the framework enables consistent modeling of solution spaces across families of tasks with continuous variation.
核心發現： 核心結果：Furthermore, the framework enables consistent modeling of solution spaces across families of tasks with continuous variation.

Acting on the Unseen: Communication-Free Collaborative Filtering for Decentralized Multi-Robot Task Allocation

Authors: Alexander Apartsin, Yigal Meshulam, Yehudit Aperstein | Submitted: 2026-05-25 | arXiv: 2605.25584 Categories: cs.RO, cs.AI

Research Background: Multi-robot task allocation usually assumes some combination of communication, known task models, or a coordinator. We study the opposite extreme, a regime common in practice but overlooked in theory, which we name Zero-Knowledge MRTA (ZK-MRTA): a robot team with no prior knowledge (no task models, not even the latent rank), no communication (no messages, no parameter sharing, no coordinator), …
研究背景： 在機器人學習領域，Multi-robot task allocation usually assumes some combination of communication, known task models, or a coordinator. We study the opposite extreme, a regime common in practice but o

Technical Approach: Yet each robot can act well on tasks it never attempted, and onboard new tasks, by running online low-rank collaborative filtering over the broadcast (SwarmCF). The advantage over any structure-free learner is categorical, not a constant factor: a structure-free learner is provably at the prior-mean error floor on unseen pairs.
技術方法： 本文提出的方法：Yet each robot can act well on tasks it never attempted, and onboard new tasks, by running online low-rank collaborative filtering over the broadcast (SwarmCF). The advantage over any structure-free learner is categorical, not a constant factor: a st

Key Takeaway: Experiments quantify the value of the broadcast, a positive scaling law (per-robot unseen-pair skill rises with team size), and the strongest masking-robustness and anytime profile among low-rank methods, recovering most (about 80% on earned skill) of a centralized full-communication ceiling, and…
核心發現： 核心結果：Experiments quantify the value of the broadcast, a positive scaling law (per-robot unseen-pair skill rises with team size), and the strongest masking-robustness and anytime profile among low-rank meth

Action-Prior Denoising for Smooth Real-Time Chunking

Authors: Dongyang Liu, Zhaowen Zheng, Yu Sun et al. | Submitted: 2026-05-25 | arXiv: 2605.25537 Categories: cs.RO

Research Background: Real-time chunking (RTC) lets chunked action policies operate under inference delay by conditioning a newly generated action chunk on actions already committed by the previous chunk. Training-time RTC simulates this delay during learning and avoids expensive guidance at deployment, but its binary prefix mask treats all non-prefix tokens as fully unconstrained.
研究背景： 在機器人學習領域，Real-time chunking (RTC) lets chunked action policies operate under inference delay by conditioning a newly generated action chunk on actions already committed by the previous chun

Technical Approach: We propose Soft RTC, a training-time RTC generalization based on action-prior denoising.
技術方法： 本文提出的方法：We propose Soft RTC, a training-time RTC generalization based on action-prior denoising.

Key Takeaway: A small preliminary real-robot sorting study provides additional evidence that training-time RTC can improve completion and that Soft RTC gives the lowest commanded-action finite-difference metrics among the tested policies.
核心發現： 核心結果：A small preliminary real-robot sorting study provides additional evidence that training-time RTC can improve completion and that Soft RTC gives the lowest commanded-action finite-difference metrics am

Path Following Control System of Line-of-Sight Guidance for Robotic Dolphin with Multi-Link Mechanism in Underwater Simulator

Authors: Takumi Asada, Takao Oki, Hideo Furuhashi et al. | Submitted: 2026-05-25 | arXiv: 2605.25401 Categories: cs.RO

Research Background: Biomimetic autonomous underwater vehicle (BAUV) with multi-link mechanism is widely used in aquatic life observation and environmental surveys due to its low power consumption and high maneuverability. An environmental survey requires a path following system that automatically follows specific points.
研究背景： 在機器人學習領域，Biomimetic autonomous underwater vehicle (BAUV) with multi-link mechanism is widely used in aquatic life observation and environmental surveys due to its low power consumption and

Technical Approach: In this study, we propose a path following system for BAUVs with a multi-link mechanism and evaluation in underwater simulation.
技術方法： 本文提出的方法：In this study, we propose a path following system for BAUVs with a multi-link mechanism and evaluation in underwater simulation.

Key Takeaway: In this result, it was possible to design a path following system suitable for BAUV, determine parameters using a simulator, and evaluate control methods.
核心發現： 核心結果：In this result, it was possible to design a path following system suitable for BAUV, determine parameters using a simulator, and evaluate control methods.

Decision-Making with Lightweight Confidence-Aware Language Model for Autonomous Driving

Authors: Ruoyu Yao, Ruiguo Zhong, Pei Liu et al. | Submitted: 2026-05-25 | arXiv: 2605.25393 Categories: cs.RO

Research Background: Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high inference latency of these massive models severely hinder their deployment in resource-constrained AD systems.
研究背景： 在機器人學習領域，Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalizati

Technical Approach: To address this challenge, we propose a novel decision-making framework utilizing a lightweight confidence-aware language model, which bridges the gap between complex multimodal intention reasoning and efficient inference. Specifically, we design a multi-agent collaborative workflow, comprising action voting, confidence assessment, and summarization agents, to generate high-quality, confidence-annotated decision demonstrations via explicit Chain-of-Thought (CoT) reasoning. Comprehensive close…
技術方法： 本文提出的方法：To address this challenge, we propose a novel decision-making framework utilizing a lightweight confidence-aware language model, which bridges the gap between complex multimodal intention reasoning and efficient inference. Specifically, we design a m

Key Takeaway: Comprehensive closed-loop experiments on the nuPlan benchmark demonstrate that our approach achieves state-of-the-art (SOTA) success rates in both regular and long-tail scenarios while maintaining low inference latency.
核心發現： 核心結果：Comprehensive closed-loop experiments on the nuPlan benchmark demonstrate that our approach achieves state-of-the-art (SOTA) success rates in both regular and long-tail scenarios while maintaining low

When Interpretability Becomes a Liability: Adversarial Attacks on CBM Concept Layers

Authors: Aditya Sridhar | Submitted: 2026-05-25 | arXiv: 2605.25304 Categories: cs.LG, cs.CR, cs.CV

Research Background: Concept Bottleneck Models (CBMs) have emerged as a cornerstone approach for interpretable machine learning, providing human-understandable intermediate representations through explicit concept activations. However, this interpretability fundamentally introduces a critical, previously unexplored attack surface: the concept bottleneck layer itself.
研究背景： 在機器學習與機器人領域，Concept Bottleneck Models (CBMs) have emerged as a cornerstone approach for interpretable machine learning, providing human-understandable intermediate representations through expl

Technical Approach: We present a comprehensive, systematic study of concept-level adversarial vulnerabilities in CBMs, revealing that targeted, minimal perturbations operating on input pixels can induce catastrophic misclassification by manipulating semantic representations. We develop a rigorous theoretical framework to quantify concept-space robustness, establishing novel metrics that expose the vulnerability landscape of these architectures. To address this critical weakness, we introduce SPECTRA (Semantic Pe…
技術方法： 本文提出的方法：We present a comprehensive, systematic study of concept-level adversarial vulnerabilities in CBMs, revealing that targeted, minimal perturbations operating on input pixels can induce catastrophic misclassification by manipulating semantic representat

Key Takeaway: Our extensive analysis on the CUB-200-2011 dataset demonstrates that standard CBMs exhibit severe susceptibility to concept-level manipulation.
核心發現： 核心結果：Our extensive analysis on the CUB-200-2011 dataset demonstrates that standard CBMs exhibit severe susceptibility to concept-level manipulation.

Segmentation-Guided Spatial Indexing for Generalizable and Explainable Deepfake Detection

Authors: Izaldein Al-Zyoud, Abdulmotaleb El Saddik | Submitted: 2026-05-25 | arXiv: 2606.00098 Categories: cs.CV, eess.IV

Research Background: We introduce segmentation-guided spatial indexing for generalizable and explainable deepfake detection. The key idea reverses the standard design order: rather than pooling all facial tokens and classifying afterward, we first select semantically meaningful patch tokens, then pool only those.
研究背景： 在電腦視覺與機器人領域，We introduce segmentation-guided spatial indexing for generalizable and explainable deepfake detection. The key idea reverses the standard design order: rather than pooling all fac

Technical Approach: The key idea reverses the standard design order: rather than pooling all facial tokens and classifying afterward, we first select semantically meaningful patch tokens, then pool only those.
技術方法： 本文提出的方法：The key idea reverses the standard design order: rather than pooling all facial tokens and classifying afterward, we first select semantically meaningful patch tokens, then pool only those.

Key Takeaway: On Celeb-DF v2, the mouth-indexed probe achieves AUC 0.905, outperforming LipForensics (+8.1 pp) and Xception (+16.9 pp), with no DINOv3 or FaRL fine-tuning and no target-domain data.
核心發現： 核心結果：On Celeb-DF v2, the mouth-indexed probe achieves AUC 0.905, outperforming LipForensics (+8.1 pp) and Xception (+16.9 pp), with no DINOv3 or FaRL fine-tuning and no target-domain data.

LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence

Authors: Xiang An, Yin Xie, Feilong Tang et al. | Submitted: 2026-05-25 | arXiv: 2605.25979 Categories: cs.CV

Research Background: We introduce LLaVA-OneVision-2 (LLaVA-OV-2), the most capable vision-language model in the LLaVA-OneVision series to date, achieving superior performance across a broad range of multimodal benchmarks. The model builds on a native OneVision-Encoder and incorporates Windowed Attention for efficient local computation while maintaining native resolution.
研究背景： 在電腦視覺與機器人領域，We introduce LLaVA-OneVision-2 (LLaVA-OV-2), the most capable vision-language model in the LLaVA-OneVision series to date, achieving superior performance across a broad range of mu

Technical Approach: Furthermore, we build the LLaVA-OV-2 data and training stack around large-scale open supervision: approximately 8M re-captioned video samples for pretraining, a 4M-sample spatial corpus for fine-tuning.
技術方法： 本文提出的方法：Furthermore, we build the LLaVA-OV-2 data and training stack around large-scale open supervision: approximately 8M re-captioned video samples for pretraining, a 4M-sample spatial corpus for fine-tuning.

Key Takeaway: Across standard benchmarks, LLaVA-OneVision-2-8B further outperforms Qwen3-VL-8B by +4.3 average points on video tasks, +5.3 on spatial tasks, and +15.6 average J&F on tracking tasks.
核心發現： 核心結果：Across standard benchmarks, LLaVA-OneVision-2-8B further outperforms Qwen3-VL-8B by +4.3 average points on video tasks, +5.3 on spatial tasks, and +15.6 average J&F on tracking tasks.

SurfSurg6D: Geometry Consistent Dense Correspondence for Textureless Surgical Instrument Pose Estimation

Authors: Daiyun Shen, Shuojue Yang, Chang Han Low et al. | Submitted: 2026-05-25 | arXiv: 2605.25598 Categories: cs.CV

Research Background: Surgical instrument pose estimation provides crucial information for promising applications, including autonomous robotic surgery, skill assessment, and standardization of surgical workflow. However, this task remains highly challenging due to high precision requirements, frequent occlusions, textureless instruments, scarcity of depth information and very limited annotated data.
研究背景： 在電腦視覺與機器人領域，Surgical instrument pose estimation provides crucial information for promising applications, including autonomous robotic surgery, skill assessment, and standardization of surgical

Technical Approach: To address these issues, we first construct a new dataset SynSurg6D, to alleviate the data shortage in this task. We further propose SurfSurg6D, a dense-correspondence framework tailored for surgical instrument pose estimation.
技術方法： 本文提出的方法：To address these issues, we first construct a new dataset SynSurg6D, to alleviate the data shortage in this task. We further propose SurfSurg6D, a dense-correspondence framework tailored for surgical instrument pose estimation.

Key Takeaway: Furthermore, SurfSurg6D outperforms existing methods, providing a robust solution for precise and efficient RGB-only pose estimation.
核心發現： 核心結果：Furthermore, SurfSurg6D outperforms existing methods, providing a robust solution for precise and efficient RGB-only pose estimation.

Physics-Aware 3D Gaussian Editing for Driving Scene Generation

Authors: Feng Zhou, Jian Zhang, Yuhang Sun et al. | Submitted: 2026-05-25 | arXiv: 2605.25373 Categories: cs.CV

Research Background: 3D Gaussian Splatting (3DGS) has shown great potential in autonomous driving simulation and data generation, enabling photorealistic reconstruction and flexible scene manipulation. However, existing 3DGS scene editing methods have limited support for road geometry editing (e.g., inserting speed humps or sunken roads), and generally do not couple such edits with plausible vehicle-road interactio…
研究背景： 在電腦視覺與機器人領域，3D Gaussian Splatting (3DGS) has shown great potential in autonomous driving simulation and data generation, enabling photorealistic reconstruction and flexible scene manipulation.

Technical Approach: To address these limitations, we propose RoVES, a Road-and-Vehicle Editing System for physics-aware 3D Gaussian editing in driving scenes.
技術方法： 本文提出的方法：To address these limitations, we propose RoVES, a Road-and-Vehicle Editing System for physics-aware 3D Gaussian editing in driving scenes.

Key Takeaway: Experiments on the Waymo dataset show that RoVES provides practical efficiency and competitive visual consistency for physics-aware driving scene generation.
核心發現： 核心結果：Experiments on the Waymo dataset show that RoVES provides practical efficiency and competitive visual consistency for physics-aware driving scene generation.

Ultra-Reduced-Impact-Encased-Logging (URIEL): propose a new method for selective sustainable logging and post-harvest silvicultural treatment in tropical forest using airborne robotics systems

Authors: Daniel Albiero, Gelton Fernando de Morais, Daniela Han et al. | Submitted: 2026-05-26 | arXiv: 2605.28883 Categories: cs.AI, cs.RO

Research Background: Tropical forests worldwide are under intense deforestation pressure driven by economic and political interests, and scientific evidence suggests this deforestation contributes to climate change. This paper proposes a novel logging method for tropical forests, Ultra-Reduced-Impact-Encased-Logging (URIEL).
研究背景： 在人工智慧與機器人領域，Tropical forests worldwide are under intense deforestation pressure driven by economic and political interests, and scientific evidence suggests this deforestation contributes to c

Technical Approach: This paper proposes a novel logging method for tropical forests, Ultra-Reduced-Impact-Encased-Logging (URIEL). The main conclusion of this paper is that, despite the satisfactory scientific and technological results, the feasibility of a Uriel method depends on the integration of stakeholders intrinsic to the context: high-tech industry; political governments; certified logging companies; and native populations.
技術方法： 本文提出的方法：This paper proposes a novel logging method for tropical forests, Ultra-Reduced-Impact-Encased-Logging (URIEL). The main conclusion of this paper is that, despite the satisfactory scientific and technological results, the feasibility of a Uriel method

Key Takeaway: The main conclusion of this paper is that, despite the satisfactory scientific and technological results, the feasibility of a Uriel method depends on the integration of stakeholders intrinsic to the context: high-tech industry; political governments; certified logging companies; and native popul…
核心發現： 核心結果：The main conclusion of this paper is that, despite the satisfactory scientific and technological results, the feasibility of a Uriel method depends on the integration of stakeholders intrinsic to the

Design of a Real-time Asynchronous Monocular Odometry for Planetary Exploration

Authors: Benat Inigo, Florian Steidle, Wolfgang Stuerzl | Submitted: 2026-05-26 | arXiv: 2605.27661 Categories: cs.RO

Research Background: We describe our preliminary design of a real-time asynchronous event-based monocular odometry for planetary exploration. Operating under strict computational constraints, planetary rovers frequently encounter complex, unpredictable environments that demand high-speed sensing and robustness to high dynamic range (HDR) lighting.
研究背景： 在機器人學習領域，We describe our preliminary design of a real-time asynchronous event-based monocular odometry for planetary exploration. Operating under strict computational constraints, planetary

Technical Approach: We propose an approach based on an Error-State Kalman Filter (ESKF) that leverages this asynchronous event stream to continuously estimate camera ego-motion.
技術方法： 本文提出的方法：We propose an approach based on an Error-State Kalman Filter (ESKF) that leverages this asynchronous event stream to continuously estimate camera ego-motion.

Key Takeaway: Event cameras address these needs by reporting asynchronous, pixel-wise brightness changes with microsecond resolution, significantly reducing data bandwidth while maintaining robustness in extreme lighting conditions.
核心發現： 核心結果：Event cameras address these needs by reporting asynchronous, pixel-wise brightness changes with microsecond resolution, significantly reducing data bandwidth while maintaining robustness in extreme li

Agentic Language-to-Objective Synthesis for Optofluidic Assembly

Authors: Ivan Saraev, Elena Erben, Weida Liao et al. | Submitted: 2026-05-26 | arXiv: 2605.27643 Categories: cs.RO, physics.optics

Research Background: Light-based advanced manufacturing increasingly requires programmable, closed-loop tools that translate human design intent into executable operations at small length scales. Yet a key bottleneck persists across robotic and manufacturing modalities: turning user intent into machine-readable objectives that are reliably executable.
研究背景： 在機器人學習領域，Light-based advanced manufacturing increasingly requires programmable, closed-loop tools that translate human design intent into executable operations at small length scales. Yet a

Technical Approach: Here, we introduce Speak-to-Objective, a modular agentic pipeline that uses a conditioned Large Language Model (LLM) to translate spoken or written commands into fully differentiable objective functions for assembling microparticles in a constraint-aware inverse solver (SLSQP) and on an experimental optofluidic platform.
技術方法： 本文提出的方法：Here, we introduce Speak-to-Objective, a modular agentic pipeline that uses a conditioned Large Language Model (LLM) to translate spoken or written commands into fully differentiable objective functions for assembling microparticles in a constraint-a

Key Takeaway: Using laser-induced thermoviscous flows as the physical actuation modality, we demonstrate natural-language-programmable, light-based microscale assembly of particle patterns in a microfluidic environment.
核心發現： 核心結果：Using laser-induced thermoviscous flows as the physical actuation modality, we demonstrate natural-language-programmable, light-based microscale assembly of particle patterns in a microfluidic environ

Inducing Calmness With Pocket-Sized Robotics: Reducing Movement and Heart Rate in Children through Hand-Held Tactile Interactions

Authors: Morten Roed Frederiksen, Kasper Støy, Maja Matarić | Submitted: 2026-05-26 | arXiv: 2605.27533 Categories: cs.RO

Research Background: Periods of heightened arousal or restlessness can interfere with children’s ability to focus, self-regulation, and physically calm. Technologies that encourage embodied self-regulation through tactile interaction may provide a simple and accessible means of promoting calmness.
研究背景： 在機器人學習領域，Periods of heightened arousal or restlessness can interfere with children’s ability to focus, self-regulation, and physically calm. Technologies that encourage embodied self-regula

Technical Approach: This paper investigates how interaction with a pocket-sized tactile device influences physiological and behavioral markers of calmness in typically developing children. Building on prior work examining heart rate modulation, we present new findings on how tactile interaction affects full-body movement and postural stability.
技術方法： 本文提出的方法：This paper investigates how interaction with a pocket-sized tactile device influences physiological and behavioral markers of calmness in typically developing children. Building on prior work examining heart rate modulation, we present new findings o

Key Takeaway: These findings demonstrate that brief tactile game-like engagement with a hand-held device can down-regulate physiological activation, promoting the calm and focused states toward sustained attention and behavior regulation.
核心發現： 核心結果：These findings demonstrate that brief tactile game-like engagement with a hand-held device can down-regulate physiological activation, promoting the calm and focused states toward sustained attention

Object Pose and Shape Estimation for Grasping: Does it Work?

Authors: Pavan Karke, Kushal Shah, Gaurav Singh et al. | Submitted: 2026-05-26 | arXiv: 2605.26944 Categories: cs.RO, cs.CV

Research Background: The problem of object pose and shape estimation has seen key advancements lately. Encoder-decoder (e.g., SAM3D, LRM, CRISP) and diffusion-based models (e.g., InstantMesh, Zero123, SceneComplete) have shown category-agnostic shape encoding capacity and open-set generalizability.
研究背景： 在機器人學習領域，The problem of object pose and shape estimation has seen key advancements lately. Encoder-decoder (e.g., SAM3D, LRM, CRISP) and diffusion-based models (e.g., InstantMesh, Zero123,

Technical Approach: In this work, we ask the question: Are the object pose and shape estimation methods mature enough, such that when used with antipodal grasp sampling, can outperform the end-to-end grasp synthesis methods?
技術方法： 本文提出的方法：In this work, we ask the question: Are the object pose and shape estimation methods mature enough, such that when used with antipodal grasp sampling, can outperform the end-to-end grasp synthesis methods?

Key Takeaway: We notice comparable performance to the state-of-the-art LERF-TOGO baseline.
核心發現： 核心結果：We notice comparable performance to the state-of-the-art LERF-TOGO baseline.

L-Learning : A Lyapunov-Based Approach Leveraging Lagrangian Mechanics for Efficient and Stable Robot Tracking

Authors: Quan Quan, Hao Li | Submitted: 2026-05-26 | arXiv: 2605.26648 Categories: cs.RO

Research Background: This paper presents L-Learning, a novel data-driven control framework for robotics that integrates Lyapunov stability theory with Lagrangian mechanics to enhance trajectory tracking performance. While traditional control methods often suffer from performance degradation in dynamic and uncertain environments, data-driven approaches, while more adaptable, are frequently limited by high sample com…
研究背景： 在機器人學習領域，This paper presents L-Learning, a novel data-driven control framework for robotics that integrates Lyapunov stability theory with Lagrangian mechanics to enhance trajectory trackin

Technical Approach: L-Learning mitigates these challenges by explicitly learning the system’s energy function from data, thereby optimizing performance while ensuring closed-loop stability intrinsically. Characterized by superior control accuracy, theoretical stability guarantees, and high sample efficiency, L-Learning represents a promising solution for practical robotic applications.
技術方法： 本文提出的方法：L-Learning mitigates these challenges by explicitly learning the system’s energy function from data, thereby optimizing performance while ensuring closed-loop stability intrinsically. Characterized by superior control accuracy, theoretical stability

Key Takeaway: Characterized by superior control accuracy, theoretical stability guarantees, and high sample efficiency, L-Learning represents a promising solution for practical robotic applications.
核心發現： 核心結果：Characterized by superior control accuracy, theoretical stability guarantees, and high sample efficiency, L-Learning represents a promising solution for practical robotic applications.

Beyond Motion Primitives: Behavioral Activity Recognition from Head-Mounted IMU

Authors: Chung-Ta Huang, Leopold Das, Jeffrey Zhou et al. | Submitted: 2026-05-26 | arXiv: 2605.27464 Categories: cs.CV, cs.AI

Research Background: AR smart glasses need continuous behavioral context to offer proactive assistance, yet their most practical always-on sensor, the head-mounted Inertial Measurement Unit (IMU), detects only motion primitives such as walking or standing. We push beyond motion primitives to behavioral-level recognition, defining five categories that balance AR application need with sensor observability.
研究背景： 在電腦視覺與機器人領域，AR smart glasses need continuous behavioral context to offer proactive assistance, yet their most practical always-on sensor, the head-mounted Inertial Measurement Unit (IMU), dete

Technical Approach: We further map the observability frontier of head-mounted IMU through per-class separability analysis, identifying which behavioral categories are reliably observable (Locomotion), which benefit from temporal context (Object Transfer, Task Operation), and where scenario-dependent signal overlap poses remaining challenges. Our results indicate that architectural choices exploiting temporal context and scenario structure outperform simply scaling model size.
技術方法： 本文提出的方法：We further map the observability frontier of head-mounted IMU through per-class separability analysis, identifying which behavioral categories are reliably observable (Locomotion), which benefit from temporal context (Object Transfer, Task Operation)

Key Takeaway: Our results indicate that architectural choices exploiting temporal context and scenario structure outperform simply scaling model size.
核心發現： 核心結果：Our results indicate that architectural choices exploiting temporal context and scenario structure outperform simply scaling model size.

Learning and Adaptation in Wire Arc Additive Manufacturing Bead Geometry Control

Authors: Chen-Lung Lu, John Wen | Submitted: 2026-05-27 | arXiv: 2605.29144 Categories: cs.RO, eess.SY

Research Background: Robotics Wire Arc Additive Manufacturing (WAAM) is governed by complex and nonlinear process dynamics coupling thermal field to the build geometry. The process may be regarded as a multi-input/multi-output dynamical system with welding torch speed and wire feed rate as inputs and weld bead deposition height and width as outputs.
研究背景： 在機器人學習領域，Robotics Wire Arc Additive Manufacturing (WAAM) is governed by complex and nonlinear process dynamics coupling thermal field to the build geometry. The process may be regarded as a

Technical Approach: In this paper, we use the input/output data to learn a data-driven model and use it for weld planning and control.
技術方法： 本文提出的方法：In this paper, we use the input/output data to learn a data-driven model and use it for weld planning and control.

Key Takeaway: Experiments on a robotic WAAM testbed with integrated line-scanner feedback significant improvements in height and width consistency compared to constant input and static model baselines.
核心發現： 核心結果：Experiments on a robotic WAAM testbed with integrated line-scanner feedback significant improvements in height and width consistency compared to constant input and static model baselines.

Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving

Authors: Qitao Weng, Heechul Yun | Submitted: 2026-05-27 | arXiv: 2605.29138 Categories: cs.RO, cs.AI, cs.LG, eess.SY

Research Background: Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from sensing to actuation.
研究背景： 在機器人學習領域，Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends

Technical Approach: We present a multi-resolution, end-to-end deep neural network for the CARLA urban driving challenge using monocular camera input. Our approach employs a convolutional neural network (CNN) that supports multiple input resolutions through per-resolution batch normalization, enabling runtime selection of an ideal input scale under a latency budget, as well as resolution retargeting, which allows multi-resolution training without access to the original training dataset.
技術方法： 本文提出的方法：We present a multi-resolution, end-to-end deep neural network for the CARLA urban driving challenge using monocular camera input. Our approach employs a convolutional neural network (CNN) that supports multiple input resolutions through per-resolutio

Key Takeaway: Results show consistent improvements in per-route safety metrics - lane invasions, red-light infractions, and collisions - relative to fixed-resolution baselines.
核心發現： 核心結果：Results show consistent improvements in per-route safety metrics - lane invasions, red-light infractions, and collisions - relative to fixed-resolution baselines.

Human-in-the-Loop Swarms: A Bionic Swarm Approach to Real-World Soil Mapping

Authors: Petras Swissler, Mohammadali Rashidioun, Nicholas Sahu et al. | Submitted: 2026-05-27 | arXiv: 2605.29091 Categories: cs.RO, cs.MA

Research Background: Swarm and field robotics face significant barriers to real-world validation due to the high cost and development time to deploy hardware. This paper introduces the Bionic Swarm,'' a novel system that lowers these barriers by abstracting away many of the tasks that are difficult to implement on robots but which do not contribute to the overall algorithm evaluation, giving these tasks to human ... **研究背景：** 在機器人學習領域，Swarm and field robotics face significant barriers to real-world validation due to the high cost and development time to deploy hardware. This paper introduces the Bionic Swarm,’

Technical Approach: This paper introduces the Bionic Swarm,'' a novel system that lowers these barriers by abstracting away many of the tasks that are difficult to implement on robots but which do not contribute to the overall algorithm evaluation, giving these tasks to human users. This work demonstrates that this human-in-the-loop approach significantly lowers the barrier to entry for field and swarm robotics research. **技術方法：** 本文提出的方法：This paper introduces the Bionic Swarm,” a novel system that lowers these barriers by abstracting away many of the tasks that are difficult to implement on robots but which do not contribute to the overall algorithm evaluation, giving these tasks

Key Takeaway: This work demonstrates that this human-in-the-loop approach significantly lowers the barrier to entry for field and swarm robotics research.
核心發現： 核心結果：This work demonstrates that this human-in-the-loop approach significantly lowers the barrier to entry for field and swarm robotics research.

Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models

Authors: Jiyao Zhang, Mingxu Zhang, Yitong Peng et al. | Submitted: 2026-05-27 | arXiv: 2605.29074 Categories: cs.CV, cs.RO

Research Background: Are current Vision Language Models (VLMs) ready to comprehend and reason about complex embodied interactions in 3D environments? We introduce Embodied3DBench, a robot-centric benchmark targeting low-level spatial intelligence in embodied 3D environments.
研究背景： 在電腦視覺與機器人領域，Are current Vision Language Models (VLMs) ready to comprehend and reason about complex embodied interactions in 3D environments? We introduce Embodied3DBench, a robot-centric bench

Technical Approach: We introduce Embodied3DBench, a robot-centric benchmark targeting low-level spatial intelligence in embodied 3D environments.
技術方法： 本文提出的方法：We introduce Embodied3DBench, a robot-centric benchmark targeting low-level spatial intelligence in embodied 3D environments.

Key Takeaway: Ultimately, Embodied3DBench fills a critical gap by providing both a systematic evaluation framework and a scalable data solution, setting a clear target for the development of interaction-aware multimodal systems.
核心發現： 核心結果：Ultimately, Embodied3DBench fills a critical gap by providing both a systematic evaluation framework and a scalable data solution, setting a clear target for the development of interaction-aware multi

EventShiftFlow: Towards Hardware-efficient FPGA-based Flow Estimation

Authors: Arianna Alonso Bizzi, Fernando Cladera, C. J. Taylor | Submitted: 2026-05-27 | arXiv: 2605.28312 Categories: cs.RO, cs.CV

Research Background: Event-based vision sensors offer asynchronous, high-temporal-resolution measurements that are attractive for low-latency robotic perception, but many event-based motion estimation methods are computationally intensive and difficult to map to FPGA hardware. We present a streaming velocity estimator that discretizes asynchronous events into fixed-duration time bins, constructs a 1-bit spatial occ…
研究背景： 在機器人學習領域，Event-based vision sensors offer asynchronous, high-temporal-resolution measurements that are attractive for low-latency robotic perception, but many event-based motion estimation

Technical Approach: We present a streaming velocity estimator that discretizes asynchronous events into fixed-duration time bins, constructs a 1-bit spatial occupancy grid, and evaluates multiple velocity hypotheses in parallel using only fixed-width integer logic - shift registers, counters, comparators, and small LUT-mapped multiplies - with no dividers and no DSP blocks.
技術方法： 本文提出的方法：We present a streaming velocity estimator that discretizes asynchronous events into fixed-duration time bins, constructs a 1-bit spatial occupancy grid, and evaluates multiple velocity hypotheses in parallel using only fixed-width integer logic - shi

Key Takeaway: We characterize the algorithm’s density-dependent behavior, present a parameter sensitivity analysis, show that the proposed datapath requires less than 2 kB of storage, and implement a single-axis prototype on a low-cost Xilinx Artix-7.
核心發現： 核心結果：We characterize the algorithm’s density-dependent behavior, present a parameter sensitivity analysis, show that the proposed datapath requires less than 2 kB of storage, and implement a single-axis pr

IMU Propagation as Preintegration

Authors: Jianzhu Huai | Submitted: 2026-05-27 | arXiv: 2605.28279 Categories: cs.RO

Research Background: IMU preintegration is widely used in factor-graph-based visual—inertial, lidar—inertial, and radar—inertial state estimation, yet it is often treated as a specialized implementation separate from conventional IMU propagation. This note shows that IMU preintegration and propagation are equivalent realizations of the same underlying computation.
研究背景： 在機器人學習領域，IMU preintegration is widely used in factor-graph-based visual—inertial, lidar—inertial, and radar—inertial state estimation, yet it is often treated as a specialized implementa

Technical Approach: We present a convention-agnostic view in which the preintegrated measurement, bias Jacobians, and covariance can be obtained by wrapping an existing IMU propagation routine, while a preintegration module can conversely recover state-transition matrices and propagated covariances.
技術方法： 本文提出的方法：We present a convention-agnostic view in which the preintegrated measurement, bias Jacobians, and covariance can be obtained by wrapping an existing IMU propagation routine, while a preintegration module can conversely recover state-transition matric

Key Takeaway: Experiments with random IMU sequences demonstrate close agreement between an RK4-based propagation implementation and GTSAM’s tangent and manifold preintegration modules in the recovered Jacobians, covariances, and transition matrices.
核心發現： 核心結果：Experiments with random IMU sequences demonstrate close agreement between an RK4-based propagation implementation and GTSAM’s tangent and manifold preintegration modules in the recovered Jacobians, co

Natural Locomotion: Principle and Method

Authors: Mirado Mortel, Luc Jaulin, Lionel Lapierre et al. | Submitted: 2026-05-27 | arXiv: 2605.28254 Categories: cs.RO, eess.SY, math.DS

Research Background: Robotic locomotion can become efficient when mechanisms exploit passive dynamics, compliance, and resonance rather than track prescribed trajectories. This paper formulates natural locomotion as an exchange principle for systems whose motion is mediated by environmental constraints or interactions.
研究背景： 在機器人學習領域，Robotic locomotion can become efficient when mechanisms exploit passive dynamics, compliance, and resonance rather than track prescribed trajectories. This paper formulates natural

Technical Approach: This paper formulates natural locomotion as an exchange principle for systems whose motion is mediated by environmental constraints or interactions. We develop the conservative realization of this principle for continuous ideal environmental constraints: the constraints do no external work, total mechanical energy is conserved, and zero mean POE power is an internal exchange with the environment-mediated propulsive channel, not external energy input.
技術方法： 本文提出的方法：This paper formulates natural locomotion as an exchange principle for systems whose motion is mediated by environmental constraints or interactions. We develop the conservative realization of this principle for continuous ideal environmental constrai

Key Takeaway: We demonstrate the principle on two ideal nonholonomic no-slip systems: a Chaplygin-sleigh / pendulum-driven car and a three-body extension.
核心發現： 核心結果：We demonstrate the principle on two ideal nonholonomic no-slip systems: a Chaplygin-sleigh / pendulum-driven car and a three-body extension.

ICAN-Deploy: Identity-Stable Canary Deployment for Safety-Critical Embodied Agents

Authors: Xue Qin, Simin Luan, John See et al. | Submitted: 2026-05-27 | arXiv: 2605.28097 Categories: cs.RO

Research Background: Canary deployment routes a fraction of traffic to a new software version, monitors metrics, and rolls back on regression. Mainstream controllers (Argo Rollouts, Spinnaker, Flagger) change the deployed system’s cryptographic identity during the canary window.
研究背景： 在機器人學習領域，Canary deployment routes a fraction of traffic to a new software version, monitors metrics, and rolls back on regression. Mainstream controllers (Argo Rollouts, Spinnaker, Flagger)

Technical Approach: We present ICAN-Deploy (Identity-stable CANary Deployment), a middleware construction whose state machine holds the identity hash invariant across the canary window by separating capability names (frozen, hashed) from capability versions (mutable runtime state).
技術方法： 本文提出的方法：We present ICAN-Deploy (Identity-stable CANary Deployment), a middleware construction whose state machine holds the identity hash invariant across the canary window by separating capability names (frozen, hashed) from capability versions (mutable run

Key Takeaway: A system certified once at identity-creation time can then ship arbitrary capability evolution under that same certification, within the version-and-name envelope.
核心發現： 核心結果：A system certified once at identity-creation time can then ship arbitrary capability evolution under that same certification, within the version-and-name envelope.

An Operator-Based Approach to STL

Authors: Panagiotis Rousseas, Dimos V. Dimarogonas | Submitted: 2026-05-27 | arXiv: 2605.28092 Categories: cs.RO

Research Background: Signal Temporal Logic (STL), has recently seen extensive development, owing to its rich expressivenes for autonomous planning and control. Nevertheless, existing verification and control synthesis methods are limited with respect to the complexity and degree of nesting of the formulae.
研究背景： 在機器人學習領域，Signal Temporal Logic (STL), has recently seen extensive development, owing to its rich expressivenes for autonomous planning and control. Nevertheless, existing verification and c

Technical Approach: In this work, we propose a novel approach to STL based on an operator acting on reachability value functions. In contrast to focusing on the design of STL-based reachability (or control barrier) functions, we develop operator-based nesting rules directly. Our method’s expressiveness is demonstrated both theoretically, where necessary and sufficient conditions for STL formula satisfaction are extracted, as well as in simulations with complex fragments.
技術方法： 本文提出的方法：In this work, we propose a novel approach to STL based on an operator acting on reachability value functions. In contrast to focusing on the design of STL-based reachability (or control barrier) functions, we develop operator-based nesting rules dire

Key Takeaway: Our method’s expressiveness is demonstrated both theoretically, where necessary and sufficient conditions for STL formula satisfaction are extracted, as well as in simulations with complex fragments.
核心發現： 核心結果：Our method’s expressiveness is demonstrated both theoretically, where necessary and sufficient conditions for STL formula satisfaction are extracted, as well as in simulations with complex fragments.

Whose Is This?: Context-Aware Object Ownership Inference with Uncertainty-Guided Questioning

Authors: Saki Hashimoto, Akira Taniguchi, Shoichi Hasegawa et al. | Submitted: 2026-05-27 | arXiv: 2605.28087 Categories: cs.RO

Research Background: Service robots must infer object ownership to correctly interpret instructions such as “bring me my cup.” However, ownership is a latent attribute that cannot be directly observed, and existing methods often rely on limited cues such as recent usage, making them unreliable in scenarios such as temporary sharing. We propose a framework for context-aware ownership inference with uncertainty-guide…
研究背景： 在機器人學習領域，Service robots must infer object ownership to correctly interpret instructions such as “bring me my cup.” However, ownership is a latent attribute that cannot be directly observed,

Technical Approach: We propose a framework for context-aware ownership inference with uncertainty-guided interaction (COIN).
技術方法： 本文提出的方法：We propose a framework for context-aware ownership inference with uncertainty-guided interaction (COIN).

Key Takeaway: The results demonstrate that combining contextual reasoning with uncertainty-aware interaction improves both estimation accuracy and robustness.
核心發現： 核心結果：The results demonstrate that combining contextual reasoning with uncertainty-aware interaction improves both estimation accuracy and robustness.

Con-DSO: Learning Short-Horizon Consistency Priors for RGB-D Direct Sparse Odometry

Authors: Haolan Zhang, Thanh Nguyen Canh, Chenghao Li et al. | Submitted: 2026-05-27 | arXiv: 2605.27952 Categories: cs.CV, cs.RO

Research Background: Visual odometry (VO) is a fundamental component in robotics and augmented reality. RGB-D direct VO benefits from metric depth measurements, but it can degrade in challenging environments, where dynamic objects, occlusions, illumination changes, and unreliable depth violate the short-horizon photometric and depth-geometric consistency assumptions used by direct alignment.
研究背景： 在電腦視覺與機器人領域，Visual odometry (VO) is a fundamental component in robotics and augmented reality. RGB-D direct VO benefits from metric depth measurements, but it can degrade in challenging enviro

Technical Approach: In this work, we propose Con-DSO, a consistency-aware RGB-D direct sparse odometry framework that predicts dense photometric and depth-geometric consistency uncertainty from temporally adjacent RGB-D frame pairs.
技術方法： 本文提出的方法：In this work, we propose Con-DSO, a consistency-aware RGB-D direct sparse odometry framework that predicts dense photometric and depth-geometric consistency uncertainty from temporally adjacent RGB-D frame pairs.

Key Takeaway: Experiments on five public RGB-D benchmarks show substantial gains over direct RGB-D VO baselines, with over 20% absolute trajectory error reduction on ICL-NUIM and 50%—80% reductions on RGB-D Scenes V2, TUM/Bonn Dynamic, and OpenLORIS sequences.
核心發現： 核心結果：Experiments on five public RGB-D benchmarks show substantial gains over direct RGB-D VO baselines, with over 20% absolute trajectory error reduction on ICL-NUIM and 50%—80% reductions on RGB-D Sce

VLM-Based Advanced Rider Assistance System for Motorcycle Safety

Authors: Mohamed Elnoor, Francesca Baldini, Ananya Trivedi et al. | Submitted: 2026-05-27 | arXiv: 2605.27948 Categories: cs.RO

Research Background: Motorcycles face disproportionately high crash risks compared to cars due to limited protection and heightened sensitivity to surface hazards, yet Advanced Rider Assistance Systems (ARAS) remain underdeveloped relative to Advanced Driver Assistance Systems (ADAS). We propose a novel ARAS that enhances motorcycle safety through semantic perception and risk-aware planning.
研究背景： 在機器人學習領域，Motorcycles face disproportionately high crash risks compared to cars due to limited protection and heightened sensitivity to surface hazards, yet Advanced Rider Assistance Systems

Technical Approach: We propose a novel ARAS that enhances motorcycle safety through semantic perception and risk-aware planning. Our approach leverages Vision-Language Models (VLMs) for contextual hazard reasoning and integrates them with segmentation-based detection to construct dense risk maps. We evaluate our system in different scenarios in the CARLA simulator.
技術方法： 本文提出的方法：We propose a novel ARAS that enhances motorcycle safety through semantic perception and risk-aware planning. Our approach leverages Vision-Language Models (VLMs) for contextual hazard reasoning and integrates them with segmentation-based detection to

Key Takeaway: Compared to the baseline method, our method achieves higher success rates and lower hazard exposure, while qualitative results demonstrate interpretable risk maps and safe trajectory recommendations.
核心發現： 核心結果：Compared to the baseline method, our method achieves higher success rates and lower hazard exposure, while qualitative results demonstrate interpretable risk maps and safe trajectory recommendations.

A Surveillance Evasion Game with Continuous Sensor Redeployment via Bilevel Optimization

Authors: Jaehyeok Kim, Kartik A. Pant, Joseph Kinerson et al. | Submitted: 2026-05-27 | arXiv: 2605.27917 Categories: cs.RO

Research Background: Uncrewed Aerial Systems (UASs) have become a growing threat to the security of critical infrastructure, exploiting spatiotemporal gaps in sensor perimeters to infiltrate restricted airspace undetected. We formulate this interaction as a two-player zero-sum differential game between an adversarial UAS and a heterogeneous sensor network of directional and omnidirectional sensors.
研究背景： 在機器人學習領域，Uncrewed Aerial Systems (UASs) have become a growing threat to the security of critical infrastructure, exploiting spatiotemporal gaps in sensor perimeters to infiltrate restricted

Technical Approach: Unlike earlier game-theoretic approaches that restrict the defender to discrete placement graphs or fixed configurations, we introduce a continuous sensor redeployment technique in which each sensor slides freely along the convex building boundaries.
技術方法： 本文提出的方法：Unlike earlier game-theoretic approaches that restrict the defender to discrete placement graphs or fixed configurations, we introduce a continuous sensor redeployment technique in which each sensor slides freely along the convex building boundaries.

Key Takeaway: The attacker’s best response is computed via a two-step approach combining STP-RRT* for feasible trajectory initialization and nonlinear programming for detection-minimization refinement.
核心發現： 核心結果：The attacker’s best response is computed via a two-step approach combining STP-RRT* for feasible trajectory initialization and nonlinear programming for detection-minimization refinement.

CLANE: Continual Learning of Actions on Neuromorphic Hardware from Event Cameras

Authors: Elvin Hajizada, Michael Neumeier, Edward Paxon Frady et al. | Submitted: 2026-05-27 | arXiv: 2605.28387 Categories: cs.LG, cs.AI, cs.NE

Research Background: Recognizing and continuously learning novel human actions without forgetting prior classes is a requirement for emerging AR/VR and robotics applications. For these applications, both on-device processing and learning are essential for privacy and low-latency adaptation.
研究背景： 在機器學習與機器人領域，Recognizing and continuously learning novel human actions without forgetting prior classes is a requirement for emerging AR/VR and robotics applications. For these applications, bo

Technical Approach: We present CLANE, Continual Learning of Actions on Neuromorphic Hardware from Event Cameras, deployed end-to-end on Intel Loihi 2. CLANE combines a spiking 2D CNN for spatiotemporal feature extraction with CLP-SNN as its on-chip learning head, extended to action clips via a Temporal Aggregation Layer and a fixed-point Normalization Layer, both novel Loihi 2 modules.
技術方法： 本文提出的方法：We present CLANE, Continual Learning of Actions on Neuromorphic Hardware from Event Cameras, deployed end-to-end on Intel Loihi 2. CLANE combines a spiking 2D CNN for spatiotemporal feature extraction with CLP-SNN as its on-chip learning head, extend

Key Takeaway: On THU E-ACT-50, a 50-class dataset captured under real-world conditions, CLANE achieves 70.4% accuracy in a continual learning task while delivering more than 100x energy reduction and 16x lower latency over a sequential CNN+GRU+CLP edge GPU baseline, validated through iso-algorithm cross-platfo…
核心發現： 核心結果：On THU E-ACT-50, a 50-class dataset captured under real-world conditions, CLANE achieves 70.4% accuracy in a continual learning task while delivering more than 100x energy reduction and 16x lower late

Category-Level 3D Correspondence in Camera Space via Morphable Object Priors

Authors: Leonhard Sommer, Artur Jesslen, Basavaraj Sunagad et al. | Submitted: 2026-05-27 | arXiv: 2605.28257 Categories: cs.CV

Research Background: Understanding 3D objects from images is fundamental to robotics and AR/VR applications. While recent work has made progress in category-level pose estimation, current representations fail to capture the fine-grained semantics needed for reasoning about object parts, functions, and interactions.
研究背景： 在電腦視覺與機器人領域，Understanding 3D objects from images is fundamental to robotics and AR/VR applications. While recent work has made progress in category-level pose estimation, current representatio

Technical Approach: In this work, we study category-level 3D correspondence in camera space — predicting, from a single image, 3D locations that remain consistent across instances within a category — and show that it can emerge without explicit correspondence supervision by learning a shared morphable object prior. To enable research in this direction, we introduce HouseCorr3D, the first large-scale benchmark for monocular category-level 3D correspondence with 178k images across 50 household object categories,…
技術方法： 本文提出的方法：In this work, we study category-level 3D correspondence in camera space — predicting, from a single image, 3D locations that remain consistent across instances within a category — and show that it can emerge without explicit correspondence supervis

Key Takeaway: These emerging 3D correspondences set a new state of the art on HouseCorr3D, demonstrating that semantic 3D object understanding can arise without direct correspondence supervision.
核心發現： 核心結果：These emerging 3D correspondences set a new state of the art on HouseCorr3D, demonstrating that semantic 3D object understanding can arise without direct correspondence supervision.

SIGMA: Semantic-Difference Instruction-Grounding Mask Annotator for Text-Driven Image Manipulation Localization

Authors: Peiyu Zhuang, Jianquan Yang, Haodong Li et al. | Submitted: 2026-05-27 | arXiv: 2605.27924 Categories: cs.CV

Research Background: Text-driven image editing has advanced rapidly, but reliably localizing these manipulations requires image manipulation localization (IML) models trained on large pixel-annotated datasets, and there is still no low-cost way to obtain such training data at scale. We observe that these data already exist in disguise: public editing datasets contain millions of structurally identical (original, ed…
研究背景： 在電腦視覺與機器人領域，Text-driven image editing has advanced rapidly, but reliably localizing these manipulations requires image manipulation localization (IML) models trained on large pixel-annotated d

Technical Approach: We propose SIGMA (Semantic-difference Instruction-Grounding Mask Annotator), which performs semantic-feature differencing in a vision foundation backbone and injects an instruction-derived spatial prior into this visual stream via bidirectional cross-modal refinement, amplifying the difference signal at intended-edit regions when the editor faithfully realizes user intent.
技術方法： 本文提出的方法：We propose SIGMA (Semantic-difference Instruction-Grounding Mask Annotator), which performs semantic-feature differencing in a vision foundation backbone and injects an instruction-derived spatial prior into this visual stream via bidirectional cross

Key Takeaway: When applied to public editing corpora, it produces a ~1.1M IML training set that improves six diverse detectors by +18.34% F1 across five datasets, turning previously unused editing data into a model-agnostic supervisory resource for IML.
核心發現： 核心結果：When applied to public editing corpora, it produces a ~1.1M IML training set that improves six diverse detectors by +18.34% F1 across five datasets, turning previously unused editing data into a model

Bidirectional Incremental Generalized Hybrid A*

Authors: Sidharth Talia, Oren Salzman, Siddhartha Srinivasa | Submitted: 2026-05-28 | arXiv: 2605.30647 Categories: cs.RO

Research Background: We focus on the problem of efficient anytime kinodynamic planning for systems with complex dynamics in unstructured environments that make precomputing motion primitives infeasible. Directly applying A* to such problems is computationally infeasible due to the curse of dimensionality.
研究背景： 在機器人學習領域，We focus on the problem of efficient anytime kinodynamic planning for systems with complex dynamics in unstructured environments that make precomputing motion primitives infeasible

Technical Approach: However, the frozen vertices can hide solution-supporting vertices from the search at a particular iteration. While classical bidirectional search is motivated by the reduction of search depth, extending IGHA* into the bidirectional setting (termed Bi-IGHA*) obtains additional benefit by fundamentally mitigating the behaviour induced by frozen vertices hiding solutions.
技術方法： 本文提出的方法：However, the frozen vertices can hide solution-supporting vertices from the search at a particular iteration. While classical bidirectional search is motivated by the reduction of search depth, extending IGHA* into the bidirectional setting (termed B

Key Takeaway: We empirically show that Bi-IGHA* substantially reduces expansions on R3, R4, and R6 planning problems, and achieves equivalent closed-loop performance with kinodynamic planning for high-speed off-road autonomy while requiring significantly fewer expansions.
核心發現： 核心結果：We empirically show that Bi-IGHA* substantially reduces expansions on R3, R4, and R6 planning problems, and achieves equivalent closed-loop performance with kinodynamic planning for high-speed off-roa

Caspar: CUDA Accelerator for Symbolic Programming with Adaptive Reordering

Authors: Emil Martens, Aaron Miller, Matias Varnum et al. | Submitted: 2026-05-28 | arXiv: 2605.30583 Categories: cs.RO, cs.PF

Research Background: We present Caspar, a library that makes the power of modern GPUs more accessible in robotics and provides a state-of-the-art nonlinear GPU solver that can be applied to a wide range of different optimization problems. Caspar bridges the gap between expressive symbolic programming in Python and high-performance GPU runtimes in C++ by automatically generating optimized CUDA kernels from symbolic …
研究背景： 在機器人學習領域，We present Caspar, a library that makes the power of modern GPUs more accessible in robotics and provides a state-of-the-art nonlinear GPU solver that can be applied to a wide rang

Technical Approach: In this paper, we present the core components of Caspar and showcase its performance by performing bundle adjustment on the Bundle Adjustment in the Large (BAL) dataset.
技術方法： 本文提出的方法：In this paper, we present the core components of Caspar and showcase its performance by performing bundle adjustment on the Bundle Adjustment in the Large (BAL) dataset.

Key Takeaway: We benchmark Caspar against other state-of-the-art bundle adjusters and show that it is 5 to 20 times faster than the best alternative, requires less memory, and achieves similar accuracy.
核心發現： 核心結果：We benchmark Caspar against other state-of-the-art bundle adjusters and show that it is 5 to 20 times faster than the best alternative, requires less memory, and achieves similar accuracy.

ARISTO Hand: Sensing-Driven Distal Hyperextension for Fine-Grained Manipulation

Authors: Aaron Kim, Dong Ho Kang, Mark Helwig et al. | Submitted: 2026-05-28 | arXiv: 2605.30508 Categories: cs.RO

Research Background: Manipulating thin objects requires precise contact geometry and reliable force perception, yet many anthropomorphic robotic hands lack the mechanical and sensing capabilities needed for such interactions. We present the ARISTO Hand, a tendon-driven robotic hand that integrates active distal hyperextension with a hybrid fingertip-sensing architecture that combines a rigid, nail-mounted force-tor…
研究背景： 在機器人學習領域，Manipulating thin objects requires precise contact geometry and reliable force perception, yet many anthropomorphic robotic hands lack the mechanical and sensing capabilities neede

Technical Approach: We present the ARISTO Hand, a tendon-driven robotic hand that integrates active distal hyperextension with a hybrid fingertip-sensing architecture that combines a rigid, nail-mounted force-torque sensor and a soft capacitive tactile array.
技術方法： 本文提出的方法：We present the ARISTO Hand, a tendon-driven robotic hand that integrates active distal hyperextension with a hybrid fingertip-sensing architecture that combines a rigid, nail-mounted force-torque sensor and a soft capacitive tactile array.

Key Takeaway: Active hyperextension enables controlled fingertip engagement beyond the kinematic limits of standard flexion, increasing pull-out force by 2.76x for object thicknesses of 1-20 mm while preserving the nominal grasp capability.
核心發現： 核心結果：Active hyperextension enables controlled fingertip engagement beyond the kinematic limits of standard flexion, increasing pull-out force by 2.76x for object thicknesses of 1-20 mm while preserving the

UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

Authors: Yufei Jia, Zhanxiang Cao, Mingrui Yu et al. | Submitted: 2026-05-28 | arXiv: 2605.30313 Categories: cs.RO

Research Background: Simulation-based RL for contemporary robot control is increasingly organized around GPU-resident simulation: physics, rollout collection, and learning are placed on a single GPU-centric execution path. This paradigm has greatly improved training speed, but it has also encouraged a default assumption that efficient training requires physics to reside on the GPU.
研究背景： 在機器人學習領域，Simulation-based RL for contemporary robot control is increasingly organized around GPU-resident simulation: physics, rollout collection, and learning are placed on a single GPU-ce

Technical Approach: We present UniLab, a heterogeneous CPU-simulation / GPU-learning architecture that decouples CPU-parallel simulation from GPU policy updates through a unified runtime for data movement, buffering, and synchronization.
技術方法： 本文提出的方法：We present UniLab, a heterogeneous CPU-simulation / GPU-learning architecture that decouples CPU-parallel simulation from GPU policy updates through a unified runtime for data movement, buffering, and synchronization.

Key Takeaway: These results show that GPU simulation is an effective path to efficient training, but not a necessary one, broadening the practical system choices available for robot RL training.
核心發現： 核心結果：These results show that GPU simulation is an effective path to efficient training, but not a necessary one, broadening the practical system choices available for robot RL training.

DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding

Authors: Luzhou Ge, Xiangyu Zhu, Jinyan Liu et al. | Submitted: 2026-05-28 | arXiv: 2605.29879 Categories: cs.CV, cs.RO

Research Background: Integrating open-vocabulary semantic information into dynamic 3D scene representations is essential for long-term embodied scene understanding. However, existing methods often suffer from fragile instance association due to incomplete cross-view cues, while their limited ability to handle object-level topological changes restricts long-term robotic task execution.
研究背景： 在電腦視覺與機器人領域，Integrating open-vocabulary semantic information into dynamic 3D scene representations is essential for long-term embodied scene understanding. However, existing methods often suff

Technical Approach: To address these challenges, we present DGSG-Mind, a hybrid instance-aware 3D Gaussian dynamic scene graph system with an embodied reasoning agent. Our system couples a probabilistic voxel grid with explicit 3D Gaussians to enable robust cross-modal instance fusion and incremental semantic mapping.
技術方法： 本文提出的方法：To address these challenges, we present DGSG-Mind, a hybrid instance-aware 3D Gaussian dynamic scene graph system with an embodied reasoning agent. Our system couples a probabilistic voxel grid with explicit 3D Gaussians to enable robust cross-modal

Key Takeaway: We further deploy DGSG-Mind on real-world robots to demonstrate its target-oriented reasoning and dynamic update capabilities.
核心發現： 核心結果：We further deploy DGSG-Mind on real-world robots to demonstrate its target-oriented reasoning and dynamic update capabilities.

Energy-Aware NECO for Single-Pass Pixel-wise Out-of-Distribution Detection in Semantic Segmentation

Authors: Boyuan Zhang, Huanshan Huang, Yifei Cao | Submitted: 2026-05-28 | arXiv: 2605.29773 Categories: cs.CV, cs.AI, cs.RO

Research Background: Reliable semantic segmentation for mobile robots requires both accurate dense prediction and robust uncertainty estimation under distribution shift. Strong uncertainty baselines such as Monte Carlo Dropout often require repeated stochastic forward passes and are difficult to deploy on edge platforms.
研究背景： 在電腦視覺與機器人領域，Reliable semantic segmentation for mobile robots requires both accurate dense prediction and robust uncertainty estimation under distribution shift. Strong uncertainty baselines su

Technical Approach: We propose Energy-Aware NECO, a single-pass pixel-wise out-of-distribution (OOD) detector for semantic segmentation.
技術方法： 本文提出的方法：We propose Energy-Aware NECO, a single-pass pixel-wise out-of-distribution (OOD) detector for semantic segmentation.

Key Takeaway: Additional qualitative and operating-point analyses show that the hybrid detector improves overall ranking performance while preserving the efficiency advantages of a single-pass design.
核心發現： 核心結果：Additional qualitative and operating-point analyses show that the hybrid detector improves overall ranking performance while preserving the efficiency advantages of a single-pass design.

Joint Angle Estimation with Customized Wristband Based on Online Incremental Learning

Authors: Shuo Wang, Xiaobin Chen, Xiaoming Tao | Submitted: 2026-05-28 | arXiv: 2605.29771 Categories: cs.RO

Research Background: Intelligent wearable technology plays an increasingly important role in human-computer interaction, motion, and health monitoring. To ensure comfort and practicality of use, one common form for motion monitoring is to utilize soft wearable sensors.
研究背景： 在機器人學習領域，Intelligent wearable technology plays an increasingly important role in human-computer interaction, motion, and health monitoring. To ensure comfort and practicality of use, one co

Technical Approach: It is a two-stage estimation method: the first stage updates the model based on the wearer’s wrist movement characteristics using online learning, integrating real-time data from an IMU as ground truth. The second stage utilizes the updated model for estimation of wrist joint angle solely with the wristband.
技術方法： 本文提出的方法：It is a two-stage estimation method: the first stage updates the model based on the wearer’s wrist movement characteristics using online learning, integrating real-time data from an IMU as ground truth. The second stage utilizes the updated model for

Key Takeaway: The results indicate that the sensors exhibit good performance under strain variations, and the wrist joint trajectory estimation of the proposed system has an approximate error of 15 degree in different scenarios.
核心發現： 核心結果：The results indicate that the sensors exhibit good performance under strain variations, and the wrist joint trajectory estimation of the proposed system has an approximate error of 15 degree in differ

Learning to Feel Materials from Multisensory Tactile Data via Interpretable Models

Authors: Li Zou, Yasemin Vardar | Submitted: 2026-05-28 | arXiv: 2605.29572 Categories: cs.RO, cs.HC

Research Background: Human tactile perception of materials relies on complex multisensory touch cues, yet the relationship between low-level tactile signals and perceptual representations remains poorly understood. This knowledge gap hinders the integration of touch in digital environments and the development of robots capable of human-like tactile perception.
研究背景： 在機器人學習領域，Human tactile perception of materials relies on complex multisensory touch cues, yet the relationship between low-level tactile signals and perceptual representations remains poorl

Technical Approach: Here, we present an interpretable computational framework for modeling human material perception and recognition using multisensory touch data. Our framework comprises three interconnected models: Model 1 maps finger-surface interaction features to psychophysical sensory attributes, Model 2 classifies materials based on these perceptual representations, and Model 3 directly classifies materials from tactile features.
技術方法： 本文提出的方法：Here, we present an interpretable computational framework for modeling human material perception and recognition using multisensory touch data. Our framework comprises three interconnected models: Model 1 maps finger-surface interaction features to p

Key Takeaway: The results showed that combining information from pressing, static contact, and sliding interactions improves prediction accuracy, and that thermal cues are particularly informative for both perceptual modeling and material classification.
核心發現： 核心結果：The results showed that combining information from pressing, static contact, and sliding interactions improves prediction accuracy, and that thermal cues are particularly informative for both perceptu

Structured interactions improve distributed coordination beyond model scaling in a real-world multi-robot system

Authors: Junping Wang, Zhizhong Zhang, Yongqiang Tang et al. | Submitted: 2026-05-28 | arXiv: 2605.30383 Categories: cs.RO, cs.AI

Research Background: Scaling individual robot capabilities is common but costly. Here we investigate a system-level design question in real-world multi-robot coordination: given matched hardware budgets, does restructuring communication among robots yield larger gains than increasing onboard model size?
研究背景： 在機器人學習領域，Scaling individual robot capabilities is common but costly. Here we investigate a system-level design question in real-world multi-robot coordination: given matched hardware budget

Technical Approach: Nested mixed-effects model comparisons show a substantially larger improvement in model fit for topology than for scale. The pattern is confirmed in independent SMAC replications; heterogeneous benchmark reanalyses provide secondary supporting consistency checks rather than primary evidence.
技術方法： 本文提出的方法：Nested mixed-effects model comparisons show a substantially larger improvement in model fit for topology than for scale. The pattern is confirmed in independent SMAC replications; heterogeneous benchmark reanalyses provide secondary supporting consis

Key Takeaway: These results indicate that interaction structure can play a dominant role within the tested system and task setting, while broader quantitative generalisation remains to be established.
核心發現： 核心結果：These results indicate that interaction structure can play a dominant role within the tested system and task setting, while broader quantitative generalisation remains to be established.

Extreme dynamic symmetry enables omnidirectional and multifunctional robots

Authors: Jiaxun Liu, Boxi Xia, Boyuan Chen | Submitted: 2026-05-28 | arXiv: 2605.29254 Categories: cs.RO, cs.AI

Research Background: Symmetry is a central organizing principle in natural systems, yet its use as a unifying design strategy in robotics has largely remained limited to geometric form. We show that symmetry can instead be leveraged at the level of dynamic actuation capability.
研究背景： 在機器人學習領域，Symmetry is a central organizing principle in natural systems, yet its use as a unifying design strategy in robotics has largely remained limited to geometric form. We show that sy

Technical Approach: We introduce dynamic symmetry, the uniformity of a robot’s attainable center-of-mass accelerations, and formalize it through a measure coined as dynamic isotropy. To study this regime systematically, we developed Argus, a family of spherical robots designed to explore the effects of increasing dynamic symmetry.
技術方法： 本文提出的方法：We introduce dynamic symmetry, the uniformity of a robot’s attainable center-of-mass accelerations, and formalize it through a measure coined as dynamic isotropy. To study this regime systematically, we developed Argus, a family of spherical robots d

Key Takeaway: These results show that designing robots for symmetry not only in morphology but also in their attainable dynamics provides a powerful and general pathway toward agility, robustness, and multifunctionality in uncertain terrestrial and extraterrestrial environments.
核心發現： 核心結果：These results show that designing robots for symmetry not only in morphology but also in their attainable dynamics provides a powerful and general pathway toward agility, robustness, and multifunction

Learning to Perturb Hidden Representations for Generalizable Deep Learning

Authors: Hua Li | Submitted: 2026-05-28 | arXiv: 2605.29525 Categories: cs.LG

Research Background: Deep neural networks process data through a cascade of representations: input features, hidden activations, logits, and loss. While perturbations at the input, logit, and label levels have been systematically studied, the intermediate hidden activations, which constitute the bulk of the network’s computation, have received no unified perturbation analysis.
研究背景： 在機器學習與機器人領域，Deep neural networks process data through a cascade of representations: input features, hidden activations, logits, and loss. While perturbations at the input, logit, and label lev

Technical Approach: In this paper, we establish a unified framework for hidden activation perturbation, revealing that Dropout, Manifold Mixup, adversarial feature perturbation, and related methods all impose specific forms of activation perturbation but with class-agnostic or random strategies. We propose Learning to Perturb Activations (LPA), which adaptively perturbs activations at a selected hidden layer with class-level perturbations learned via PGD.
技術方法： 本文提出的方法：In this paper, we establish a unified framework for hidden activation perturbation, revealing that Dropout, Manifold Mixup, adversarial feature perturbation, and related methods all impose specific forms of activation perturbation but with class-agno

Key Takeaway: Experiments on balanced classification, long-tail classification, and domain generalization demonstrate that LPA consistently outperforms existing methods and provides complementary benefits to logit perturbation methods such as LPL.
核心發現： 核心結果：Experiments on balanced classification, long-tail classification, and domain generalization demonstrate that LPA consistently outperforms existing methods and provides complementary benefits to logit

Supercharging Thermal Gaussian Splatting with Depth Estimation

Authors: Manoj Biswanath, Chenxin Cai, Hannah Schieber et al. | Submitted: 2026-05-28 | arXiv: 2605.30328 Categories: cs.CV

Research Background: Efficient and robust 3D scene representation is crucial in autonomous driving, robotics, and related fields. While RGB images provide valuable content for 3D reconstruction, other modalities like thermal or depth can enable additional information on the environment.
研究背景： 在電腦視覺與機器人領域，Efficient and robust 3D scene representation is crucial in autonomous driving, robotics, and related fields. While RGB images provide valuable content for 3D reconstruction, other

Technical Approach: Lately, novel view synthesis methods like 3D Gaussian Splatting have started using multiple modalities to further boost their performance. We propose a method, Thermal-to-Depth Gaussian Splatting (TDg), that uses only thermal images and depth estimation in its architecture to derive the radiance fields. Overall, our method is successful in deriving these thermal radiance fields, which can ultimately have several applications, such as identifying heat sources critical in surveillance, search o…
技術方法： 本文提出的方法：Lately, novel view synthesis methods like 3D Gaussian Splatting have started using multiple modalities to further boost their performance. We propose a method, Thermal-to-Depth Gaussian Splatting (TDg), that uses only thermal images and depth estimat

Key Takeaway: It also reduces the training time significantly, by 12 mins 47 secs (55% improvement).
核心發現： 核心結果：It also reduces the training time significantly, by 12 mins 47 secs (55% improvement).

Evaluation of Conversational Agents: Understanding Culture, Context and Environment in Emotion Detection

Authors: Martha Teiko Teye, Yaw Marfo Missah, Emmanuel Ahene et al. | Submitted: 2026-05-28 | arXiv: 2605.30099 Categories: cs.CV

Research Background: Valuable decisions and highly prioritized analysis now depend on applications such as facial biometrics, social media photo tagging, and human robots interactions. However, the ability to successfully deploy such applications is based on their efficiencies on tested use cases taking into consideration possible edge cases.
研究背景： 在電腦視覺與機器人領域，Valuable decisions and highly prioritized analysis now depend on applications such as facial biometrics, social media photo tagging, and human robots interactions. However, the abi

Technical Approach: In this paper, we seek to address the potential challenges in the usage of conversational AI within Black African society. We develop an emotion prediction model with accuracies ranging between 85% and 96%. Our model combines both speech and image data to detect the seven basic emotions with a focus on also identifying sarcasm.
技術方法： 本文提出的方法：In this paper, we seek to address the potential challenges in the usage of conversational AI within Black African society. We develop an emotion prediction model with accuracies ranging between 85% and 96%. Our model combines both speech and image da

Key Takeaway: In the end, our proposed solution contributes to maintaining the credibility of an emotion recognition system in conversational AIs.
核心發現： 核心結果：In the end, our proposed solution contributes to maintaining the credibility of an emotion recognition system in conversational AIs.

ESAM++: Efficient Online 3D Perception on the Edge

Authors: Qin Liu, Lavisha Aggarwal, Saptarashmi Bandyopadhyay et al. | Submitted: 2026-05-28 | arXiv: 2605.29505 Categories: cs.CV

Research Background: Online 3D scene perception in real time is essential for robotics, AR/VR, and autonomous systems, particularly in edge computing scenarios where computational resources are limited and privacy is crucial. Recent state-of-the-art methods like EmbodiedSAM (ESAM) demonstrate the promise of online 3D perception by leveraging the Segment Anything Model (SAM) for real-time, fine-grained, and generali…
研究背景： 在電腦視覺與機器人領域，Online 3D scene perception in real time is essential for robotics, AR/VR, and autonomous systems, particularly in edge computing scenarios where computational resources are limited

Technical Approach: In this paper, we propose ESAM++, a lightweight and scalable alternative for online 3D scene perception tailored to edge devices without GPU acceleration. Our method introduces a 3D Sparse Feature Pyramid Network (SFPN) that efficiently captures multi-scale geometric features from streaming 3D point clouds while significantly reducing computational overhead and model size. We evaluate our approach on four challenging segmentation benchmarks, namely ScanNet, ScanNet200, SceneNN, and 3RScan, de…
技術方法： 本文提出的方法：In this paper, we propose ESAM++, a lightweight and scalable alternative for online 3D scene perception tailored to edge devices without GPU acceleration. Our method introduces a 3D Sparse Feature Pyramid Network (SFPN) that efficiently captures mult

Key Takeaway: We evaluate our approach on four challenging segmentation benchmarks, namely ScanNet, ScanNet200, SceneNN, and 3RScan, demonstrating that our model achieves competitive accuracy with up to 3 times faster inference with a 2 times smaller model size compared to ESAM, enabling practical deployment o…
核心發現： 核心結果：We evaluate our approach on four challenging segmentation benchmarks, namely ScanNet, ScanNet200, SceneNN, and 3RScan, demonstrating that our model achieves competitive accuracy with up to 3 times fas

ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects

Authors: Deokmin Hwang, Minseok Song, Daehyung Park | Submitted: 2026-05-28 | arXiv: 2605.29417 Categories: cs.CV

Research Background: This study addresses the partial-to-complete geometry reconstruction of deformable objects (DOs) from point-cloud observations toward precise DO manipulation. Recent DO reconstruction approaches often adopt implicit neural representations (INRs) to model continuous surfaces as well as capture structural variability.
研究背景： 在電腦視覺與機器人領域，This study addresses the partial-to-complete geometry reconstruction of deformable objects (DOs) from point-cloud observations toward precise DO manipulation. Recent DO reconstruct

Technical Approach: To figure it out, we introduce ParCo-SDF, a two-stage partial-to-complete signed distance field (SDF) reconstruction framework consisting of temporal geometry encoding followed by FiLM-conditioned SDF prediction.
技術方法： 本文提出的方法：To figure it out, we introduce ParCo-SDF, a two-stage partial-to-complete signed distance field (SDF) reconstruction framework consisting of temporal geometry encoding followed by FiLM-conditioned SDF prediction.

Key Takeaway: We evaluate the proposed method against a state-of-the-art DO surface reconstruction baseline on a rubber band manipulation dataset, demonstrating robust and high-fidelity reconstruction under severe occlusions.
核心發現： 核心結果：We evaluate the proposed method against a state-of-the-art DO surface reconstruction baseline on a rubber band manipulation dataset, demonstrating robust and high-fidelity reconstruction under severe

SalsaAgent: A multimodal embodied language model for interactive dance generation

Authors: Payam Jome Yazdian, Zoe Stanley, Angelica Lim | Submitted: 2026-05-28 | arXiv: 2605.29219 Categories: cs.CV

Research Background: Interaction between humanoids involves bidirectional and nonverbal reactivity, coordination and synchrony. Toward socially aware robots and interactive virtual agents, we present SalsaAgent, a language model that generates expressive, full-body salsa dance motions in reaction to a human leader and against a contextual music backdrop.
研究背景： 在電腦視覺與機器人領域，Interaction between humanoids involves bidirectional and nonverbal reactivity, coordination and synchrony. Toward socially aware robots and interactive virtual agents, we present S

Technical Approach: Toward socially aware robots and interactive virtual agents, we present SalsaAgent, a language model that generates expressive, full-body salsa dance motions in reaction to a human leader and against a contextual music backdrop. Subjective and objective evaluations demonstrate the effectiveness of our approach in terms of motion quality, music and partner coordination, and consistent two-person spatial behavior, with significant improvements over baselines.
技術方法： 本文提出的方法：Toward socially aware robots and interactive virtual agents, we present SalsaAgent, a language model that generates expressive, full-body salsa dance motions in reaction to a human leader and against a contextual music backdrop. Subjective and object

Key Takeaway: Subjective and objective evaluations demonstrate the effectiveness of our approach in terms of motion quality, music and partner coordination, and consistent two-person spatial behavior, with significant improvements over baselines.
核心發現： 核心結果：Subjective and objective evaluations demonstrate the effectiveness of our approach in terms of motion quality, music and partner coordination, and consistent two-person spatial behavior, with signific

Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Maps

Authors: Christoffer Heckman, Harel Biggie, Brendan Crowe et al. | Submitted: 2026-05-29 | arXiv: 2606.00318 Categories: cs.RO, cs.CV

Research Background: Persistent maps used by autonomous robots increasingly fuse a geometric perception stack whose assertions are well-characterized with a foundation-model channel that produces semantic claims without calibrated reliability about the same scene. Contemporary mapping systems integrate the two channels by treating the foundation-model channel as an additional voter into a per-element posterior, unc…
研究背景： 在機器人學習領域，Persistent maps used by autonomous robots increasingly fuse a geometric perception stack whose assertions are well-characterized with a foundation-model channel that produces seman

Technical Approach: We propose an update operator with two cooperating mechanisms: a per-class calibrated commit gate, and a per-event conflict-drop window that refuses to commit foundation-model claims contradicted by the geometric channel at the moment of the claim.
技術方法： 本文提出的方法：We propose an update operator with two cooperating mechanisms: a per-class calibrated commit gate, and a per-event conflict-drop window that refuses to commit foundation-model claims contradicted by the geometric channel at the moment of the claim.

Key Takeaway: We evaluate on KITTI-360 and ScanNet, with an oracle geometric channel (panoptic ground truth) and an off-the-shelf online semantic segmenter (Mask2Former) to demonstrate real-world performance.
核心發現： 核心結果：We evaluate on KITTI-360 and ScanNet, with an oracle geometric channel (panoptic ground truth) and an off-the-shelf online semantic segmenter (Mask2Former) to demonstrate real-world performance.

Cuttlebot: a platform demonstration for complex, autonomous, bio-inspired swimmers

Authors: Alexander Nicholas White, Ang Leo Li, Alexander Yin et al. | Submitted: 2026-05-29 | arXiv: 2606.00197 Categories: cs.RO

Research Background: Increasing interest in deep-sea operations and resources motivates the development of ecologically sensitive but environmentally durable robots. Dielectric elastomer actuator artificial muscles are good candidates for powering such systems due to their pressure and temperature tolerance and soft makeup, but they are difficult to integrate with robotic systems.
研究背景： 在機器人學習領域，Increasing interest in deep-sea operations and resources motivates the development of ecologically sensitive but environmentally durable robots. Dielectric elastomer actuator artif

Technical Approach: This work presents an autonomous robotic platform: the CORE, capable of driving six artificial muscles while sensing visual and spatial information. To validate the platform, we developed the Cuttlebot - a cuttlefish-inspired robot that swims in three dimensions using undulatory fin locomotion. This work provides a platform for developing complex, bio-inspired swimming robots for ocean exploration and monitoring, laying the foundation with our leading example: the Cuttlebot.
技術方法： 本文提出的方法：This work presents an autonomous robotic platform: the CORE, capable of driving six artificial muscles while sensing visual and spatial information. To validate the platform, we developed the Cuttlebot - a cuttlefish-inspired robot that swims in thre

Key Takeaway: This work provides a platform for developing complex, bio-inspired swimming robots for ocean exploration and monitoring, laying the foundation with our leading example: the Cuttlebot.
核心發現： 核心結果：This work provides a platform for developing complex, bio-inspired swimming robots for ocean exploration and monitoring, laying the foundation with our leading example: the Cuttlebot.

Safe2Drive: Evaluating Safe Driving Behaviors of E2E Autonomous Driving Models

Authors: Nishad Sahu, Kalpana Panda, Congyuan Yu et al. | Submitted: 2026-05-29 | arXiv: 2606.00191 Categories: cs.RO, cs.CV

Research Background: Recent end-to-end (E2E) autonomous driving policies achieve high driving scores in closed-loop simulations. Yet it remains unclear whether these policies handle common safety-critical scenarios.
研究背景： 在機器人學習領域，Recent end-to-end (E2E) autonomous driving policies achieve high driving scores in closed-loop simulations. Yet it remains unclear whether these policies handle common safety-criti

Technical Approach: We present Safe2Drive (S2D), a set of Bench2Drive-aligned scenario extensions focused on three frequent families of road hazards: work zones, pedestrian jaywalking, and occluded vulnerable road users (VRUs).
技術方法： 本文提出的方法：We present Safe2Drive (S2D), a set of Bench2Drive-aligned scenario extensions focused on three frequent families of road hazards: work zones, pedestrian jaywalking, and occluded vulnerable road users (VRUs).

Key Takeaway: These results are consistent with brittle safe-driving behaviors such as poor work-zone understanding, red-light violations, and late or absent braking for pedestrians.
核心發現： 核心結果：These results are consistent with brittle safe-driving behaviors such as poor work-zone understanding, red-light violations, and late or absent braking for pedestrians.

On-Device Robotic Planning: Eliminating Inference Redundancy for Efficient Decision-Making

Authors: Joonhee Lee, Hyunseung Shin, Hyunmi Kim et al. | Submitted: 2026-05-29 | arXiv: 2605.31460 Categories: cs.RO, eess.SY

Research Background: Reasoning-based robotic policies using large language and vision-language models achieve strong semantic planning capabilities but mostly suffer from a high inference latency that limits practical real-time deployment. In this work, we observe that robotic reasoning workloads contain substantial temporal redundancy, where consecutive observations frequently produce identical actions and subgoals.
研究背景： 在機器人學習領域，Reasoning-based robotic policies using large language and vision-language models achieve strong semantic planning capabilities but mostly suffer from a high inference latency that

Technical Approach: In this work, we observe that robotic reasoning workloads contain substantial temporal redundancy, where consecutive observations frequently produce identical actions and subgoals. Based on this insight, we present REIS, a human cognition inspired robotic decision-making framework that minimizes unnecessary reasoning while preserving semantic adaptability.
技術方法： 本文提出的方法：In this work, we observe that robotic reasoning workloads contain substantial temporal redundancy, where consecutive observations frequently produce identical actions and subgoals. Based on this insight, we present REIS, a human cognition inspired ro

Key Takeaway: Experiments on ALFRED, and real-world robotic tasks demonstrate that REIS significantly suppresses reasoning overhead while maintaining competitive task performance.
核心發現： 核心結果：Experiments on ALFRED, and real-world robotic tasks demonstrate that REIS significantly suppresses reasoning overhead while maintaining competitive task performance.

Adaptive Artificial Time-Delay Control with Barrier Lyapunov Constraints for Euler-Lagrange Robots

Authors: Saksham Gupta, Rishabh Dev Yadav, Sarthak Mishra et al. | Submitted: 2026-05-29 | arXiv: 2605.31405 Categories: cs.RO

Research Background: This paper addresses the challenge of simultaneously compensating for state-dependent uncertainties and enforcing time-varying state constraints in Euler-Lagrange systems, a common requirement in robotics that remains underserved by existing control designs. A novel adaptive control framework is developed that combines an artificial time-delay-based uncertainty estimation strategy, also known a…
研究背景： 在機器人學習領域，This paper addresses the challenge of simultaneously compensating for state-dependent uncertainties and enforcing time-varying state constraints in Euler-Lagrange systems, a common

Technical Approach: A novel adaptive control framework is developed that combines an artificial time-delay-based uncertainty estimation strategy, also known as time-delay estimation, with a barrier Lyapunov function to enforce constraint-aware control design.
技術方法： 本文提出的方法：A novel adaptive control framework is developed that combines an artificial time-delay-based uncertainty estimation strategy, also known as time-delay estimation, with a barrier Lyapunov function to enforce constraint-aware control design.

Key Takeaway: Experimental results on a five-degree-of-freedom robotic manipulator validate the framework’s capability, compared with the state of the art, in maintaining strict adherence to safety-critical constraints under dynamic uncertainties.
核心發現： 核心結果：Experimental results on a five-degree-of-freedom robotic manipulator validate the framework’s capability, compared with the state of the art, in maintaining strict adherence to safety-critical constra

Simulation of collision avoidance behavior in crowd movement by data-driven approach

Authors: Xuanwen Liang, Eric Wai Ming Lee | Submitted: 2026-05-29 | arXiv: 2605.31210 Categories: cs.RO, cs.AI

Research Background: Crowd movement simulation is essential for pedestrian safety management and facility layout optimization. Data-driven models enhance trajectory prediction accuracy under Euclidean metrics, yet they suffer from excessively high collision rates, especially in bidirectional and multidirectional flows.
研究背景： 在機器人學習領域，Crowd movement simulation is essential for pedestrian safety management and facility layout optimization. Data-driven models enhance trajectory prediction accuracy under Euclidean

Technical Approach: In this paper, we establish a novel data-driven crowd simulation model that incorporates the pedestrian collision mechanism into the loss function to reduce collisions.
技術方法： 本文提出的方法：In this paper, we establish a novel data-driven crowd simulation model that incorporates the pedestrian collision mechanism into the loss function to reduce collisions.

Key Takeaway: Results show that the proposed lateral-acceleration-based collision loss significantly reduces opposite-direction pedestrian collision rates to levels comparable with controlled experiments.
核心發現： 核心結果：Results show that the proposed lateral-acceleration-based collision loss significantly reduces opposite-direction pedestrian collision rates to levels comparable with controlled experiments.

Probing Collision Grounding in Vision-Language Models for Safe Human-Robot Collaboration

Authors: Jun Wang, Xiaohao Xu, Xiaonan Huang | Submitted: 2026-05-29 | arXiv: 2605.31196 Categories: cs.CV, cs.AI, cs.CL, cs.RO

Research Background: Safe human—robot collaboration requires more than visual description: a monitor must determine whether the robot body is safely separated, already colliding with the scene or a person, or about to collide. We call this capability collision grounding: binding visual observations to robot body geometry, camera viewpoint, scene layout, human proximity, and temporal motion in order to infer presen…
研究背景： 在電腦視覺與機器人領域，Safe human—robot collaboration requires more than visual description: a monitor must determine whether the robot body is safely separated, already colliding with the scene or a pe

Technical Approach: We introduce TouchSafeBench, a physics-grounded benchmark for evaluating collision grounding in vision-language models (VLMs).
技術方法： 本文提出的方法：We introduce TouchSafeBench, a physics-grounded benchmark for evaluating collision grounding in vision-language models (VLMs).

Key Takeaway: We will release the benchmark upon acceptance.
核心發現： 核心結果：We will release the benchmark upon acceptance.

Don’t Fool Me Twice: Adapting to Adversity in the Wild with Experience-Driven Reasoning

Authors: Navin Sriram Ravie, Andrew Jong, Krrish Jain et al. | Submitted: 2026-05-29 | arXiv: 2605.31119 Categories: cs.RO, cs.LG

Research Background: In robotics, dangers and adversity modes are often embodiment-specific and relative to each agent. A frontier of autonomous mobile robotics is to enable agents to operate effectively in the wild in unseen unstructured environments.
研究背景： 在機器人學習領域，In robotics, dangers and adversity modes are often embodiment-specific and relative to each agent. A frontier of autonomous mobile robotics is to enable agents to operate effective

Technical Approach: We propose a continual learning framework for a mobile embodied agent to learn online from disturbances and attribute anomalous behaviours to causes through semantics, enabling better prediction and planning of the world in the future. Our framework, “Don’t Fool Me Twice”, first observes disturbances and describes their effects on the robot; this description is augmented with visual context to query a VLM to predict possible causes; the local disturbance is characterized using kernel regressi…
技術方法： 本文提出的方法：We propose a continual learning framework for a mobile embodied agent to learn online from disturbances and attribute anomalous behaviours to causes through semantics, enabling better prediction and planning of the world in the future. Our framework,

Key Takeaway: A significant challenge in unseen unstructured environments is that it may not be possible to predict all the dangers to the specific robot.
核心發現： 核心結果：A significant challenge in unseen unstructured environments is that it may not be possible to predict all the dangers to the specific robot.

Building Generalization Into Behavior Generation Via Adaptive Compositions of Regularities

Authors: Aravind Battaje, Malte Bernhard, Vito Mengers et al. | Submitted: 2026-05-29 | arXiv: 2605.31110 Categories: cs.RO

Research Background: Generalization in robotics requires prior knowledge about how the world is structured, yet this structure changes from one situation to the next. This paper investigates the proposition that generalization arises from adaptively composing regularities — predictable relationships within the robot-environment system — into situation-appropriate structures for behavior generation.
研究背景： 在機器人學習領域，Generalization in robotics requires prior knowledge about how the world is structured, yet this structure changes from one situation to the next. This paper investigates the propos

Technical Approach: This paper investigates the proposition that generalization arises from adaptively composing regularities — predictable relationships within the robot-environment system — into situation-appropriate structures for behavior generation. We expose the resulting model to a wide range of novel conditions not considered during design, and we find that it generates context-appropriate behavior in all but one case, where encoded regularities are provably insufficient.
技術方法： 本文提出的方法：This paper investigates the proposition that generalization arises from adaptively composing regularities — predictable relationships within the robot-environment system — into situation-appropriate structures for behavior generation. We expose the

Key Takeaway: These results suggest that adaptive composition of regularities constitutes a powerful inductive bias for building generalization into behavior generation.
核心發現： 核心結果：These results suggest that adaptive composition of regularities constitutes a powerful inductive bias for building generalization into behavior generation.

Modeling Robotics Dataset Construction as an Artifact-Based Build Process

Authors: Leon Pohl, Lukas Beer, George Sebastian et al. | Submitted: 2026-05-29 | arXiv: 2606.00162 Categories: cs.RO, cs.CV, cs.LG

Research Background: Robotic systems generate large volumes of multimodal sensor data, but converting ROS bag recordings into machine learning datasets is often handled by ad hoc sequential scripts, creating engineering overhead and slow iteration cycles. We model dataset construction as an artifact-based build process over a dependency graph and implement this approach in Bagzel, an open-source Bazel extension for…
研究背景： 在機器人學習領域，Robotic systems generate large volumes of multimodal sensor data, but converting ROS bag recordings into machine learning datasets is often handled by ad hoc sequential scripts, cr

Technical Approach: Across dataset sizes from 5.1 to 20.4 GB, Bagzel variants show markedly better scaling behavior than the baseline, especially in warm and incremental modes. Bagzel-xattr provides additional gains, with a mean runtime reduction of 5.9% compared to Bagzel in the input granularity study.
技術方法： 本文提出的方法：Across dataset sizes from 5.1 to 20.4 GB, Bagzel variants show markedly better scaling behavior than the baseline, especially in warm and incremental modes. Bagzel-xattr provides additional gains, with a mean runtime reduction of 5.9% compared to Bag

Key Takeaway: Bagzel reduces runtime in all evaluated execution modes, with the largest gains in iterative workflows (up to 386.26x in warm builds and 7.21x in incremental builds on a 20.4 GB dataset).
核心發現： 核心結果：Bagzel reduces runtime in all evaluated execution modes, with the largest gains in iterative workflows (up to 386.26x in warm builds and 7.21x in incremental builds on a 20.4 GB dataset).

Seeing Fast and Slow: Bimodal 3D Scene Graphs for Open-set Tasks

Authors: Marcel Bartholomeus Prasetyo, Shrutika Vishal Thengane, A Manicka Praveen et al. | Submitted: 2026-05-29 | arXiv: 2605.31067 Categories: cs.RO

Research Background: Open-set task execution can significantly benefit from seamlessly switching between coarse and fine scene representations depending on the context and the evolving information as the robot explores the environment. For example, it is often sufficient to start with a coarse scene representation initially and only employ a finer, more granular scene representation when the robot encounters region…
研究背景： 在機器人學習領域，Open-set task execution can significantly benefit from seamlessly switching between coarse and fine scene representations depending on the context and the evolving information as t

Technical Approach: Hence, in this work, we propose BiMoSG, a bimodal 3D scene graph generation approach for open-set tasks.
技術方法： 本文提出的方法：Hence, in this work, we propose BiMoSG, a bimodal 3D scene graph generation approach for open-set tasks.

Key Takeaway: We demonstrate that our proposed 3D scene graph generation approach is significantly faster than the open-source state-of-the-art approaches.
核心發現： 核心結果：We demonstrate that our proposed 3D scene graph generation approach is significantly faster than the open-source state-of-the-art approaches.

High-Load-Density Electro-Permanent Magnetic Foot with Controllable Adhesion for Quadruped Wall-Climbing Robots

Authors: An Li, Bo Tao, I-Ming Chen et al. | Submitted: 2026-05-29 | arXiv: 2605.30849 Categories: cs.RO

Research Background: To enable reliable climbing locomotion of quadruped robots on ferromagnetic surfaces, this paper presents a high-load-density electro-permanent magnetic foot with controllable adhesion, featuring force-feedback circular Halbach-net electro-permanent magnet (CHN-EPM) adhesion units and a magnetization control system. Due to its three-dimensional magnetic circuit structure and flux-concentration …
研究背景： 在機器人學習領域，To enable reliable climbing locomotion of quadruped robots on ferromagnetic surfaces, this paper presents a high-load-density electro-permanent magnetic foot with controllable adhe

Technical Approach: A magnetization driver and a two-stage pulse current control strategy are developed to regulate the excitation current amplitude and duration, enabling accurate and reliable magnetization. By incorporating a flexible pressure sensor for contact force feedback, the system can effectively monitor attachment and detachment states, ensuring robust adhesion switching under uncertain contact conditions.
技術方法： 本文提出的方法：A magnetization driver and a two-stage pulse current control strategy are developed to regulate the excitation current amplitude and duration, enabling accurate and reliable magnetization. By incorporating a flexible pressure sensor for contact force

Key Takeaway: The proposed system is integrated into a commercial quadruped robot (Unitree GO2), demonstrating high-load adhesion on ceiling and vertical-wall surfaces and stable locomotion on painted, perforated, and curved ferromagnetic surfaces.
核心發現： 核心結果：The proposed system is integrated into a commercial quadruped robot (Unitree GO2), demonstrating high-load adhesion on ceiling and vertical-wall surfaces and stable locomotion on painted, perforated,

DisPlace: Discriminative Place Projections for Multi-Reference Visual Place Recognition

Authors: Dhyey Manish Rajani, Michael Milford, Tobias Fischer | Submitted: 2026-05-29 | arXiv: 2605.30769 Categories: cs.CV, cs.RO

Research Background: A key challenge in Visual Place Recognition (VPR) is matching query images against reference maps captured under diverse environmental conditions and viewpoints. While multiple reference traversals improve robustness, existing fusion strategies either aggregate references uniformly or rely on heuristic selection, without distinguishing descriptor variations that preserve stable place identity f…
研究背景： 在電腦視覺與機器人領域，A key challenge in Visual Place Recognition (VPR) is matching query images against reference maps captured under diverse environmental conditions and viewpoints. While multiple ref

Technical Approach: In this paper, we propose DisPlace, a multi-reference VPR framework that fuses multiple reference descriptors into a single compact and discriminative place representation.
技術方法： 本文提出的方法：In this paper, we propose DisPlace, a multi-reference VPR framework that fuses multiple reference descriptors into a single compact and discriminative place representation.

Key Takeaway: DisPlace outperforms seven multi-reference baselines in 49 out of 54 appearance-varying conditions, consistently improves descriptor-level fusion performance under viewpoint and unstructured settings, and requires less storage during inference than all compared fusion methods.
核心發現： 核心結果：DisPlace outperforms seven multi-reference baselines in 49 out of 54 appearance-varying conditions, consistently improves descriptor-level fusion performance under viewpoint and unstructured settings,

SSR: Scaling Surefooted and Symmetric Humanoid Traversal to the Open World

Authors: Ruiqi Yu, Yiwen Wang, Yuan Hao et al. | Submitted: 2026-05-29 | arXiv: 2605.30770 Categories: cs.RO

Research Background: Extending humanoid traversal to the open world is key to practical deployment in human environments, but remains challenging. The robot must use vision to ensure safe and reliable foot placement on heterogeneous terrain under highly dynamic motion, while producing coordinated, natural whole-body behaviors.
研究背景： 在機器人學習領域，Extending humanoid traversal to the open world is key to practical deployment in human environments, but remains challenging. The robot must use vision to ensure safe and reliable

Technical Approach: We propose SSR, an efficient end-to-end framework for egocentric vision-based humanoid traversal that jointly learns these capabilities.
技術方法： 本文提出的方法：We propose SSR, an efficient end-to-end framework for egocentric vision-based humanoid traversal that jointly learns these capabilities.

Key Takeaway: Extensive experiments show that SSR achieves safe, stable, and high-quality locomotion on diverse real-world terrains, including stairs with varied structures and extreme challenges such as wide gaps and high platforms, while enabling reliable long-horizon traversal in open outdoor environments.
核心發現： 核心結果：Extensive experiments show that SSR achieves safe, stable, and high-quality locomotion on diverse real-world terrains, including stairs with varied structures and extreme challenges such as wide gaps

GLENS: Global Search via Learning from Solver Iterates with Diffusion Models

Authors: Anjian Li, Bartolomeo Stellato, Ryne Beeson | Submitted: 2026-05-29 | arXiv: 2606.00366 Categories: cs.LG, math.OC

Research Background: We consider the problem of generating a large collection of initial guesses for local minima of multimodal non-convex continuous optimization problems. The goal is for these initial guesses to be high-quality (i.e., a numerical solver converges quickly) and diverse (i.e., represent many different local minima).
研究背景： 在機器學習與機器人領域，We consider the problem of generating a large collection of initial guesses for local minima of multimodal non-convex continuous optimization problems. The goal is for these initia

Technical Approach: We propose GLENS (Global Search via Learning from Solver Iterates), a data-efficient global search method that leverages intermediate solver iterates as free data augmentation.
技術方法： 本文提出的方法：We propose GLENS (Global Search via Learning from Solver Iterates), a data-efficient global search method that leverages intermediate solver iterates as free data augmentation.

Key Takeaway: The resulting initial guesses lead to faster solver convergence across different problem settings and solvers.
核心發現： 核心結果：The resulting initial guesses lead to faster solver convergence across different problem settings and solvers.

Graphical einops: bridging tensor networks and computation graphs

Authors: Vincent Wang-Maścianica, Nikhil Khatri | Submitted: 2026-05-29 | arXiv: 2605.31485 Categories: cs.LG, math.CT

Research Background: Architecture diagrams are ubiquitous in deep learning, but they are usually only representational: the tensor-program identities they suggest are still proved by prose and tensor-axis manipulation. We introduce a formal graphical calculus for the structural fragment of tensor programming underlying einops, making such diagrams proof-enabling.
研究背景： 在機器學習與機器人領域，Architecture diagrams are ubiquitous in deep learning, but they are usually only representational: the tensor-program identities they suggest are still proved by prose and tensor-a

Technical Approach: We introduce a formal graphical calculus for the structural fragment of tensor programming underlying einops, making such diagrams proof-enabling.
技術方法： 本文提出的方法：We introduce a formal graphical calculus for the structural fragment of tensor programming underlying einops, making such diagrams proof-enabling.

Key Takeaway: We additionally demonstrate how our rewrite system may be applied to convert attention masks into pre-processing operations, recovering efficient implementations of sparse attention blocks.
核心發現： 核心結果：We additionally demonstrate how our rewrite system may be applied to convert attention masks into pre-processing operations, recovering efficient implementations of sparse attention blocks.

STEP: Learning STructured Embeddings for Progressive Time Series

Authors: Lucas Thil, Jesse Read, Rim Kaddah et al. | Submitted: 2026-05-29 | arXiv: 2605.31061 Categories: cs.LG, cs.AI

Research Background: We present a novel method for learning interpretable representations of progressive time series, that is, data capturing irreversible state transitions such as degradation or task completion. Our approach uses a self-supervised contrastive objective to learn a low-dimensional latent space whose geometry is itself the interpretation: each observation becomes a point on a manifold anchored betwee…
研究背景： 在機器學習與機器人領域，We present a novel method for learning interpretable representations of progressive time series, that is, data capturing irreversible state transitions such as degradation or task

Technical Approach: Our approach uses a self-supervised contrastive objective to learn a low-dimensional latent space whose geometry is itself the interpretation: each observation becomes a point on a manifold anchored between two fixed orthogonal prototype vectors, and a trajectory becomes a path across that manifold. Our method matches or improves over black-box counterparts on all of these while providing transparency about the underlying mechanisms.
技術方法： 本文提出的方法：Our approach uses a self-supervised contrastive objective to learn a low-dimensional latent space whose geometry is itself the interpretation: each observation becomes a point on a manifold anchored between two fixed orthogonal prototype vectors, and

Key Takeaway: Our method matches or improves over black-box counterparts on all of these while providing transparency about the underlying mechanisms.
核心發現： 核心結果：Our method matches or improves over black-box counterparts on all of these while providing transparency about the underlying mechanisms.

UniVerse: A Unified Modulation Framework for Segmentation-Free,Disentangled Multi-Concept Personalization

Authors: Quynh Phung, Sandesh Ghimire, Minsi Hu et al. | Submitted: 2026-05-29 | arXiv: 2606.00351 Categories: cs.CV

Research Background: Personalized visual understanding has advanced significantly, yet existing approaches struggle to localize and extract specific concepts when input images contain multiple objects. Many prior methods rely heavily on segmentation-based supervision or exhibit poor compositional generalization, limiting their ability to accurately disentangle and manipulate individual concepts.
研究背景： 在電腦視覺與機器人領域，Personalized visual understanding has advanced significantly, yet existing approaches struggle to localize and extract specific concepts when input images contain multiple objects.

Technical Approach: In this work, we propose UniVerse, a Unified Modulation Framework for segmentation-free, disentangled multi-concept personalization in diffusion transformers. Our method allows for composable and decomposable concept extraction, enabling fine-grained localization and representation of target objects without explicit segmentation masks. Qualitative and quantitative results show that our approach can precisely extract target concepts in cluttered scenes, paving the way for more flexible, interp…
技術方法： 本文提出的方法：In this work, we propose UniVerse, a Unified Modulation Framework for segmentation-free, disentangled multi-concept personalization in diffusion transformers. Our method allows for composable and decomposable concept extraction, enabling fine-grained

Key Takeaway: Qualitative and quantitative results show that our approach can precisely extract target concepts in cluttered scenes, paving the way for more flexible, interpretable, and personalized visual generation and understanding.
核心發現： 核心結果：Qualitative and quantitative results show that our approach can precisely extract target concepts in cluttered scenes, paving the way for more flexible, interpretable, and personalized visual generati

DSD-GS: Dynamic-Static Decomposition of Gaussian Splatting for Efficient and High-Fidelity Dynamic Scene Reconstruction

Authors: Youngtae Han, Sung-hwan Han, Youngmin Yi | Submitted: 2026-05-29 | arXiv: 2605.30863 Categories: cs.CV, cs.GR

Research Background: Dynamic scene reconstruction and novel view synthesis are fundamental to next-generation visual intelligence applications such as virtual reality, robotics, and digital twins. However, high-fidelity reconstruction of complex, time-varying scenes from arbitrary viewpoints remains a significant challenge.
研究背景： 在電腦視覺與機器人領域，Dynamic scene reconstruction and novel view synthesis are fundamental to next-generation visual intelligence applications such as virtual reality, robotics, and digital twins. Howe

Technical Approach: To mitigate these limitations, we propose a novel dynamic reconstruction framework built upon an efficient static-dynamic decomposition strategy using a Feed-Forward Gaussian Splatting encoder and an optical flow model. By eliminating redundant computations on static regions, our method achieves state-of-the-art performance, outperforming existing baselines across rendering quality, training and rendering speed, and storage efficiency. Notably, on the Neural 3D dataset, our framework requires…
技術方法： 本文提出的方法：To mitigate these limitations, we propose a novel dynamic reconstruction framework built upon an efficient static-dynamic decomposition strategy using a Feed-Forward Gaussian Splatting encoder and an optical flow model. By eliminating redundant compu

Key Takeaway: Furthermore, our decomposition strategy eliminates the need for COLMAP preprocessing and enables deterministic initialization, thereby enhancing both efficiency and reproducibility.
核心發現： 核心結果：Furthermore, our decomposition strategy eliminates the need for COLMAP preprocessing and enables deterministic initialization, thereby enhancing both efficiency and reproducibility.

Coarse-to-Fine Compositional Diffusion for Long-Horizon Planning

Authors: Byoungwoo Park, Utkarsh A. Mishra, Jaemoo Choi et al. | Submitted: 2026-05-30 | arXiv: 2606.00837 Categories: cs.RO, cs.LG

Research Background: Diffusion models provide strong priors for generating structured data, but many tasks require outputs beyond the scale on which these models are typically trained. Compositional generation addresses this by composing overlapping local plans from a pretrained short-horizon prior into a long-horizon output.
研究背景： 在機器人學習領域，Diffusion models provide strong priors for generating structured data, but many tasks require outputs beyond the scale on which these models are typically trained. Compositional ge

Technical Approach: We propose Coarse-to-Fine Compositional Diffusion (CoFi), an inference-time sampler that separates global structure formation from local detail refinement.
技術方法： 本文提出的方法：We propose Coarse-to-Fine Compositional Diffusion (CoFi), an inference-time sampler that separates global structure formation from local detail refinement.

Key Takeaway: Across long-horizon robotic planning, panoramic image generation, and long video generation, CoFi not only improves both global coherence and local sample quality over prior compositional baselines, but also requires 2-8x fewer denoiser evaluations.
核心發現： 核心結果：Across long-horizon robotic planning, panoramic image generation, and long video generation, CoFi not only improves both global coherence and local sample quality over prior compositional baselines, b

SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Models

Authors: Ziheng He, Yixiang Chen, Ning Yang et al. | Submitted: 2026-05-30 | arXiv: 2606.00664 Categories: cs.RO, cs.CV

Research Background: Embodied world models have emerged as a promising paradigm in robotics by predicting how robot actions affect the surrounding scene. However, the rollout inference remains computationally expensive in pixel space, as long-horizon manipulation videos typically have to be generated frame by frame.
研究背景： 在機器人學習領域，Embodied world models have emerged as a promising paradigm in robotics by predicting how robot actions affect the surrounding scene. However, the rollout inference remains computat

Technical Approach: To address this challenge, we propose Sparse Keyframe Interpolation Paradigm (SKIP), an event-preserving sparse-to-dense framework that avoids dense frame-by-frame generation.
技術方法： 本文提出的方法：To address this challenge, we propose Sparse Keyframe Interpolation Paradigm (SKIP), an event-preserving sparse-to-dense framework that avoids dense frame-by-frame generation.

Key Takeaway: Even when they fully replace real demonstrations, $π_{0.5}$ success drops only $1.3$ pp in LIBERO simulation and $6.7$ pp on the real robot, whereas fully dense frame-by-frame generation collapses by $48$ to $58$ pp.
核心發現： 核心結果：Even when they fully replace real demonstrations, $π_{0.5}$ success drops only $1.3$ pp in LIBERO simulation and $6.7$ pp on the real robot, whereas fully dense frame-by-frame generation collapses by

A passive universal grasping mechanism based on an everting shell

Authors: Mythra V. S. Balakuntala, Safvan Palathingal, G. K. Ananthasuresh | Submitted: 2026-05-30 | arXiv: 2606.00470 Categories: cs.RO, cond-mat.soft

Research Background: A passive monolithic compliant grasping mechanism that works based on the eversion of an elastically deformable bistable shell is conceptualized. It comprises grasping arms made of beam segments that work in conjunction with the everting shell.
研究背景： 在機器人學習領域，A passive monolithic compliant grasping mechanism that works based on the eversion of an elastically deformable bistable shell is conceptualized. It comprises grasping arms made of

Technical Approach: The mechanism then stays in that configuration until it is actuated again to turn the shell back to its original configuration and thereby opening the enclosure to release the object. The stiffness of the arms decides the payload of the mechanism.
技術方法： 本文提出的方法：The mechanism then stays in that configuration until it is actuated again to turn the shell back to its original configuration and thereby opening the enclosure to release the object. The stiffness of the arms decides the payload of the mechanism.

Key Takeaway: The bistable shell everts upon contact with the object to enable the grasping arms envelop the object forming an enclosure.
核心發現： 核心結果：The bistable shell everts upon contact with the object to enable the grasping arms envelop the object forming an enclosure.

Beyond Independent Manipulation: Individual Fairness-aware Strategic Classification with Peer Imitation

Authors: Xinpeng Lv, Chunyuan Zheng, Yunxin Mao et al. | Submitted: 2026-05-30 | arXiv: 2606.00827 Categories: cs.LG, cs.AI

Research Background: Strategic classification (SC) investigates scenarios where agents manipulate their features to obtain favorable decisions from predictive models. Existing fairness-aware SC approaches primarily focus on group fairness and typically assume that agents respond independently.
研究背景： 在機器學習與機器人領域，Strategic classification (SC) investigates scenarios where agents manipulate their features to obtain favorable decisions from predictive models. Existing fairness-aware SC approac

Technical Approach: To address this issue, we introduce individual fairness-aware strategic classification (IFSC), a framework that models peer-driven manipulation arising from individual fairness, where agents imitate nearby positively decided peers to obtain favorable outcomes.
技術方法： 本文提出的方法：To address this issue, we introduce individual fairness-aware strategic classification (IFSC), a framework that models peer-driven manipulation arising from individual fairness, where agents imitate nearby positively decided peers to obtain favorable

Key Takeaway: Experiments on synthetic and real-world datasets demonstrate that IFSC improves individual-fairness consistency and mitigates imitation-induced distortions.
核心發現： 核心結果：Experiments on synthetic and real-world datasets demonstrate that IFSC improves individual-fairness consistency and mitigates imitation-induced distortions.

Partial Fairness Awareness: Belief-Guided Strategic Mechanism for Strategic Agents

Authors: Xinpeng Lv, Chunyuan Zheng, Yunxin Mao et al. | Submitted: 2026-05-30 | arXiv: 2606.00826 Categories: cs.LG

Research Background: Strategic machine learning investigates scenarios where agents manipulate their features to receive favorable decisions from predictive models. To address fairness concerns intrinsic to strategic classification, recent work has introduced group-specific fairness constraints.
研究背景： 在機器學習與機器人領域，Strategic machine learning investigates scenarios where agents manipulate their features to receive favorable decisions from predictive models. To address fairness concerns intrins

Technical Approach: To be specific, we introduce a belief-guided strategic mechanism, wherein agents iteratively interact with the decision system and maintain a belief distribution over the candidate set of fairness constraints.
技術方法： 本文提出的方法：To be specific, we introduce a belief-guided strategic mechanism, wherein agents iteratively interact with the decision system and maintain a belief distribution over the candidate set of fairness constraints.

Key Takeaway: Extensive experiments on real-world and synthetic datasets demonstrate that PFA achieves lower group fairness gaps, higher acceptance of truly qualified individuals, and more stable outcomes compared to fully public or private fairness regimes.
核心發現： 核心結果：Extensive experiments on real-world and synthetic datasets demonstrate that PFA achieves lower group fairness gaps, higher acceptance of truly qualified individuals, and more stable outcomes compared

Authors: Shao-An Yin | Submitted: 2026-05-30 | arXiv: 2606.00759 Categories: cs.LG

Research Background: Recent advances in artificial intelligence have expanded the focus from classical optimization to include equilibrium analysis in noncooperative games. Many such games involve shared constraints, leading to Generalized Nash Equilibrium Problems (GNEPs).
研究背景： 在機器學習與機器人領域，Recent advances in artificial intelligence have expanded the focus from classical optimization to include equilibrium analysis in noncooperative games. Many such games involve shar

Technical Approach: This work introduces fully distributed continuous-time algorithms and establishes convergence without requiring multiplier exchange, thereby reducing information exchange per iteration while improving privacy preservation. In the second part, this work includes research conducted in collaboration with Amazon scientists. In this work, I propose using contextual bandits to adaptively select the most suitable active learning strategy.
技術方法： 本文提出的方法：This work introduces fully distributed continuous-time algorithms and establishes convergence without requiring multiplier exchange, thereby reducing information exchange per iteration while improving privacy preservation. In the second part, this wo

Key Takeaway: The effectiveness of the proposed approach is demonstrated on publicly available external datasets.
核心發現： 核心結果：The effectiveness of the proposed approach is demonstrated on publicly available external datasets.

An Attribute-Based Measure of Video Complexity

Authors: Aditya Sarkar, Yi Li, Zihao Wang et al. | Submitted: 2026-05-30 | arXiv: 2606.00640 Categories: cs.CV

Research Background: A new framework for the estimation of the complexity posed by video-question pairs to video-LLMs, Video Attribute-Based Complexity (VideoABC), is proposed. Video complexity is defined as the probability of failure of a video-LLM for a given video-question pair.
研究背景： 在電腦視覺與機器人領域，A new framework for the estimation of the complexity posed by video-question pairs to video-LLMs, Video Attribute-Based Complexity (VideoABC), is proposed. Video complexity is defi

Technical Approach: Given a new video and its projection into the attribute space, complexity is estimated by the expected ABC of the associated quantization cell. To enable the use of VideoABC with small reference video datasets, two quantizers are combined: a k-means quantizer that enables accurate complexity estimates for samples in the distribution of the reference dataset and a universal lattice quantizer that guarantees generalization to out-of-distribution samples.
技術方法： 本文提出的方法：Given a new video and its projection into the attribute space, complexity is estimated by the expected ABC of the associated quantization cell. To enable the use of VideoABC with small reference video datasets, two quantizers are combined: a k-means

Key Takeaway: Finally, the explainable nature of the VideoABC score, in terms of well-defined attributes, is shown to provide insights on how the attribute composition of benchmarks affects their complexity.
核心發現： 核心結果：Finally, the explainable nature of the VideoABC score, in terms of well-defined attributes, is shown to provide insights on how the attribute composition of benchmarks affects their complexity.

Training-Free Imitation Learning with Closed-Form Diffusion Policies

Authors: Raghav Mishra, Ian R. Manchester | Submitted: 2026-05-31 | arXiv: 2606.01238 Categories: cs.RO, cs.LG

Research Background: While diffusion-based policies have impressive performance and expressivity, their long offline training slows down the data collection and policy deployment loop. We introduce Closed-Form Diffusion Policies, a class of training-free diffusion-based policies for imitation learning using the closed-form score derived from the demonstration dataset.
研究背景： 在機器人學習領域，While diffusion-based policies have impressive performance and expressivity, their long offline training slows down the data collection and policy deployment loop. We introduce Clo

Technical Approach: We introduce Closed-Form Diffusion Policies, a class of training-free diffusion-based policies for imitation learning using the closed-form score derived from the demonstration dataset. Finally, we show how closed-form diffusion policies act as a composable primitive that enables data-driven inference-time editing of pre-trained neural diffusion policies, including policy guidance and novel demonstration augmentation.
技術方法： 本文提出的方法：We introduce Closed-Form Diffusion Policies, a class of training-free diffusion-based policies for imitation learning using the closed-form score derived from the demonstration dataset. Finally, we show how closed-form diffusion policies act as a com

Key Takeaway: Finally, we show how closed-form diffusion policies act as a composable primitive that enables data-driven inference-time editing of pre-trained neural diffusion policies, including policy guidance and novel demonstration augmentation.
核心發現： 核心結果：Finally, we show how closed-form diffusion policies act as a composable primitive that enables data-driven inference-time editing of pre-trained neural diffusion policies, including policy guidance an

CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Driving

Authors: Yifan Wang | Submitted: 2026-05-31 | arXiv: 2606.02641 Categories: cs.RO, cs.AI

Research Background: Interactive driving exposes a failure mode that is easy to miss in rule-aware autonomous-driving stacks: a hard-rule margin can be negative for an ego candidate even though a small lawful accommodation by a non-priority agent would restore feasibility. Existing rulebooks, shields, and reachability filters are strong at vetoing unsafe actions, while prediction-based planners model likely responses.
研究背景： 在機器人學習領域，Interactive driving exposes a failure mode that is easy to miss in rule-aware autonomous-driving stacks: a hard-rule margin can be negative for an ego candidate even though a small

Technical Approach: Agent-owned requests are admissible only inside (B_j(s) = β(π_j)α_j^{\max}(s)), a cooperation envelope that separates kinematic reachability from normative priority. The resulting certificate records the binding rule, repair category, repair set, responsibility-weighted cost split, and fallback.
技術方法： 本文提出的方法：Agent-owned requests are admissible only inside (B_j(s) = β(π_j)α_j^{\max}(s)), a cooperation envelope that separates kinematic reachability from normative priority. The resulting certificate records the binding rule, repair category, repair set, r

Key Takeaway: The resulting certificate records the binding rule, repair category, repair set, responsibility-weighted cost split, and fallback.
核心發現： 核心結果：The resulting certificate records the binding rule, repair category, repair set, responsibility-weighted cost split, and fallback.

Tether-Aware Dynamic Collision Avoidance for USV-HROV Systems

Authors: Yang Gu, Ziyang Hong, Xuanlin Chen et al. | Submitted: 2026-05-31 | arXiv: 2606.01112 Categories: cs.RO

Research Background: Heterogeneous marine robotic systems composed of an unmanned surface vehicle (USV) and a hybrid remotely operated vehicle (HROV) have shown great potential for subsea cable inspection. In such missions, the USV tracks the HROV at the surface while supplying power and communication through an umbilical tether.
研究背景： 在機器人學習領域，Heterogeneous marine robotic systems composed of an unmanned surface vehicle (USV) and a hybrid remotely operated vehicle (HROV) have shown great potential for subsea cable inspect

Technical Approach: To address these challenges, this work proposes a tether-aware dynamic collision avoidance method for a USV tracking an HROV.
技術方法： 本文提出的方法：To address these challenges, this work proposes a tether-aware dynamic collision avoidance method for a USV tracking an HROV.

Key Takeaway: Gazebo-based simulations show that the proposed method avoids dynamic obstacle vessels while maintaining tether safety and reducing the likelihood of tether tautness during USV evasive maneuvers.
核心發現： 核心結果：Gazebo-based simulations show that the proposed method avoids dynamic obstacle vessels while maintaining tether safety and reducing the likelihood of tether tautness during USV evasive maneuvers.

Position: Good Embodied Reward Models Need Bad Behavior Data

Authors: Ran Tian, Yilin Wu, Andrea Bajcsy | Submitted: 2026-05-31 | arXiv: 2606.01036 Categories: cs.RO

Research Background: This position paper argues that to obtain reliable embodied reward models, the community must invest in bad'' robot data: failed, suboptimal, error-prone, and even hazardous behaviors. While reward models are central to any foundation model's lifecycle, today's embodied reward models are trained primarily on successful behaviors. **研究背景：** 在機器人學習領域，This position paper argues that to obtain reliable embodied reward models, the community must invest in bad” robot data: failed, suboptimal, error-prone, and even hazardous beha

Technical Approach: We attribute these failures to a key data gap: the scarcity of negative embodied data which is costly to collect and often filtered out or withheld in existing robotics datasets. Furthermore, we show that even modest exposure to real bad behavior data can improve alignment with human preferences and reduce costly false positives.
技術方法： 本文提出的方法：We attribute these failures to a key data gap: the scarcity of negative embodied data which is costly to collect and often filtered out or withheld in existing robotics datasets. Furthermore, we show that even modest exposure to real bad behavior dat

Key Takeaway: We therefore call on the embodied AI community to curate and release their bad robot data, build synthetic bad data generation engines, develop more decentralized physical evaluation systems, and design benchmarks for fine-grained embodied reward model evaluations.
核心發現： 核心結果：We therefore call on the embodied AI community to curate and release their bad robot data, build synthetic bad data generation engines, develop more decentralized physical evaluation systems, and desi

AI-IoT-Robotics Integration: Survey of Frameworks, Emerging Trends, and the Path Toward Connected Robotics

Authors: Ranulfo Bezerra, Satoshi Tadokoro, Kazunori Ohno | Submitted: 2026-05-31 | arXiv: 2606.01015 Categories: cs.RO, cs.AI, cs.NI, eess.SY

Research Background: The convergence of Artificial Intelligence, the Internet of Things, and Robotics is no longer a futuristic vision; it is rapidly becoming the foundation of real-time, intelligent, and context-aware systems. AI enables perception and reasoning, IoT provides scalable sensing and communication, and robotics delivers embodied actuation.
研究背景： 在機器人學習領域，The convergence of Artificial Intelligence, the Internet of Things, and Robotics is no longer a futuristic vision; it is rapidly becoming the foundation of real-time, intelligent,

Technical Approach: We propose a modular system architecture that aligns with these trends, analyze persistent gaps in interoperability and feedback control, and classify existing work by integration depth. This work offers a conceptual and technical roadmap for designing next-generation AI-IoT-Robotic ecosystems that are modular, interpretable, and capable of learning within dynamic environments, paving the way for the emerging paradigm of Connected Robotics and Physical AI.
技術方法： 本文提出的方法：We propose a modular system architecture that aligns with these trends, analyze persistent gaps in interoperability and feedback control, and classify existing work by integration depth. This work offers a conceptual and technical roadmap for designi

Key Takeaway: This survey synthesizes the state-of-the-art across these domains, emphasizing the emerging role of Small Language Models (SLMs) at the edge and Large Language Models (LLMs) in the cloud for distributed cognition and autonomous decision-making.
核心發現： 核心結果：This survey synthesizes the state-of-the-art across these domains, emphasizing the emerging role of Small Language Models (SLMs) at the edge and Large Language Models (LLMs) in the cloud for distribut

One Channel to Rule Them All: Rethinking Input Representation for Visual Place Recognition

Authors: Timur Ismagilov, Shakaiba Majeed, Michael Milford et al. | Submitted: 2026-05-31 | arXiv: 2606.00936 Categories: cs.CV

Research Background: Visual Place Recognition (VPR) is fundamental to long-term robot localization and SLAM, yet current systems overwhelmingly rely on RGB input, implicitly assuming color is necessary for global place recognition. We challenge this assumption, investigating the role of chromatic information across training regimes, model architectures and standard benchmarks under real-world appearance variation.
研究背景： 在電腦視覺與機器人領域，Visual Place Recognition (VPR) is fundamental to long-term robot localization and SLAM, yet current systems overwhelmingly rely on RGB input, implicitly assuming color is necessary

Technical Approach: Across selected benchmarks, a fully gray-trained MixVPR model achieves an average 82.4% Recall@1 compared to 81.2% for its RGB counterpart. In some cases, lightweight grayscale variants with 60% fewer parameters can outperform heavier RGB models.
技術方法： 本文提出的方法：Across selected benchmarks, a fully gray-trained MixVPR model achieves an average 82.4% Recall@1 compared to 81.2% for its RGB counterpart. In some cases, lightweight grayscale variants with 60% fewer parameters can outperform heavier RGB models.

Key Takeaway: In some cases, lightweight grayscale variants with 60% fewer parameters can outperform heavier RGB models.
核心發現： 核心結果：In some cases, lightweight grayscale variants with 60% fewer parameters can outperform heavier RGB models.

Explorer

arXiv Digest — 2026-W23

arXiv Weekly Digest — Week 23, 2026