arXiv Weekly Digest — Week 11, 2026
Fetched: 2026-03-15 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 393
Safe Whole-Body Loco-Manipulation via Combined Model and Learning-based Control
Authors: Alexander Schperberg, Yeping Wang, Stefano Di Cairano | Submitted: 2026-03-02 | arXiv: 2603.02443
Categories: cs.RO, cs.HC, eess.SY
Research Background: Simultaneous locomotion and manipulation enables robots to interact with their environment beyond the constraints of a fixed base. However, coordinating legged locomotion with arm manipulation, while considering safety and compliance during contact interaction remains challenging.
研究背景: 在機器人學習領域,Simultaneous locomotion and manipulation enables robots to interact with their environment beyond the constraints of a fixed base. However, coordinating legged locomotion with arm
Technical Approach: To this end, we propose a whole-body controller that combines a model-based admittance control for the manipulator arm with a Reinforcement Learning (RL) policy for legged locomotion. We validate our approach in both simulation and hardware using the Unitree Go2 quadruped robot with a 6-DoF arm and wrist-mounted 6-DoF Force/Torque sensor.
技術方法: 本文提出的方法:To this end, we propose a whole-body controller that combines a model-based admittance control for the manipulator arm with a Reinforcement Learning (RL) policy for legged locomotion. We validate our
Key Takeaway: Results demonstrate accurate tracking of interaction-driven velocities, compliant behavior, and safe, reliable performance in dynamic settings.
核心發現: 核心結果:Results demonstrate accurate tracking of interaction-driven velocities, compliant behavior, and safe, reliable performance in dynamic settings.
Rethinking Camera Choice: An Empirical Study on Fisheye Camera Properties in Robotic Manipulation
Authors: Han Xue, Nan Min, Xiaotong Liu et al. | Submitted: 2026-03-02 | arXiv: 2603.02139
Categories: cs.RO, cs.CV
Research Background: The adoption of fisheye cameras in robotic manipulation, driven by their exceptionally wide Field of View (FoV), is rapidly outpacing a systematic understanding of their downstream effects on policy learning. This paper presents the first comprehensive empirical study to bridge this gap, rigorously analyzing the properties of wrist-mounted fisheye cameras for imitation learning.
研究背景: 在機器人學習領域,The adoption of fisheye cameras in robotic manipulation, driven by their exceptionally wide Field of View (FoV), is rapidly outpacing a systematic understanding of their downstream
Technical Approach: This paper presents the first comprehensive empirical study to bridge this gap, rigorously analyzing the properties of wrist-mounted fisheye cameras for imitation learning.
技術方法: 本文提出的方法:This paper presents the first comprehensive empirical study to bridge this gap, rigorously analyzing the properties of wrist-mounted fisheye cameras for imitation learning.
Key Takeaway: More results and videos are available on https://robo-fisheye.github.io/
核心發現: 核心結果:More results and videos are available on https://robo-fisheye.github.io/
ACDC: Adaptive Curriculum Planning with Dynamic Contrastive Control for Goal-Conditioned Reinforcement Learning in Robotic Manipulation
Authors: Xuerui Wang, Guangyu Ren, Tianhong Dai et al. | Submitted: 2026-03-02 | arXiv: 2603.02104
Categories: cs.RO
Research Background: Goal-conditioned reinforcement learning has shown considerable potential in robotic manipulation; however, existing approaches remain limited by their reliance on prioritizing collected experience, resulting in suboptimal performance across diverse tasks. Inspired by human learning behaviors, we propose a more comprehensive learning paradigm, ACDC, which integrates multidimensional Adaptive Curriculum (AC) Planning with Dynamic Contrastive (DC) Control to guide the agent along a well-designed learning trajectory.
研究背景: 在機器人學習領域,Goal-conditioned reinforcement learning has shown considerable potential in robotic manipulation; however, existing approaches remain limited by their reliance on prioritizing coll
Technical Approach: Inspired by human learning behaviors, we propose a more comprehensive learning paradigm, ACDC, which integrates multidimensional Adaptive Curriculum (AC) Planning with Dynamic Contrastive (DC) Control to guide the agent along a well-designed learning trajectory.
技術方法: 本文提出的方法:Inspired by human learning behaviors, we propose a more comprehensive learning paradigm, ACDC, which integrates multidimensional Adaptive Curriculum (AC) Planning with Dynamic Contrastive (DC) Control
Key Takeaway: Extensive experiments on challenging robotic manipulation tasks demonstrate that ACDC consistently outperforms the state-of-the-art baselines in both sample efficiency and final task success rate.
核心發現: 核心結果:Extensive experiments on challenging robotic manipulation tasks demonstrate that ACDC consistently outperforms the state-of-the-art baselines in both sample efficiency and final task success rate.
-StepNFT: Wider Space Needs Finer Steps in Online RL for Flow-based VLAs
Authors: Siting Wang, Xiaofeng Wang, Zheng Zhu et al. | Submitted: 2026-03-02 | arXiv: 2603.02083
Categories: cs.RO, cs.CV
Research Background: Flow-based vision-language-action (VLA) models excel in embodied control but suffer from intractable likelihoods during multi-step sampling, hindering online reinforcement learning. We propose \textbf{\textit{-StepNFT}} (Step-wise Negative-aware Fine-Tuning), a critic-and-likelihood-free framework that requires only a single forward pass per optimization step and eliminates auxiliary value networks.
研究背景: 在機器人學習領域,Flow-based vision-language-action (VLA) models excel in embodied control but suffer from intractable likelihoods during multi-step sampling, hindering online reinforcement learning
Technical Approach: We propose \textbf{\textit{-StepNFT}} (Step-wise Negative-aware Fine-Tuning), a critic-and-likelihood-free framework that requires only a single forward pass per optimization step and eliminates auxiliary value networks.
技術方法: 本文提出的方法:We propose \textbf{\textit{-StepNFT}} (Step-wise Negative-aware Fine-Tuning), a critic-and-likelihood-free framework that requires only a single forward pass per optimization step and el
Key Takeaway: Moreover, it achieves superior generalization on ManiSkill, outperforming value-based baselines in OOD scenarios by preventing overfitting to multimodal features.
核心發現: 核心結果:Moreover, it achieves superior generalization on ManiSkill, outperforming value-based baselines in OOD scenarios by preventing overfitting to multimodal features.
CHOP: Counterfactual Human Preference Labels Improve Obstacle Avoidance in Visuomotor Navigation Policies
Authors: Gershom Seneviratne, Jianyu An, Vaibhav Shende et al. | Submitted: 2026-03-02 | arXiv: 2603.02004
Categories: cs.RO
Research Background: Visuomotor navigation policies have shown strong perception-action coupling for embodied agents, yet they often struggle with safe navigation and dynamic obstacle avoidance in complex real-world environments. We introduce CHOP, a novel approach that leverages Counterfactual Human Preference Labels to align visuomotor navigation policies towards human intuition of safety and obstacle avoidance in navigation.
研究背景: 在機器人學習領域,Visuomotor navigation policies have shown strong perception-action coupling for embodied agents, yet they often struggle with safe navigation and dynamic obstacle avoidance in comp
Technical Approach: We introduce CHOP, a novel approach that leverages Counterfactual Human Preference Labels to align visuomotor navigation policies towards human intuition of safety and obstacle avoidance in navigation.
技術方法: 本文提出的方法:We introduce CHOP, a novel approach that leverages Counterfactual Human Preference Labels to align visuomotor navigation policies towards human intuition of safety and obstacle avoidance in navigation
Key Takeaway: Our results highlight the value of counterfactual preference supervision in bridging the gap between large-scale visuomotor policies and human-aligned, safety-aware embodied navigation.
核心發現: 核心結果:Our results highlight the value of counterfactual preference supervision in bridging the gap between large-scale visuomotor policies and human-aligned, safety-aware embodied navigation.
Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policy
Authors: Pengyuan Wu, Pingrui Zhang, Zhigang Wang et al. | Submitted: 2026-03-02 | arXiv: 2603.01953
Categories: cs.RO, cs.AI, cs.CV
Research Background: Diffusion-based policies have achieved remarkable results in robotic manipulation but often struggle to adapt rapidly in dynamic scenarios, leading to delayed responses or task failures. We present DCDP, a Dynamic Closed-Loop Diffusion Policy framework that integrates chunk-based action generation with real-time correction.
研究背景: 在機器人學習領域,Diffusion-based policies have achieved remarkable results in robotic manipulation but often struggle to adapt rapidly in dynamic scenarios, leading to delayed responses or task fai
Technical Approach: We present DCDP, a Dynamic Closed-Loop Diffusion Policy framework that integrates chunk-based action generation with real-time correction.
技術方法: 本文提出的方法:We present DCDP, a Dynamic Closed-Loop Diffusion Policy framework that integrates chunk-based action generation with real-time correction.
Key Takeaway: In dynamic PushT simulations, DCDP improves adaptability by 19% without retraining while requiring only 5% additional computation.
核心發現: 核心結果:In dynamic PushT simulations, DCDP improves adaptability by 19% without retraining while requiring only 5% additional computation.
Co-designing a Social Robot for Newcomer Children’s Cultural and Language Learning
Authors: Neil Fernandes, Tehniyat Shahbaz, Emily Davies-Robinson et al. | Submitted: 2026-03-02 | arXiv: 2603.26674
Categories: cs.RO, cs.CY, cs.HC
Research Background: Newcomer children face barriers in acquiring the host country’s language and literacy programs are often constrained by limited staffing, mixed-proficiency cohorts, and short contact time. While Socially Assistive Robots (SARs) show promise in education, their use in these socio-emotionally sensitive settings remains underexplored.
研究背景: 在機器人學習領域,Newcomer children face barriers in acquiring the host country’s language and literacy programs are often constrained by limited staffing, mixed-proficiency cohorts, and short conta
Technical Approach: While Socially Assistive Robots (SARs) show promise in education, their use in these socio-emotionally sensitive settings remains underexplored. This research presents a co-design study with program tutors and coordinators, to explore the design space for a social robot, Maple. We contribute (1) a domain summary outlining four recurring challenges, (2) a discussion on cultural orientation and community belonging with robots, (3) an expert-grounded discussion of the perceived role of an SAR in cultural and language learning, and (4) preliminary design guidelines for integrating an SAR into a classroom.
技術方法: 本文提出的方法:While Socially Assistive Robots (SARs) show promise in education, their use in these socio-emotionally sensitive settings remains underexplored. This research presents a co-design study with program t
Key Takeaway: These expert-grounded insights lay the foundation for iterative design and evaluation with newcomer children and their families.
核心發現: 核心結果:These expert-grounded insights lay the foundation for iterative design and evaluation with newcomer children and their families.
SSMG-Nav: Enhancing Lifelong Object Navigation with Semantic Skeleton Memory Graph
Authors: Haochen Niu, Lantao Zhang, Xingwu Ji et al. | Submitted: 2026-03-02 | arXiv: 2603.01813
Categories: cs.RO
Research Background: Navigating to out-of-sight targets from human instructions in unfamiliar environments is a core capability for service robots. Despite substantial progress, most approaches underutilize reusable, persistent memory, constraining performance in lifelong settings.
研究背景: 在機器人學習領域,Navigating to out-of-sight targets from human instructions in unfamiliar environments is a core capability for service robots. Despite substantial progress, most approaches underut
Technical Approach: To address such limitations, we introduce SSMG-Nav, a framework for object navigation built on a \textit{Semantic Skeleton Memory Graph} (SSMG) that consolidates past observations into a spatially aligned, persistent memory anchored by topological keypoints (e.g., junctions, room centers). Extensive experiments on challenging lifelong benchmarks and standard ObjectNav benchmarks demonstrate that, compared to strong baselines, our method achieves higher success rates and greater path efficiency, validating the effectiveness of SSMG-Nav.
技術方法: 本文提出的方法:To address such limitations, we introduce SSMG-Nav, a framework for object navigation built on a \textit{Semantic Skeleton Memory Graph} (SSMG) that consolidates past observations into a spatially ali
Key Takeaway: Extensive experiments on challenging lifelong benchmarks and standard ObjectNav benchmarks demonstrate that, compared to strong baselines, our method achieves higher success rates and greater path efficiency, validating the effectiveness of SSMG-Nav.
核心發現: 核心結果:Extensive experiments on challenging lifelong benchmarks and standard ObjectNav benchmarks demonstrate that, compared to strong baselines, our method achieves higher success rates and greater path eff
Neural Implicit Action Fields: From Discrete Waypoints to Continuous Functions for Vision-Language-Action Models
Authors: Haoyun Liu, Jianzhuang Zhao, Xinyuan Chang et al. | Submitted: 2026-03-02 | arXiv: 2603.01766
Categories: cs.RO
Research Background: Despite the rapid progress of vision-language-action (VLA) models, the prevailing practice of predicting action chunks as discrete waypoints remains structurally misaligned with the intrinsic continuity of physical motion. This discretization arises naturally from fixed-rate robot data collection and the token-by-token prediction paradigm of large language models, but ties actions to rigid sampling rates, does not naturally support analytically consistent higher-order derivatives, and introduces quantization artifacts that hinder precise, compliant interaction.
研究背景: 在機器人學習領域,Despite the rapid progress of vision-language-action (VLA) models, the prevailing practice of predicting action chunks as discrete waypoints remains structurally misaligned with th
Technical Approach: We propose Neural Implicit Action Fields (NIAF), which reformulates chunk-level action representation from discrete waypoints to continuous action functions. Our approach achieves strong results on CALVIN and LIBERO across diverse backbones.
技術方法: 本文提出的方法:We propose Neural Implicit Action Fields (NIAF), which reformulates chunk-level action representation from discrete waypoints to continuous action functions. Our approach achieves strong results on CA
Key Takeaway: Real-world experiments further confirm that NIAF supports stable impedance control, bridging policy-side action generation and execution-side smooth control.
核心發現: 核心結果:Real-world experiments further confirm that NIAF supports stable impedance control, bridging policy-side action generation and execution-side smooth control.
Learning Thermal-Aware Locomotion Policies for an Electrically-Actuated Quadruped Robot
Authors: Letian Qian, Yuhang Wan, Shuhan Wang et al. | Submitted: 2026-03-02 | arXiv: 2603.01631
Categories: cs.RO
Research Background: Electrically-actuated quadrupedal robots possess high mobility on complex terrains, but their motors tend to accumulate heat under high-torque cyclic loads, potentially triggering overheat protection and limiting long-duration tasks. This work proposes a thermal-aware control method that incorporates motor temperatures into reinforcement learning locomotion policies and introduces thermal-constraint rewards to prevent temperature exceedance.
研究背景: 在機器人學習領域,Electrically-actuated quadrupedal robots possess high mobility on complex terrains, but their motors tend to accumulate heat under high-torque cyclic loads, potentially triggering
Technical Approach: This work proposes a thermal-aware control method that incorporates motor temperatures into reinforcement learning locomotion policies and introduces thermal-constraint rewards to prevent temperature exceedance.
技術方法: 本文提出的方法:This work proposes a thermal-aware control method that incorporates motor temperatures into reinforcement learning locomotion policies and introduces thermal-constraint rewards to prevent temperature
Key Takeaway: Real-world experiments on the Unitree A1 demonstrate that, under a fixed 3 kg payload, the baseline policy triggers overheat protection and stops within approximately 7 minutes, whereas the proposed method can operate continuously for over 27 minutes without thermal interruptions while maintaining comparable command-tracking performance, thereby enhancing sustainable operational capability.
核心發現: 核心結果:Real-world experiments on the Unitree A1 demonstrate that, under a fixed 3 kg payload, the baseline policy triggers overheat protection and stops within approximately 7 minutes, whereas the proposed m
KERV: Kinematic-Rectified Speculative Decoding for Embodied VLA Models
Authors: Zihao Zheng, Zhihao Mao, Maoliang Li et al. | Submitted: 2026-03-02 | arXiv: 2603.01581
Categories: cs.RO, cs.LG
Research Background: Vision-Language-Action (VLA) models build a token-domain robot control paradigm, yet suffer from low speed. Speculative Decoding (SD) is an optimization strategy that can boost inference speed.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models build a token-domain robot control paradigm, yet suffer from low speed. Speculative Decoding (SD) is an optimization strategy that can boost inf
Technical Approach: Moreover, we design a kinematics-based adjustment strategy to dynamically rectify the acceptance threshold, addressing the difficulty of threshold determination.
技術方法: 本文提出的方法:Moreover, we design a kinematics-based adjustment strategy to dynamically rectify the acceptance threshold, addressing the difficulty of threshold determination.
Key Takeaway: Experimental results across diverse tasks and environments demonstrate that KERV achieves 27%~37% acceleration with nearly no Success Rate loss.
核心發現: 核心結果:Experimental results across diverse tasks and environments demonstrate that KERV achieves 27%~37% acceleration with nearly no Success Rate loss.
Pri4R: Learning World Dynamics for Vision-Language-Action Models with Privileged 4D Representation
Authors: Jisoo Kim, Jungbin Cho, Sanghyeok Chu et al. | Submitted: 2026-03-02 | arXiv: 2603.01549
Categories: cs.CV, cs.AI, cs.RO
Research Background: Humans learn not only how their bodies move, but also how the surrounding world responds to their actions. In contrast, while recent Vision-Language-Action (VLA) models exhibit impressive semantic understanding, they often fail to capture the spatiotemporal dynamics governing physical interaction.
研究背景: 在機器人學習領域,Humans learn not only how their bodies move, but also how the surrounding world responds to their actions. In contrast, while recent Vision-Language-Action (VLA) models exhibit imp
Technical Approach: In this paper, we introduce Pri4R, a simple yet effective approach that endows VLA models with an implicit understanding of world dynamics by leveraging privileged 4D information during training.
技術方法: 本文提出的方法:In this paper, we introduce Pri4R, a simple yet effective approach that endows VLA models with an implicit understanding of world dynamics by leveraging privileged 4D information during training.
Key Takeaway: We further show that 3D point track prediction is an effective supervision target for learning action-world dynamics, and validate our design choices through extensive ablations.
核心發現: 核心結果:We further show that 3D point track prediction is an effective supervision target for learning action-world dynamics, and validate our design choices through extensive ablations.
Bimanual XR Specification of Relative and Absolute Assembly Hierarchies for Teleoperation
Authors: Benjamin Yang, Xichen He, Charlie Zou et al. | Submitted: 2026-03-02 | arXiv: 2603.01495
Categories: cs.HC, cs.RO
Research Background: We present a bimanual XR interaction approach for specifying remote assembly tasks as hierarchies of relative and absolute object constraints that specify high-level teleoperation goals for robots. Grabbing one object in each hand creates a constraint group (visualized as a hull) and groups can be nested into hierarchies.
研究背景: 在機器人學習領域,We present a bimanual XR interaction approach for specifying remote assembly tasks as hierarchies of relative and absolute object constraints that specify high-level teleoperation
Technical Approach: We present a bimanual XR interaction approach for specifying remote assembly tasks as hierarchies of relative and absolute object constraints that specify high-level teleoperation goals for robots.
技術方法: 本文提出的方法:We present a bimanual XR interaction approach for specifying remote assembly tasks as hierarchies of relative and absolute object constraints that specify high-level teleoperation goals for robots.
Key Takeaway: A relative group specifies a subassembly that can be constructed at a location chosen by the robot software for efficiency rather than mandated by the user.
核心發現: 核心結果:A relative group specifies a subassembly that can be constructed at a location chosen by the robot software for efficiency rather than mandated by the user.
ROSER: Few-Shot Robotic Sequence Retrieval for Scalable Robot Learning
Authors: Zillur Rahman, Eddison Pham, Alejandro Daniel Noel et al. | Submitted: 2026-03-02 | arXiv: 2603.01474
Categories: cs.RO
Research Background: A critical bottleneck in robot learning is the scarcity of task-labeled, segmented training data, despite the abundance of large-scale robotic datasets recorded as long, continuous interaction logs. Existing datasets contain vast amounts of diverse behaviors, yet remain structurally incompatible with modern learning frameworks that require cleanly segmented, task-specific trajectories.
研究背景: 在機器人學習領域,A critical bottleneck in robot learning is the scarcity of task-labeled, segmented training data, despite the abundance of large-scale robotic datasets recorded as long, continuous
Technical Approach: We introduce ROSER, a lightweight few-shot retrieval framework that learns task-agnostic metric spaces over temporal windows, enabling accurate retrieval with as few as 3-5 demonstrations, without any task-specific training required. To validate our approach, we establish comprehensive evaluation protocols and benchmark ROSER against classical alignment methods, learned embeddings, and language model baselines across three large-scale datasets (e.g., LIBERO, DROID, and nuScenes).
技術方法: 本文提出的方法:We introduce ROSER, a lightweight few-shot retrieval framework that learns task-agnostic metric spaces over temporal windows, enabling accurate retrieval with as few as 3-5 demonstrations, without any
Key Takeaway: Our experiments demonstrate that ROSER consistently outperforms all prior methods in both accuracy and efficiency, achieving sub-millisecond per-match inference while maintaining superior distributional alignment.
核心發現: 核心結果:Our experiments demonstrate that ROSER consistently outperforms all prior methods in both accuracy and efficiency, achieving sub-millisecond per-match inference while maintaining superior distribution
Mean-Flow based One-Step Vision-Language-Action
Authors: Yang Chen, Xiaoguang Ma, Bin Zhao | Submitted: 2026-03-02 | arXiv: 2603.01469
Categories: cs.RO, cs.AI
Research Background: Recent advances in FlowMatching-based Vision-Language-Action (VLA) frameworks have demonstrated remarkable advantages in generating high-frequency action chunks, particularly for highly dexterous robotic manipulation tasks. Despite these notable achievements, their practical applications are constrained by prolonged generation latency, which stems from inherent iterative sampling requirements and architectural limitations.
研究背景: 在機器人學習領域,Recent advances in FlowMatching-based Vision-Language-Action (VLA) frameworks have demonstrated remarkable advantages in generating high-frequency action chunks, particularly for h
Technical Approach: To address this critical bottleneck, we propose a Mean-Flow based One-Step VLA approach.
技術方法: 本文提出的方法:To address this critical bottleneck, we propose a Mean-Flow based One-Step VLA approach.
Key Takeaway: These results elucidate its great potential as a high-efficiency backbone for VLA-based robotic manipulation.
核心發現: 核心結果:These results elucidate its great potential as a high-efficiency backbone for VLA-based robotic manipulation.
Non-Markovian Long-Horizon Robot Manipulation via Keyframe Chaining
Authors: Yipeng Chen, Wentao Tan, Lei Zhu et al. | Submitted: 2026-03-02 | arXiv: 2603.01465
Categories: cs.RO, cs.AI
Research Background: Existing Vision-Language-Action (VLA) models often struggle to generalize to long-horizon tasks due to their heavy reliance on immediate observations. While recent studies incorporate retrieval mechanisms or extend context windows to handle procedural tasks, they often struggle to capture Non-Markovian dependencies, where optimal actions rely solely on specific past states rather than the current observation.
研究背景: 在機器人學習領域,Existing Vision-Language-Action (VLA) models often struggle to generalize to long-horizon tasks due to their heavy reliance on immediate observations. While recent studies incorpor
Technical Approach: To address this, we introduce Keyframe-Chaining VLA, a framework that extracts and links key historical frames to model long-horizon dependencies. Specifically, we propose an automatic keyframe selector that learns a discriminative embedding space, effectively identifying distinct state transitions. To capture task-critical information, we design a progress-aware query mechanism that dynamically retrieves historical frames based on their temporal relevance to the current execution phase.
技術方法: 本文提出的方法:To address this, we introduce Keyframe-Chaining VLA, a framework that extracts and links key historical frames to model long-horizon dependencies. Specifically, we propose an automatic keyframe select
Key Takeaway: Experimental results demonstrate that our method achieves superior performance, effectively tackling robot manipulation tasks characterized by long-horizon temporal dependencies.
核心發現: 核心結果:Experimental results demonstrate that our method achieves superior performance, effectively tackling robot manipulation tasks characterized by long-horizon temporal dependencies.
Scaling Tasks, Not Samples: Mastering Humanoid Control through Multi-Task Model-Based Reinforcement Learning
Authors: Shaohuai Liu, Weirui Ye, Yilun Du et al. | Submitted: 2026-03-02 | arXiv: 2603.01452
Categories: cs.AI, cs.RO
Research Background: Developing generalist robots capable of mastering diverse skills remains a central challenge in embodied AI. While recent progress emphasizes scaling model parameters and offline datasets, such approaches are limited in robotics, where learning requires active interaction.
研究背景: 在機器人學習領域,Developing generalist robots capable of mastering diverse skills remains a central challenge in embodied AI. While recent progress emphasizes scaling model parameters and offline d
Technical Approach: While recent progress emphasizes scaling model parameters and offline datasets, such approaches are limited in robotics, where learning requires active interaction. We argue that effective online learning should scale the \emph{number of tasks}, rather than the number of samples per task. This regime reveals a structural advantage of model-based reinforcement learning (MBRL).
技術方法: 本文提出的方法:While recent progress emphasizes scaling model parameters and offline datasets, such approaches are limited in robotics, where learning requires active interaction. We argue that effective online lear
Key Takeaway: These results establish task scaling as a critical axis for scalable robotic learning.
核心發現: 核心結果:These results establish task scaling as a critical axis for scalable robotic learning.
PhysGraph: Physically-Grounded Graph-Transformer Policies for Bimanual Dexterous Hand-Tool-Object Manipulation
Authors: Runfa Blark Li, David Kim, Xinshuang Liu et al. | Submitted: 2026-03-02 | arXiv: 2603.01436
Categories: cs.RO
Research Background: Bimanual dexterous manipulation for tool use remains a formidable challenge in robotics due to the high-dimensional state space and complicated contact dynamics. Existing methods naively represent the entire system state as a single configuration vector, disregarding the rich structural and topological information inherent to articulated hands.
研究背景: 在機器人學習領域,Bimanual dexterous manipulation for tool use remains a formidable challenge in robotics due to the high-dimensional state space and complicated contact dynamics. Existing methods n
Technical Approach: We present PhysGraph, a physically-grounded graph transformer policy designed explicitly for challenging bimanual hand-tool-object manipulation. We propose a physically-grounded bias generator that injects structural priors directly into the attention mechanism, including kinematic spatial distance, dynamic contact states, geometric proximity, and anatomical properties.
技術方法: 本文提出的方法:We present PhysGraph, a physically-grounded graph transformer policy designed explicitly for challenging bimanual hand-tool-object manipulation. We propose a physically-grounded bias generator that in
Key Takeaway: Extensive experiments show that PhysGraph significantly outperforms baseline - ManipTrans in manipulation precision and task success rates while using only 51% of the parameters of ManipTrans.
核心發現: 核心結果:Extensive experiments show that PhysGraph significantly outperforms baseline - ManipTrans in manipulation precision and task success rates while using only 51% of the parameters of ManipTrans.
SEAR: Sample Efficient Action Chunking Reinforcement Learning
Authors: C. F. Maximilian Nagy, Onur Celik, Emiliyan Gospodinov et al. | Submitted: 2026-03-02 | arXiv: 2603.01891
Categories: cs.LG
Research Background: Action chunking can improve exploration and value estimation in long horizon reinforcement learning, but makes learning substantially harder since the critic must evaluate action sequences rather than single actions, greatly increasing approximation and data efficiency challenges. As a result, existing action chunking methods, primarily designed for the offline and offline-to-online settings, have not achieved strong performance in purely online reinforcement learning.
研究背景: 在機器人學習領域,Action chunking can improve exploration and value estimation in long horizon reinforcement learning, but makes learning substantially harder since the critic must evaluate action s
Technical Approach: We introduce SEAR, an off policy online reinforcement learning algorithm for action chunking.
技術方法: 本文提出的方法:We introduce SEAR, an off policy online reinforcement learning algorithm for action chunking.
Key Takeaway: SEAR outperforms state of the art online reinforcement learning methods on Metaworld, training with chunk sizes up to 20.
核心發現: 核心結果:SEAR outperforms state of the art online reinforcement learning methods on Metaworld, training with chunk sizes up to 20.
LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
Authors: Yuechen Luo, Fang Li, Shaoqing Xu et al. | Submitted: 2026-03-02 | arXiv: 2603.01928
Categories: cs.CV
Research Background: While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) leads to semantic-perceptual decoupling and perceptual-symbolic conflicts. Recent shifts toward latent reasoning attempt to bypass these bottlenecks by thinking in continuous hidden space.
研究背景: 在機器人學習領域,While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) lead
Technical Approach: To address this, we propose the Latent Spatio-Temporal VLA (LaST-VLA), a framework shifting the reasoning paradigm from discrete symbolic processing into a physically grounded Latent Spatio-Temporal CoT.
技術方法: 本文提出的方法:To address this, we propose the Latent Spatio-Temporal VLA (LaST-VLA), a framework shifting the reasoning paradigm from discrete symbolic processing into a physically grounded Latent Spatio-Temporal C
Key Takeaway: Coupled with a progressive SFT training strategy that transitions from feature alignment to trajectory generation, and refined via Reinforcement Learning with Group Relative Policy Optimization (GRPO) to ensure safety and rule compliance. \method~setting a new record on NAVSIM v1 (91.3 PDMS) and NAVSIM v2 (87.1 EPDMS), while excelling in spatial-temporal reasoning on SURDS and NuDynamics benchmarks.
核心發現: 核心結果:Coupled with a progressive SFT training strategy that transitions from feature alignment to trajectory generation, and refined via Reinforcement Learning with Group Relative Policy Optimization (GRPO)
Act-Observe-Rewrite: Multimodal Coding Agents as In-Context Policy Learners for Robot Manipulation
Authors: Vaishak Kumar | Submitted: 2026-03-03 | arXiv: 2603.04466
Categories: cs.RO, cs.LG
Research Background: Can a multimodal language model learn to manipulate physical objects by reasoning about its own failures-without gradient updates, demonstrations, or reward engineering? We argue the answer is yes, under conditions we characterise precisely.
研究背景: 在機器人學習領域,Can a multimodal language model learn to manipulate physical objects by reasoning about its own failures-without gradient updates, demonstrations, or reward engineering? We argue t
Technical Approach: We present Act-Observe-Rewrite (AOR), a framework in which an LLM agent improves a robot manipulation policy by synthesising entirely new executable Python controller code between trials, guided by visual observations and structured episode outcomes.
技術方法: 本文提出的方法:We present Act-Observe-Rewrite (AOR), a framework in which an LLM agent improves a robot manipulation policy by synthesising entirely new executable Python controller code between trials, guided by vi
Key Takeaway: We validate this across three robosuite manipulation tasks and report promising results, with the agent achieving high success rates without demonstrations, reward engineering, or gradient updates.
核心發現: 核心結果:We validate this across three robosuite manipulation tasks and report promising results, with the agent achieving high success rates without demonstrations, reward engineering, or gradient updates.
ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation
Authors: Xialin He, Sirui Xu, Xinyao Li et al. | Submitted: 2026-03-03 | arXiv: 2603.03279
Categories: cs.RO, cs.CV
Research Background: Achieving autonomous and versatile whole-body loco-manipulation remains a central barrier to making humanoids practically useful. Yet existing approaches are fundamentally constrained: retargeted data are often scarce or low-quality; methods struggle to scale to large skill repertoires; and, most importantly, they rely on tracking predefined motion references rather than generating behavior from perception and high-level task specifications.
研究背景: 在機器人學習領域,Achieving autonomous and versatile whole-body loco-manipulation remains a central barrier to making humanoids practically useful. Yet existing approaches are fundamentally constrai
Technical Approach: To address these limitations, we propose ULTRA, a unified framework with two key components. First, we introduce a physics-driven neural retargeting algorithm that translates large-scale motion capture to humanoid embodiments while preserving physical plausibility for contact-rich interactions.
技術方法: 本文提出的方法:To address these limitations, we propose ULTRA, a unified framework with two key components. First, we introduce a physics-driven neural retargeting algorithm that translates large-scale motion captur
Key Takeaway: Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception, consistently outperforming tracking-only baselines with limited skills.
核心發現: 核心結果:Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception, consistently outperforming tracking-only baselines with limited skills.
HoMMI: Learning Whole-Body Mobile Manipulation from Human Demonstrations
Authors: Xiaomeng Xu, Jisang Park, Han Zhang et al. | Submitted: 2026-03-03 | arXiv: 2603.03243
Categories: cs.RO
Research Background: We present Whole-Body Mobile Manipulation Interface (HoMMI), a data collection and policy learning framework that learns whole-body mobile manipulation directly from robot-free human demonstrations. We augment UMI interfaces with egocentric sensing to capture the global context required for mobile manipulation, enabling portable, robot-free, and scalable data collection.
研究背景: 在機器人學習領域,We present Whole-Body Mobile Manipulation Interface (HoMMI), a data collection and policy learning framework that learns whole-body mobile manipulation directly from robot-free hum
Technical Approach: We present Whole-Body Mobile Manipulation Interface (HoMMI), a data collection and policy learning framework that learns whole-body mobile manipulation directly from robot-free human demonstrations.
技術方法: 本文提出的方法:We present Whole-Body Mobile Manipulation Interface (HoMMI), a data collection and policy learning framework that learns whole-body mobile manipulation directly from robot-free human demonstrations.
Key Takeaway: Results are best viewed on: https://hommi-robot.github.io
核心發現: 核心結果:Results are best viewed on: https://hommi-robot.github.io
Robotic Grasping and Placement Controlled by EEG-Based Hybrid Visual and Motor Imagery
Authors: Yichang Liu, Tianyu Wang, Ziyi Ye et al. | Submitted: 2026-03-03 | arXiv: 2603.03181
Categories: cs.RO, eess.SP
Research Background: We present a framework that integrates EEG-based visual and motor imagery (VI/MI) with robotic control to enable real-time, intention-driven grasping and placement. Motivated by the promise of BCI-driven robotics to enhance human-robot interaction, this system bridges neural signals with physical control by deploying offline-pretrained decoders in a zero-shot manner within an online streaming pipeline.
研究背景: 在機器人學習領域,We present a framework that integrates EEG-based visual and motor imagery (VI/MI) with robotic control to enable real-time, intention-driven grasping and placement. Motivated by th
Technical Approach: We present a framework that integrates EEG-based visual and motor imagery (VI/MI) with robotic control to enable real-time, intention-driven grasping and placement.
技術方法: 本文提出的方法:We present a framework that integrates EEG-based visual and motor imagery (VI/MI) with robotic control to enable real-time, intention-driven grasping and placement.
Key Takeaway: These results demonstrate that high-level visual cognition can be decoded in real time and translated into executable robot commands, bridging the gap between neural signals and physical interaction, and validating the flexibility of a purely imagery-based BCI paradigm for practical human-robot collaboration.
核心發現: 核心結果:These results demonstrate that high-level visual cognition can be decoded in real time and translated into executable robot commands, bridging the gap between neural signals and physical interaction,
CMoE: Contrastive Mixture of Experts for Motion Control and Terrain Adaptation of Humanoid Robots
Authors: Shihao Ma, Hongjin Chen, Zijun Xu et al. | Submitted: 2026-03-03 | arXiv: 2603.03067
Categories: cs.RO
Research Background: For effective deployment in real-world environments, humanoid robots must autonomously navigate a diverse range of complex terrains with abrupt transitions. While the Vanilla mixture of experts (MoE) framework is theoretically capable of modeling diverse terrain features, in practice, the gating network exhibits nearly uniform expert activations across different terrains, weakening the expert specialization and limiting the model’s expressive power.
研究背景: 在機器人學習領域,For effective deployment in real-world environments, humanoid robots must autonomously navigate a diverse range of complex terrains with abrupt transitions. While the Vanilla mixtu
Technical Approach: To address this limitation, we introduce CMoE, a novel single-stage reinforcement learning framework that integrates contrastive learning to refine expert activation distributions. We validated our approach on the Unitree G1 humanoid robot through a series of challenging experiments.
技術方法: 本文提出的方法:To address this limitation, we introduce CMoE, a novel single-stage reinforcement learning framework that integrates contrastive learning to refine expert activation distributions. We validated our ap
Key Takeaway: Results demonstrate that CMoE enables the robot to traverse continuous steps up to 20 cm high and gaps up to 80 cm wide, while achieving robust and natural gait across diverse mixed terrains, surpassing the limits of existing methods.
核心發現: 核心結果:Results demonstrate that CMoE enables the robot to traverse continuous steps up to 20 cm high and gaps up to 80 cm wide, while achieving robust and natural gait across diverse mixed terrains, surpassi
Rhythm: Learning Interactive Whole-Body Control for Dual Humanoids
Authors: Hongjin Chen, Wei Zhang, Pengfei Li et al. | Submitted: 2026-03-03 | arXiv: 2603.02856
Categories: cs.RO
Research Background: Realizing interactive whole-body control for multi-humanoid systems is critical for unlocking complex collaborative capabilities in shared environments. Although recent advancements have significantly enhanced the agility of individual robots, bridging the gap to physically coupled multi-humanoid interaction remains challenging, primarily due to severe kinematic mismatches and complex contact dynamics.
研究背景: 在機器人學習領域,Realizing interactive whole-body control for multi-humanoid systems is critical for unlocking complex collaborative capabilities in shared environments. Although recent advancement
Technical Approach: To address this, we introduce Rhythm, the first unified framework enabling real-world deployment of dual-humanoid systems for complex, physically plausible interactions. Our framework integrates three core components: (1) an Interaction-Aware Motion Retargeting (IAMR) module that generates feasible humanoid interaction references from human data; (2) an Interaction-Guided Reinforcement Learning (IGRL) policy that masters coupled dynamics via graph-based rewards; and (3) a real-world deployment system that enables robust transfer of dual-humanoid interaction. Extensive experiments on physical Unitree G1 robots demonstrate that our framework achieves robust interactive whole-body control, successfully transferring diverse behaviors such as hugging and dancing from simulation to reality.
技術方法: 本文提出的方法:To address this, we introduce Rhythm, the first unified framework enabling real-world deployment of dual-humanoid systems for complex, physically plausible interactions. Our framework integrates three
Key Takeaway: Extensive experiments on physical Unitree G1 robots demonstrate that our framework achieves robust interactive whole-body control, successfully transferring diverse behaviors such as hugging and dancing from simulation to reality.
核心發現: 核心結果:Extensive experiments on physical Unitree G1 robots demonstrate that our framework achieves robust interactive whole-body control, successfully transferring diverse behaviors such as hugging and danci
Generative adversarial imitation learning for robot swarms: Learning from human demonstrations and trained policies
Authors: Mattes Kraus, Jonas Kuckling | Submitted: 2026-03-03 | arXiv: 2603.02783
Categories: cs.RO, cs.LG, cs.MA
Research Background: In imitation learning, robots are supposed to learn from demonstrations of the desired behavior. Most of the work in imitation learning for swarm robotics provides the demonstrations as rollouts of an existing policy.
研究背景: 在機器人學習領域,In imitation learning, robots are supposed to learn from demonstrations of the desired behavior. Most of the work in imitation learning for swarm robotics provides the demonstratio
Technical Approach: Our framework is evaluated across six different missions, learning both from manual demonstrations and demonstrations derived from a PPO-trained policy.
技術方法: 本文提出的方法:Our framework is evaluated across six different missions, learning both from manual demonstrations and demonstrations derived from a PPO-trained policy.
Key Takeaway: The exhibited behaviors preserved their visually recognizable character and their performance is comparable to the one achieved in simulation.
核心發現: 核心結果:The exhibited behaviors preserved their visually recognizable character and their performance is comparable to the one achieved in simulation.
Agentic Self-Evolutionary Replanning for Embodied Navigation
Authors: Guoliang Li, Ruihua Han, Chengyang Li et al. | Submitted: 2026-03-03 | arXiv: 2603.02772
Categories: cs.RO
Research Background: Failure is inevitable for embodied navigation in complex environments. To enhance the resilience, replanning (RP) is a viable option, where the robot is allowed to fail, but is capable of adjusting plan until success.
研究背景: 在機器人學習領域,Failure is inevitable for embodied navigation in complex environments. To enhance the resilience, replanning (RP) is a viable option, where the robot is allowed to fail, but is cap
Technical Approach: To address this limitation, we propose Self-Evolutionary RePlanning, or SERP for short, which leads to a paradigm shift from frozen models towards evolving models by run-time learning from recent experiences. In contrast to existing model evolution approaches that often get stuck at predefined static parameters, we introduce agentic self-evolving action model that uses in-context learning with auto-differentiation (ILAD) for adaptive function adjustment and global parameter reset.
技術方法: 本文提出的方法:To address this limitation, we propose Self-Evolutionary RePlanning, or SERP for short, which leads to a paradigm shift from frozen models towards evolving models by run-time learning from recent expe
Key Takeaway: Extensive simulation and real-world experiments demonstrate that SERP achieves higher success rate with lower token expenditure over various benchmarks, validating its superior robustness and efficiency across diverse environments.
核心發現: 核心結果:Extensive simulation and real-world experiments demonstrate that SERP achieves higher success rate with lower token expenditure over various benchmarks, validating its superior robustness and efficien
Uni-Skill: Building Self-Evolving Skill Repository for Generalizable Robotic Manipulation
Authors: Senwei Xie, Yuntian Zhang, Ruiping Wang et al. | Submitted: 2026-03-03 | arXiv: 2603.02623
Categories: cs.RO, cs.LG
Research Background: While skill-centric approaches leverage foundation models to enhance generalization in compositional tasks, they often rely on fixed skill libraries, limiting adaptability to new tasks without manual intervention. To address this, we propose Uni-Skill, a Unified Skill-centric framework that supports skill-aware planning and facilitates automatic skill evolution.
研究背景: 在機器人學習領域,While skill-centric approaches leverage foundation models to enhance generalization in compositional tasks, they often rely on fixed skill libraries, limiting adaptability to new t
Technical Approach: To address this, we propose Uni-Skill, a Unified Skill-centric framework that supports skill-aware planning and facilitates automatic skill evolution.
技術方法: 本文提出的方法:To address this, we propose Uni-Skill, a Unified Skill-centric framework that supports skill-aware planning and facilitates automatic skill evolution.
Key Takeaway: Comprehensive experiments in both simulation and real-world settings verify the state-of-the-art performance of Uni-Skill over existing VLM-based skill-centric approaches, highlighting its advanced reasoning capabilities and strong zero-shot generalization across a wide range of novel tasks.
核心發現: 核心結果:Comprehensive experiments in both simulation and real-world settings verify the state-of-the-art performance of Uni-Skill over existing VLM-based skill-centric approaches, highlighting its advanced re
Give me scissors: Collision-Free Dual-Arm Surgical Assistive Robot for Instrument Delivery
Authors: Xuejin Luo, Shiquan Sun, Runshi Zhang et al. | Submitted: 2026-03-03 | arXiv: 2603.02553
Categories: cs.RO, cs.CV, cs.HC, cs.LG
Research Background: During surgery, scrub nurses are required to frequently deliver surgical instruments to surgeons, which can lead to physical fatigue and decreased focus. Robotic scrub nurses provide a promising solution that can replace repetitive tasks and enhance efficiency.
研究背景: 在機器人學習領域,During surgery, scrub nurses are required to frequently deliver surgical instruments to surgeons, which can lead to physical fatigue and decreased focus. Robotic scrub nurses provi
Technical Approach: To address these challenges, we present a collision-free dual-arm surgical assistive robot capable of performing instrument delivery.
技術方法: 本文提出的方法:To address these challenges, we present a collision-free dual-arm surgical assistive robot capable of performing instrument delivery.
Key Takeaway: Extensive experimental validations demonstrate that the proposed robotic system achieves an 83.33% success rate in surgical instrument delivery while maintaining smooth, collision-free movement throughout all trials.
核心發現: 核心結果:Extensive experimental validations demonstrate that the proposed robotic system achieves an 83.33% success rate in surgical instrument delivery while maintaining smooth, collision-free movement throug
Risk-Aware Reinforcement Learning for Mobile Manipulation
Authors: Michael Groom, James Wilson, Nick Hawes et al. | Submitted: 2026-03-04 | arXiv: 2603.04579
Categories: cs.RO
Research Background: For robots to successfully transition from lab settings to everyday environments, they must begin to reason about the risks associated with their actions and make informed, risk-aware decisions. This is particularly true for robots performing mobile manipulation tasks, which involve both interacting with and navigating within dynamic, unstructured spaces.
研究背景: 在機器人學習領域,For robots to successfully transition from lab settings to everyday environments, they must begin to reason about the risks associated with their actions and make informed, risk-aw
Technical Approach: Our method achieves this by first training a privileged teacher policy using Distributional Reinforcement Learning (DRL), with a risk-neutral distributional critic.
技術方法: 本文提出的方法:Our method achieves this by first training a privileged teacher policy using Distributional Reinforcement Learning (DRL), with a risk-neutral distributional critic.
Key Takeaway: We perform extensive evaluations demonstrating that our trained visuomotor policies exhibit risk-aware behaviour (specifically achieving better worst-case performance) while performing reactive whole-body motions in unmapped environments, leveraging live depth observations for perception.
核心發現: 核心結果:We perform extensive evaluations demonstrating that our trained visuomotor policies exhibit risk-aware behaviour (specifically achieving better worst-case performance) while performing reactive whole-
PTLD: Sim-to-real Privileged Tactile Latent Distillation for Dexterous Manipulation
Authors: Rosy Chen, Mustafa Mukadam, Michael Kaess et al. | Submitted: 2026-03-04 | arXiv: 2603.04531
Categories: cs.RO
Research Background: Tactile dexterous manipulation is essential to automating complex household tasks, yet learning effective control policies remains a challenge. While recent work has relied on imitation learning, obtaining high quality demonstrations for multi-fingered hands via robot teleoperation or kinesthetic teaching is prohibitive.
研究背景: 在機器人學習領域,Tactile dexterous manipulation is essential to automating complex household tasks, yet learning effective control policies remains a challenge. While recent work has relied on imit
Technical Approach: To bridge this gap, we introduce PTLD: sim-to-real Privileged Tactile Latent Distillation, a novel approach to learning tactile manipulation skills without requiring tactile simulation.
技術方法: 本文提出的方法:To bridge this gap, we introduce PTLD: sim-to-real Privileged Tactile Latent Distillation, a novel approach to learning tactile manipulation skills without requiring tactile simulation.
Key Takeaway: We also show that PTLD enables learning the challenging task of tactile in-hand reorientation where we see a 57% improvement in the number of goals reached over using proprioception alone.
核心發現: 核心結果:We also show that PTLD enables learning the challenging task of tactile in-hand reorientation where we see a 57% improvement in the number of goals reached over using proprioception alone.
ManipulationNet: An Infrastructure for Benchmarking Real-World Robot Manipulation with Physical Skill Challenges and Embodied Multimodal Reasoning
Authors: Yiting Chen, Kenneth Kimble, Edward H. Adelson et al. | Submitted: 2026-03-04 | arXiv: 2603.04363
Categories: cs.RO
Research Background: Dexterous manipulation enables robots to purposefully alter the physical world, transforming them from passive observers into active agents in unstructured environments. This capability is the cornerstone of physical artificial intelligence.
研究背景: 在機器人學習領域,Dexterous manipulation enables robots to purposefully alter the physical world, transforming them from passive observers into active agents in unstructured environments. This capab
Technical Approach: To address this, we introduce ManipulationNet, a global infrastructure that hosts real-world benchmark tasks for robotic manipulation.
技術方法: 本文提出的方法:To address this, we introduce ManipulationNet, a global infrastructure that hosts real-world benchmark tasks for robotic manipulation.
Key Takeaway: As a persistent and scalable infrastructure, ManipulationNet organizes benchmark tasks into two complementary tracks: 1) the Physical Skills Track, which evaluates low-level physical interaction skills, and 2) the Embodied Reasoning Track, which tests high-level reasoning and multimodal grounding abilities.
核心發現: 核心結果:As a persistent and scalable infrastructure, ManipulationNet organizes benchmark tasks into two complementary tracks: 1) the Physical Skills Track, which evaluates low-level physical interaction skill
RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robots
Authors: Soroush Nasiriany, Sepehr Nasiriany, Abhiram Maddukuri et al. | Submitted: 2026-03-04 | arXiv: 2603.04356
Categories: cs.RO, cs.AI, cs.LG
Research Background: Recent advances in robot learning have accelerated progress toward generalist robots that can perform everyday tasks in human environments. Yet it remains difficult to gauge how close we are to this vision.
研究背景: 在機器人學習領域,Recent advances in robot learning have accelerated progress toward generalist robots that can perform everyday tasks in human environments. Yet it remains difficult to gauge how cl
Technical Approach: To fill this gap, we present RoboCasa365, a comprehensive simulation benchmark for household mobile manipulation.
技術方法: 本文提出的方法:To fill this gap, we present RoboCasa365, a comprehensive simulation benchmark for household mobile manipulation.
Key Takeaway: Our results provide new insights into what factors most strongly affect the performance of generalist robots and inform strategies for future progress in the field.
核心發現: 核心結果:Our results provide new insights into what factors most strongly affect the performance of generalist robots and inform strategies for future progress in the field.
Gaussian Mixture-Based Inverse Perception Contract for Uncertainty-Aware Robot Navigation
Authors: Bingyao Du, Joonkyung Kim, Yiwei Lyu | Submitted: 2026-03-04 | arXiv: 2603.04329
Categories: cs.RO
Research Background: Reliable navigation in cluttered environments requires perception outputs that are not only accurate but also equipped with uncertainty sets suitable for safe control. An inverse perception contract (IPC) provides such a connection by mapping perceptual estimates to sets that contain the ground truth with high confidence.
研究背景: 在機器人學習領域,Reliable navigation in cluttered environments requires perception outputs that are not only accurate but also equipped with uncertainty sets suitable for safe control. An inverse p
Technical Approach: In this work, we introduce Gaussian Mixture-based Inverse Perception Contract (GM-IPC), which extends IPC to represent uncertainty with unions of ellipsoidal confidence sets derived from Gaussian mixture models.
技術方法: 本文提出的方法:In this work, we introduce Gaussian Mixture-based Inverse Perception Contract (GM-IPC), which extends IPC to represent uncertainty with unions of ellipsoidal confidence sets derived from Gaussian mixt
Key Takeaway: We further show that the resulting uncertainty characterizations can be leveraged in downstream planning frameworks for real-time safe navigation, enabling less conservative and more adaptive robot motion while preserving safety in a probabilistic manner.
核心發現: 核心結果:We further show that the resulting uncertainty characterizations can be leveraged in downstream planning frameworks for real-time safe navigation, enabling less conservative and more adaptive robot mo
Compliant In-hand Rolling Manipulation Using Tactile Sensing
Authors: Huan Weng, Yifei Chen, Kevin M. Lynch | Submitted: 2026-03-04 | arXiv: 2603.04301
Categories: cs.RO
Research Background: We investigate in-hand rolling manipulation using a multifingered robot hand, where each finger is compliant and equipped with a tactile fingertip providing contact location and wrench information. We derive the equations of motion for compliant quasistatic in-hand rolling manipulation and formulate a fingertip rolling manipulation controller for multiple fingers to achieve a desired object twist within a grasp.
研究背景: 在機器人學習領域,We investigate in-hand rolling manipulation using a multifingered robot hand, where each finger is compliant and equipped with a tactile fingertip providing contact location and wr
Technical Approach: We derive the equations of motion for compliant quasistatic in-hand rolling manipulation and formulate a fingertip rolling manipulation controller for multiple fingers to achieve a desired object twist within a grasp.
技術方法: 本文提出的方法:We derive the equations of motion for compliant quasistatic in-hand rolling manipulation and formulate a fingertip rolling manipulation controller for multiple fingers to achieve a desired object twis
Key Takeaway: The contact mechanics are demonstrated in simulation and the controller is tested on an experimental robot system.
核心發現: 核心結果:The contact mechanics are demonstrated in simulation and the controller is tested on an experimental robot system.
RoboLight: A Dataset with Linearly Composable Illumination for Robotic Manipulation
Authors: Shutong Jin, Jin Yang, Muhammad Zahid et al. | Submitted: 2026-03-04 | arXiv: 2603.04249
Categories: cs.RO
Research Background: In this paper, we introduce RoboLight, the first real-world robotic manipulation dataset capturing synchronized episodes under systematically varied lighting conditions. RoboLight consists of two components.
研究背景: 在機器人學習領域,In this paper, we introduce RoboLight, the first real-world robotic manipulation dataset capturing synchronized episodes under systematically varied lighting conditions. RoboLight
Technical Approach: In this paper, we introduce RoboLight, the first real-world robotic manipulation dataset capturing synchronized episodes under systematically varied lighting conditions. Leveraging the linearity of light transport, we introduce (b) RoboLight-Synthetic, comprising 196,000 episodes synthesized through interpolation in the HDR image space of RoboLight-Real.
技術方法: 本文提出的方法:In this paper, we introduce RoboLight, the first real-world robotic manipulation dataset capturing synchronized episodes under systematically varied lighting conditions. Leveraging the linearity of li
Key Takeaway: We additionally demonstrate three representative use cases of the proposed dataset.
核心發現: 核心結果:We additionally demonstrate three representative use cases of the proposed dataset.
Swimming Under Constraints: A Safe Reinforcement Learning Framework for Quadrupedal Bio-Inspired Propulsion
Authors: Xinyu Cui, Fei Han, Hang Xu et al. | Submitted: 2026-03-04 | arXiv: 2603.04073
Categories: cs.RO
Research Background: Bio-inspired aquatic propulsion offers high thrust and maneuverability but is prone to destabilizing forces such as lift fluctuations, which are further amplified by six-degree-of-freedom (6-DoF) fluid coupling. We formulate quadrupedal swimming as a constrained optimization problem that maximizes forward thrust while minimizing destabilizing fluctuations.
研究背景: 在機器人學習領域,Bio-inspired aquatic propulsion offers high thrust and maneuverability but is prone to destabilizing forces such as lift fluctuations, which are further amplified by six-degree-of-
Technical Approach: We formulate quadrupedal swimming as a constrained optimization problem that maximizes forward thrust while minimizing destabilizing fluctuations.
技術方法: 本文提出的方法:We formulate quadrupedal swimming as a constrained optimization problem that maximizes forward thrust while minimizing destabilizing fluctuations.
Key Takeaway: Results demonstrate improved thrust efficiency, reduced destabilizing forces, and faster convergence compared with state-of-the-art baselines, underscoring the importance of constraint-aware safe RL for robust and generalizable bio-inspired locomotion in complex fluid environments.
核心發現: 核心結果:Results demonstrate improved thrust efficiency, reduced destabilizing forces, and faster convergence compared with state-of-the-art baselines, underscoring the importance of constraint-aware safe RL f
Structural Action Transformer for 3D Dexterous Manipulation
Authors: Xiaohan Lei, Min Wang, Bohong Weng et al. | Submitted: 2026-03-04 | arXiv: 2603.03960
Categories: cs.RO, cs.CV
Research Background: Achieving human-level dexterity in robots via imitation learning from heterogeneous datasets is hindered by the challenge of cross-embodiment skill transfer, particularly for high-DoF robotic hands. Existing methods, often relying on 2D observations and temporal-centric action representation, struggle to capture 3D spatial relations and fail to handle embodiment heterogeneity.
研究背景: 在機器人學習領域,Achieving human-level dexterity in robots via imitation learning from heterogeneous datasets is hindered by the challenge of cross-embodiment skill transfer, particularly for high-
Technical Approach: This paper proposes the Structural Action Transformer (SAT), a new 3D dexterous manipulation policy that challenges this paradigm by introducing a structural-centric perspective. To encode structural priors and resolve ambiguity, we introduce an Embodied Joint Codebook that embeds each joint’s functional role and kinematic properties. We validate our approach by pre-training on large-scale heterogeneous datasets and fine-tuning on simulation and real-world dexterous manipulation tasks.
技術方法: 本文提出的方法:This paper proposes the Structural Action Transformer (SAT), a new 3D dexterous manipulation policy that challenges this paradigm by introducing a structural-centric perspective. To encode structural
Key Takeaway: Our method consistently outperforms all baselines, demonstrating superior sample efficiency and effective cross-embodiment skill transfer.
核心發現: 核心結果:Our method consistently outperforms all baselines, demonstrating superior sample efficiency and effective cross-embodiment skill transfer.
Bi-HIL: Bilateral Control-Based Multimodal Hierarchical Imitation Learning via Subtask-Level Progress Rate and Keyframe Memory for Long-Horizon Contact-Rich Robotic Manipulation
Authors: Thanpimon Buamanee, Masato Kobayashi, Yuki Uranishi | Submitted: 2026-03-04 | arXiv: 2603.13315
Categories: cs.RO
Research Background: Long-horizon contact-rich robotic manipulation remains challenging due to partial observability and unstable subtask transitions under contact uncertainty. While hierarchical architectures improve temporal reasoning and bilateral imitation learning enables force-aware control, existing approaches often rely on flat policies that struggle with long-horizon coordination.
研究背景: 在機器人學習領域,Long-horizon contact-rich robotic manipulation remains challenging due to partial observability and unstable subtask transitions under contact uncertainty. While hierarchical archi
Technical Approach: We propose Bi-HIL, a bilateral control-based multimodal hierarchical imitation learning framework for long-horizon manipulation.
技術方法: 本文提出的方法:We propose Bi-HIL, a bilateral control-based multimodal hierarchical imitation learning framework for long-horizon manipulation.
Key Takeaway: The results highlight the importance of explicitly modeling subtask progression together with force-aware control for robust long-horizon manipulation.
核心發現: 核心結果:The results highlight the importance of explicitly modeling subtask progression together with force-aware control for robust long-horizon manipulation.
MRPoS: Mixed Reality-Based Robot Navigation Interface Using Spatial Pointing and Speech with Large Language Model
Authors: Eduardo Iglesius, Masato Kobayashi, Yuki Uranishi | Submitted: 2026-03-04 | arXiv: 2603.13313
Categories: cs.RO
Research Background: Recent advancements have made robot navigation more intuitive by transitioning from traditional 2D displays to spatially aware Mixed Reality (MR) systems. However, current MR interfaces often rely on manual “air tap” gestures for goal placement, which can be repetitive and physically demanding, especially for beginners.
研究背景: 在機器人學習領域,Recent advancements have made robot navigation more intuitive by transitioning from traditional 2D displays to spatially aware Mixed Reality (MR) systems. However, current MR inter
Technical Approach: This paper proposes the Mixed Reality-Based Robot Navigation Interface using Spatial Pointing and Speech (MRPoS). Comprehensive experiments comparing MRPoS against conventional gesture-based systems demonstrate that our approach significantly reduces task completion time and workload, providing a more accessible and efficient interface.
技術方法: 本文提出的方法:This paper proposes the Mixed Reality-Based Robot Navigation Interface using Spatial Pointing and Speech (MRPoS). Comprehensive experiments comparing MRPoS against conventional gesture-based systems d
Key Takeaway: Comprehensive experiments comparing MRPoS against conventional gesture-based systems demonstrate that our approach significantly reduces task completion time and workload, providing a more accessible and efficient interface.
核心發現: 核心結果:Comprehensive experiments comparing MRPoS against conventional gesture-based systems demonstrate that our approach significantly reduces task completion time and workload, providing a more accessible
Pretrained Vision-Language-Action Models are Surprisingly Resistant to Forgetting in Continual Learning
Authors: Huihan Liu, Changyeon Kim, Bo Liu et al. | Submitted: 2026-03-04 | arXiv: 2603.03818
Categories: cs.LG, cs.AI, cs.RO
Research Background: Continual learning is a long-standing challenge in robot policy learning, where a policy must acquire new skills over time without catastrophically forgetting previously learned ones. While prior work has extensively studied continual learning in relatively small behavior cloning (BC) policy models trained from scratch, its behavior in modern large-scale pretrained Vision-Language-Action (VLA) models remains underexplored.
研究背景: 在機器人學習領域,Continual learning is a long-standing challenge in robot policy learning, where a policy must acquire new skills over time without catastrophically forgetting previously learned on
Technical Approach: While prior work has extensively studied continual learning in relatively small behavior cloning (BC) policy models trained from scratch, its behavior in modern large-scale pretrained Vision-Language-Action (VLA) models remains underexplored. In this work, we found that pretrained VLAs are remarkably resistant to forgetting compared with smaller policy models trained from scratch. Simple Experience Replay (ER) works surprisingly well on VLAs, sometimes achieving zero forgetting even with a small replay data size.
技術方法: 本文提出的方法:While prior work has extensively studied continual learning in relatively small behavior cloning (BC) policy models trained from scratch, its behavior in modern large-scale pretrained Vision-Language-
Key Takeaway: While prior work has extensively studied continual learning in relatively small behavior cloning (BC) policy models trained from scratch, its behavior in modern large-scale pretrained Vision-Language-Action (VLA) models remains underexplored.
核心發現: 核心結果:While prior work has extensively studied continual learning in relatively small behavior cloning (BC) policy models trained from scratch, its behavior in modern large-scale pretrained Vision-Language-
Learning Surgical Robotic Manipulation with 3D Spatial Priors
Authors: Yu Sheng, Lidian Wang, Xiaomeng Chu et al. | Submitted: 2026-03-04 | arXiv: 2603.03798
Categories: cs.RO
Research Background: Achieving 3D spatial awareness is crucial for surgical robotic manipulation, where precise and delicate operations are required. Existing methods either explicitly reconstruct the surgical scene prior to manipulation, or enhance multi-view features by adding wrist-mounted cameras to supplement the default stereo endoscopes.
研究背景: 在機器人學習領域,Achieving 3D spatial awareness is crucial for surgical robotic manipulation, where precise and delicate operations are required. Existing methods either explicitly reconstruct the
Technical Approach: In this work, we introduce the Spatial Surgical Transformer (SST), an end-to-end visuomotor policy that empowers surgical robots with 3D spatial awareness by directly exploring 3D spatial cues embedded in endoscopic images. First, we build Surgical3D, a large-scale photorealistic dataset containing 30K stereo endoscopic image pairs with accurate 3D geometry, addressing the scarcity of 3D data in surgical scenes.
技術方法: 本文提出的方法:In this work, we introduce the Spatial Surgical Transformer (SST), an end-to-end visuomotor policy that empowers surgical robots with 3D spatial awareness by directly exploring 3D spatial cues embedde
Key Takeaway: Extensive real-robot experiments demonstrate that SST achieves state-of-the-art performance and strong spatial generalization on complex surgical tasks such as knot tying and ex-vivo organ dissection, representing a significant step toward practical clinical deployment.
核心發現: 核心結果:Extensive real-robot experiments demonstrate that SST achieves state-of-the-art performance and strong spatial generalization on complex surgical tasks such as knot tying and ex-vivo organ dissection,
Interaction-Aware Whole-Body Control for Compliant Object Transport
Authors: Hao Zhang, Yves Tseng, Ding Zhao et al. | Submitted: 2026-03-04 | arXiv: 2603.03751
Categories: cs.RO, cs.AI
Research Background: Cooperative object transport in unstructured environments remains challenging for assistive humanoids because strong, time-varying interaction forces can make tracking-centric whole-body control unreliable, especially in close-contact support tasks. This paper proposes a bio-inspired, interaction-oriented whole-body control (IO-WBC) that functions as an artificial cerebellum - an adaptive motor agent that translates upstream (skill-level) commands into stable, physically consistent whole-body behavior under contact.
研究背景: 在機器人學習領域,Cooperative object transport in unstructured environments remains challenging for assistive humanoids because strong, time-varying interaction forces can make tracking-centric whol
Technical Approach: This paper proposes a bio-inspired, interaction-oriented whole-body control (IO-WBC) that functions as an artificial cerebellum - an adaptive motor agent that translates upstream (skill-level) commands into stable, physically consistent whole-body behavior under contact.
技術方法: 本文提出的方法:This paper proposes a bio-inspired, interaction-oriented whole-body control (IO-WBC) that functions as an artificial cerebellum - an adaptive motor agent that translates upstream (skill-level) command
Key Takeaway: Extensive experiments demonstrate that IO-WBC maintains stable whole-body behavior and physical interaction even when precise velocity tracking becomes infeasible, enabling compliant object transport across a wide range of scenarios.
核心發現: 核心結果:Extensive experiments demonstrate that IO-WBC maintains stable whole-body behavior and physical interaction even when precise velocity tracking becomes infeasible, enabling compliant object transport
HALO: Learning Human-Robot Collaboration via Heterogeneous-Agent Lyapunov Policy Optimization
Authors: Hao Zhang, Yaru Niu, Yikai Wang et al. | Submitted: 2026-03-04 | arXiv: 2603.03741
Categories: cs.RO, cs.AI
Research Background: To improve generalization and resilience in human-robot collaboration (HRC), robots must contend with diverse combinations of human behaviors and contexts, motivating multi-agent reinforcement learning (MARL). However, inherent heterogeneity between robots and humans creates a rationality gap (RG), where decentralized policy updates deviate from cooperative joint optimization.
研究背景: 在機器人學習領域,To improve generalization and resilience in human-robot collaboration (HRC), robots must contend with diverse combinations of human behaviors and contexts, motivating multi-agent r
Technical Approach: We propose heterogeneous-agent Lyapunov policy optimization (HALO), a framework that stabilizes decentralized MARL by enforcing Lyapunov-based contraction in policy-parameter space.
技術方法: 本文提出的方法:We propose heterogeneous-agent Lyapunov policy optimization (HALO), a framework that stabilizes decentralized MARL by enforcing Lyapunov-based contraction in policy-parameter space.
Key Takeaway: Extensive simulations and real-world humanoid-robot experiments show that this certified stability improves generalization and robustness in collaborative corner cases.
核心發現: 核心結果:Extensive simulations and real-world humanoid-robot experiments show that this certified stability improves generalization and robustness in collaborative corner cases.
UrbanHuRo: A Two-Layer Human-Robot Collaboration Framework for the Joint Optimization of Heterogeneous Urban Services
Authors: Tonmoy Dey, Lin Jiang, Zheng Dong et al. | Submitted: 2026-03-04 | arXiv: 2603.03701
Categories: cs.RO, cs.AI, cs.HC, cs.SI
Research Background: In the vision of smart cities, technologies are being developed to enhance the efficiency of urban services and improve residents’ quality of life. However, most existing research focuses on optimizing individual services in isolation, without adequately considering reciprocal interactions among heterogeneous urban services that could yield higher efficiency and improved resource utilization.
研究背景: 在機器人學習領域,In the vision of smart cities, technologies are being developed to enhance the efficiency of urban services and improve residents’ quality of life. However, most existing research
Technical Approach: In this paper, we propose UrbanHuRo, a two-layer human-robot collaboration framework for joint optimization of heterogeneous urban services, demonstrated through crowdsourced delivery and urban sensing.
技術方法: 本文提出的方法:In this paper, we propose UrbanHuRo, a two-layer human-robot collaboration framework for joint optimization of heterogeneous urban services, demonstrated through crowdsourced delivery and urban sensin
Key Takeaway: Experimental evaluations on real-world datasets from a food delivery platform demonstrate that UrbanHuRo improves sensing coverage by 29.7% and courier income by 39.2% on average in most settings, while also significantly reducing the number of overdue orders.
核心發現: 核心結果:Experimental evaluations on real-world datasets from a food delivery platform demonstrate that UrbanHuRo improves sensing coverage by 29.7% and courier income by 39.2% on average in most settings, whi
Efficient Autonomous Navigation of a Quadruped Robot in Underground Mines on Edge Hardware
Authors: Yixiang Gao, Kwame Awuah-Offei | Submitted: 2026-03-04 | arXiv: 2603.04470
Categories: cs.RO
Research Background: Embodied navigation in underground mines faces significant challenges, including narrow passages, uneven terrain, near-total darkness, GPS-denied conditions, and limited communication infrastructure. While recent learning-based approaches rely on GPU-accelerated inference and extensive training data, we present a fully autonomous navigation stack for a Boston Dynamics Spot quadruped robot that runs entirely on a low-power Intel NUC edge computer with no GPU and no network connectivity requirements.
研究背景: 在機器人學習領域,Embodied navigation in underground mines faces significant challenges, including narrow passages, uneven terrain, near-total darkness, GPS-denied conditions, and limited communicat
Technical Approach: While recent learning-based approaches rely on GPU-accelerated inference and extensive training data, we present a fully autonomous navigation stack for a Boston Dynamics Spot quadruped robot that runs entirely on a low-power Intel NUC edge computer with no GPU and no network connectivity requirements.
技術方法: 本文提出的方法:While recent learning-based approaches rely on GPU-accelerated inference and extensive training data, we present a fully autonomous navigation stack for a Boston Dynamics Spot quadruped robot that run
Key Takeaway: We validate the system through repeated field trials using four target locations of varying traversal difficulty in an experimental underground mine, accumulating over 700 m of fully autonomous traverse with a 100% success rate across all 20 trials (5 repetitions x 4 targets) and an overall Success weighted by Path Length (SPL) of 0.73 \pm 0.09.
核心發現: 核心結果:We validate the system through repeated field trials using four target locations of varying traversal difficulty in an experimental underground mine, accumulating over 700 m of fully autonomous traver
MistyPilot: An Agentic Fast-Slow Thinking LLM Framework for Misty Social Robots
Authors: Xiao Wang, Lu Dong, Jingchen Sun et al. | Submitted: 2026-03-04 | arXiv: 2603.03640
Categories: cs.RO
Research Background: With the availability of open APIs in social robots, it has become easier to customize general-purpose tools to meet users’ needs. However, interpreting high-level user instructions, selecting and configuring appropriate tools, and executing them reliably remain challenging for users without programming experience.
研究背景: 在機器人學習領域,With the availability of open APIs in social robots, it has become easier to customize general-purpose tools to meet users’ needs. However, interpreting high-level user instruction
Technical Approach: To address these challenges, we introduce MistyPilot, an agentic LLM-driven framework for autonomous tool selection, orchestration, and parameter configuration. Extensive experiments demonstrate the effectiveness of our framework in routing correctness, task completeness, fast-slow thinking retrieval efficiency, tool scalability,and emotion alignment.
技術方法: 本文提出的方法:To address these challenges, we introduce MistyPilot, an agentic LLM-driven framework for autonomous tool selection, orchestration, and parameter configuration. Extensive experiments demonstrate the e
Key Takeaway: Extensive experiments demonstrate the effectiveness of our framework in routing correctness, task completeness, fast-slow thinking retrieval efficiency, tool scalability,and emotion alignment.
核心發現: 核心結果:Extensive experiments demonstrate the effectiveness of our framework in routing correctness, task completeness, fast-slow thinking retrieval efficiency, tool scalability,and emotion alignment.
MEM: Multi-Scale Embodied Memory for Vision Language Action Models
Authors: Marcel Torne, Karl Pertsch, Homer Walke et al. | Submitted: 2026-03-04 | arXiv: 2603.03596
Categories: cs.RO, cs.LG
Research Background: Conventionally, memory in end-to-end robotic learning involves inputting a sequence of past observations into the learned policy. However, in complex multi-stage real-world tasks, the robot’s memory must represent past events at multiple levels of granularity: from long-term memory that captures abstracted semantic concepts (e.g., a robot cooking dinner should remember which stages of the recipe are already done) to short-term memory that captures recent events and compensates for occlusions (e.g., a robot remembering the object it wants to pick up once its arm occludes it).
研究背景: 在機器人學習領域,Conventionally, memory in end-to-end robotic learning involves inputting a sequence of past observations into the learned policy. However, in complex multi-stage real-world tasks,
Technical Approach: We introduce Multi-Scale Embodied Memory (MEM), an approach for mixed-modal long-horizon memory in robot policies.
技術方法: 本文提出的方法:We introduce Multi-Scale Embodied Memory (MEM), an approach for mixed-modal long-horizon memory in robot policies.
Key Takeaway: Additionally, we find that memory enables MEM policies to intelligently adapt manipulation strategies in-context.
核心發現: 核心結果:Additionally, we find that memory enables MEM policies to intelligently adapt manipulation strategies in-context.
Safe-Night VLA: Seeing the Unseen via Thermal-Perceptive Vision-Language-Action Models for Safety-Critical Manipulation
Authors: Dian Yu, Qingchuan Zhou, Bingkun Huang et al. | Submitted: 2026-03-05 | arXiv: 2603.05754
Categories: cs.RO
Research Background: Current Vision-Language-Action (VLA) models rely primarily on RGB perception, preventing them from capturing modalities such as thermal signals that are imperceptible to conventional visual sensors. Moreover, end-to-end generative policies lack explicit safety constraints, making them fragile when encountering obstacles and novel scenarios outside the training distribution.
研究背景: 在機器人學習領域,Current Vision-Language-Action (VLA) models rely primarily on RGB perception, preventing them from capturing modalities such as thermal signals that are imperceptible to convention
Technical Approach: To address these limitations, we propose Safe-Night VLA, a multimodal manipulation framework that enables robots to see the unseen while enforcing rigorous safety constraints for thermal-aware manipulation in unstructured environments. We validate our framework through real-world experiments on a Franka manipulator, introducing a novel evaluation paradigm featuring temperature-conditioned manipulation, subsurface target localization, and reflection disambiguation, while maintaining constrained execution at inference time.
技術方法: 本文提出的方法:To address these limitations, we propose Safe-Night VLA, a multimodal manipulation framework that enables robots to see the unseen while enforcing rigorous safety constraints for thermal-aware manipul
Key Takeaway: Results demonstrate that Safe-Night VLA outperforms RGB-only baselines and provide empirical evidence that foundation models can effectively leverage non-visible physical modalities for robust manipulation.
核心發現: 核心結果:Results demonstrate that Safe-Night VLA outperforms RGB-only baselines and provide empirical evidence that foundation models can effectively leverage non-visible physical modalities for robust manipul
Observing and Controlling Features in Vision-Language-Action Models
Authors: Hugo Buurmeijer, Carmen Amo Alonso, Aiden Swann et al. | Submitted: 2026-03-05 | arXiv: 2603.05487
Categories: cs.RO
Research Background: Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal inputs/outputs and often hybrid nature of transformer and diffusion heads.
研究背景: 在機器人學習領域,Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs)
Technical Approach: In this work, we propose to close this gap by introducing and analyzing two main concepts: feature-observability and feature-controllability.
技術方法: 本文提出的方法:In this work, we propose to close this gap by introducing and analyzing two main concepts: feature-observability and feature-controllability.
Key Takeaway: We demonstrate on different VLA architectures ( and OpenVLA) through simulation experiments that VLAs possess interpretable internal structure amenable to online adaptation without fine-tuning, enabling real-time alignment with user preferences and task requirements.
核心發現: 核心結果:We demonstrate on different VLA architectures ( and OpenVLA) through simulation experiments that VLAs possess interpretable internal structure amenable to online adaptation without fine-tunin
Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation
Authors: Pengfei Yi, Yingjie Ma, Wenjiang Xu et al. | Submitted: 2026-03-05 | arXiv: 2603.05185
Categories: cs.RO
Research Background: Balancing high-level semantic reasoning with low-level reactive control remains a core challenge in visual robotic manipulation. While Vision-Language Models (VLMs) excel at cognitive planning, their inference latency precludes real-time execution.
研究背景: 在機器人學習領域,Balancing high-level semantic reasoning with low-level reactive control remains a core challenge in visual robotic manipulation. While Vision-Language Models (VLMs) excel at cognit
Technical Approach: To bridge this gap, we introduce Critic in the Loop, an adaptive hierarchical framework driven by dynamic VLM-Expert scheduling. Comprehensive experiments on challenging, long-horizon manipulation benchmarks reveal that our approach achieves state-of-the-art performance.
技術方法: 本文提出的方法:To bridge this gap, we introduce Critic in the Loop, an adaptive hierarchical framework driven by dynamic VLM-Expert scheduling. Comprehensive experiments on challenging, long-horizon manipulation ben
Key Takeaway: Comprehensive experiments on challenging, long-horizon manipulation benchmarks reveal that our approach achieves state-of-the-art performance.
核心發現: 核心結果:Comprehensive experiments on challenging, long-horizon manipulation benchmarks reveal that our approach achieves state-of-the-art performance.
Lifelong Language-Conditioned Robotic Manipulation Learning
Authors: Xudong Wang, Zebin Han, Zhiyu Liu et al. | Submitted: 2026-03-05 | arXiv: 2603.05160
Categories: cs.RO, cs.AI
Research Background: Traditional language-conditioned manipulation agent sequential adaptation to new manipulation skills leads to catastrophic forgetting of old skills, limiting dynamic scene practical deployment. In this paper, we propose SkillsCrafter, a novel robotic manipulation framework designed to continually learn multiple skills while reducing catastrophic forgetting of old skills.
研究背景: 在機器人學習領域,Traditional language-conditioned manipulation agent sequential adaptation to new manipulation skills leads to catastrophic forgetting of old skills, limiting dynamic scene practica
Technical Approach: In this paper, we propose SkillsCrafter, a novel robotic manipulation framework designed to continually learn multiple skills while reducing catastrophic forgetting of old skills. Specifically, we propose a Manipulation Skills Adaptation to retain the old skills knowledge while inheriting the shared knowledge between new and old skills to facilitate learning of new skills. To achieve forget-less and generalization manipulation, we propose a Skills Specialization Aggregation to compute inter-skills similarity in skill semantic subspaces, achieving aggregation of the previously learned skill knowledge for any new or unknown skill.
技術方法: 本文提出的方法:In this paper, we propose SkillsCrafter, a novel robotic manipulation framework designed to continually learn multiple skills while reducing catastrophic forgetting of old skills. Specifically, we pro
Key Takeaway: Extensive experiments demonstrate the effectiveness and superiority of our proposed SkillsCrafter.
核心發現: 核心結果:Extensive experiments demonstrate the effectiveness and superiority of our proposed SkillsCrafter.
Act, Think or Abstain: Complexity-Aware Adaptive Inference for Vision-Language-Action Models
Authors: Riccardo Andrea Izzo, Gianluca Bardaro, Matteo Matteucci | Submitted: 2026-03-05 | arXiv: 2603.05147
Categories: cs.CV, cs.RO
Research Background: Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through established reasoning techniques. While effective, these improvements invariably increase computational complexity and inference latency.
研究背景: 在機器人學習領域,Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through established reasoning techniques. While effective, these improveme
Technical Approach: Inspired by human cognition, we propose an adaptive framework that dynamically routes VLA execution based on the complexity of the perceived state. Our approach transforms the VLA’s vision-language backbone into an active detection tool by projecting latent embeddings into an ensemble of parametric and non-parametric estimators.
技術方法: 本文提出的方法:Inspired by human cognition, we propose an adaptive framework that dynamically routes VLA execution based on the complexity of the perceived state. Our approach transforms the VLA’s vision-language ba
Key Takeaway: Evaluated on the LIBERO and LIBERO-PRO benchmarks as well as on a real robot, our vision-only configuration achieves 80% F1-Score using as little as 5% of training data, establishing itself as a reliable and efficient task complexity detector.
核心發現: 核心結果:Evaluated on the LIBERO and LIBERO-PRO benchmarks as well as on a real robot, our vision-only configuration achieves 80% F1-Score using as little as 5% of training data, establishing itself as a relia
SeedPolicy: Horizon Scaling via Self-Evolving Diffusion Policy for Robot Manipulation
Authors: Youqiang Gui, Yuxuan Zhou, Shen Cheng et al. | Submitted: 2026-03-05 | arXiv: 2603.05117
Categories: cs.RO
Research Background: Imitation Learning (IL) enables robots to acquire manipulation skills from expert demonstrations. Diffusion Policy (DP) models multi-modal expert behaviors but degrades when naively increasing stacked observation horizons, limiting long-horizon manipulation.
研究背景: 在機器人學習領域,Imitation Learning (IL) enables robots to acquire manipulation skills from expert demonstrations. Diffusion Policy (DP) models multi-modal expert behaviors but degrades when naivel
Technical Approach: We propose Self-Evolving Gated Attention (SEGA), a temporal module that maintains a time-evolving latent state via gated attention, enabling efficient recurrent updates that accumulate long-term context into a compact latent representation while filtering irrelevant temporal information.
技術方法: 本文提出的方法:We propose Self-Evolving Gated Attention (SEGA), a temporal module that maintains a time-evolving latent state via gated attention, enabling efficient recurrent updates that accumulate long-term conte
Key Takeaway: These results establish SeedPolicy as a state-of-the-art imitation learning method for long-horizon robotic manipulation.
核心發現: 核心結果:These results establish SeedPolicy as a state-of-the-art imitation learning method for long-horizon robotic manipulation.
SPIRIT: Perceptive Shared Autonomy for Robust Robotic Manipulation under Deep Learning Uncertainty
Authors: Jongseok Lee, Ribin Balachandran, Harsimran Singh et al. | Submitted: 2026-03-05 | arXiv: 2603.05111
Categories: cs.RO, cs.AI
Research Background: Deep learning (DL) has enabled impressive advances in robotic perception, yet its limited robustness and lack of interpretability hinder reliable deployment in safety critical applications. We propose a concept termed perceptive shared autonomy, in which uncertainty estimates from DL based perception are used to regulate the level of autonomy.
研究背景: 在機器人學習領域,Deep learning (DL) has enabled impressive advances in robotic perception, yet its limited robustness and lack of interpretability hinder reliable deployment in safety critical appl
Technical Approach: We propose a concept termed perceptive shared autonomy, in which uncertainty estimates from DL based perception are used to regulate the level of autonomy.
技術方法: 本文提出的方法:We propose a concept termed perceptive shared autonomy, in which uncertainty estimates from DL based perception are used to regulate the level of autonomy.
Key Takeaway: The resulting system, named SPIRIT, improves both manipulation performance and system reliability.
核心發現: 核心結果:The resulting system, named SPIRIT, improves both manipulation performance and system reliability.
Observer Design for Augmented Reality-based Teleoperation of Soft Robots
Authors: Jorge Francisco García-Samartín, Iago López Pérez, Emirhan Yolcu et al. | Submitted: 2026-03-05 | arXiv: 2603.05015
Categories: cs.RO
Research Background: Although virtual and augmented reality are gaining traction as teleoperation tools for various types of robots, including manipulators and mobile robots, they are not being used for soft robots. The inherent difficulties of modelling soft robots mean that combining accurate and computationally efficient representations is very challenging.
研究背景: 在機器人學習領域,Although virtual and augmented reality are gaining traction as teleoperation tools for various types of robots, including manipulators and mobile robots, they are not being used fo
Technical Approach: This paper presents an augmented reality interface for teleoperating these devices.
技術方法: 本文提出的方法:This paper presents an augmented reality interface for teleoperating these devices.
Key Takeaway: Errors obtained are on the order of 5% of the robot’s length, demonstrating that augmented reality facilitates operator interaction with soft manipulators and can be integrated into the control loop.
核心發現: 核心結果:Errors obtained are on the order of 5% of the robot’s length, demonstrating that augmented reality facilitates operator interaction with soft manipulators and can be integrated into the control loop.
Beyond the Patch: Exploring Vulnerabilities of Visuomotor Policies via Viewpoint-Consistent 3D Adversarial Object
Authors: Chanmi Lee, Minsung Yoon, Woojae Kim et al. | Submitted: 2026-03-05 | arXiv: 2603.04913
Categories: cs.RO, cs.CV
Research Background: Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is relatively consistent; however, their efficacy often diminishes under dynamic viewpoints from moving cameras, such as wrist-mounted setups, due to perspective distortions.
研究背景: 在機器人學習領域,Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches
Technical Approach: For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is relatively consistent; however, their efficacy often diminishes under dynamic viewpoints from moving cameras, such as wrist-mounted setups, due to perspective distortions. To proactively investigate potential vulnerabilities beyond 2D patches, this work proposes a viewpoint-consistent adversarial texture optimization method for 3D objects through differentiable rendering. As optimization strategies, we employ Expectation over Transformation (EOT) with a Coarse-to-Fine (C2F) curriculum, exploiting distance-dependent frequency characteristics to induce textures effective across varying camera-object distances.
技術方法: 本文提出的方法:For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is relatively consistent; however, their efficacy often diminishes under dynamic viewpoints f
Key Takeaway: Our comprehensive experiments show that the proposed method is effective under various environmental conditions, while confirming its black-box transferability and real-world applicability.
核心發現: 核心結果:Our comprehensive experiments show that the proposed method is effective under various environmental conditions, while confirming its black-box transferability and real-world applicability.
VPWEM: Non-Markovian Visuomotor Policy with Working and Episodic Memory
Authors: Yuheng Lei, Zhixuan Liang, Hongyuan Zhang et al. | Submitted: 2026-03-05 | arXiv: 2603.04910
Categories: cs.RO, cs.AI, cs.LG
Research Background: Imitation learning from human demonstrations has achieved significant success in robotic control, yet most visuomotor policies still condition on single-step observations or short-context histories, making them struggle with non-Markovian tasks that require long-term memory. Simply enlarging the context window incurs substantial computational and memory costs and encourages overfitting to spurious correlations, leading to catastrophic failures under distribution shift and violating real-time constraints in robotic systems.
研究背景: 在機器人學習領域,Imitation learning from human demonstrations has achieved significant success in robotic control, yet most visuomotor policies still condition on single-step observations or short-
Technical Approach: In this paper, we propose VPWEM, a non-Markovian visuomotor policy equipped with working and episodic memories.
技術方法: 本文提出的方法:In this paper, we propose VPWEM, a non-Markovian visuomotor policy equipped with working and episodic memories.
Key Takeaway: Experiments demonstrate that VPWEM outperforms state-of-the-art baselines including diffusion policies and vision-language-action (VLA) models by more than 20% on the memory-intensive manipulation tasks in MIKASA and achieves an average 5% improvement on the mobile manipulation benchmark MoMaRT.
核心發現: 核心結果:Experiments demonstrate that VPWEM outperforms state-of-the-art baselines including diffusion policies and vision-language-action (VLA) models by more than 20% on the memory-intensive manipulation tas
Hyperbolic Multiview Pretraining for Robotic Manipulation
Authors: Jin Yang, Ping Wei, Yixin Chen et al. | Submitted: 2026-03-05 | arXiv: 2603.04848
Categories: cs.RO
Research Background: 3D-aware visual pretraining has proven effective in improving the performance of downstream robotic manipulation tasks. However, existing methods are constrained to Euclidean embedding spaces, whose flat geometry limits their ability to model structural relations among embeddings.
研究背景: 在機器人學習領域,3D-aware visual pretraining has proven effective in improving the performance of downstream robotic manipulation tasks. However, existing methods are constrained to Euclidean embed
Technical Approach: To this end, we propose HyperMVP, a self-supervised framework for \underline{Hyper}bolic \underline{M}ulti\underline{V}iew \underline{P}retraining. In addition, we introduce 3D-MOV, a large-scale dataset comprising multiple types of 3D point clouds to support pretraining.
技術方法: 本文提出的方法:To this end, we propose HyperMVP, a self-supervised framework for \underline{Hyper}bolic \underline{M}ulti\underline{V}iew \underline{P}retraining. In addition, we introduce 3D-MOV, a large-scale data
Key Takeaway: Our results highlight the potential of 3D-aware pretraining in a non-Euclidean space for learning robust and generalizable robotic manipulation policies.
核心發現: 核心結果:Our results highlight the potential of 3D-aware pretraining in a non-Euclidean space for learning robust and generalizable robotic manipulation policies.
Task-Relevant and Irrelevant Region-Aware Augmentation for Generalizable Vision-Based Imitation Learning in Agricultural Manipulation
Authors: Shun Hattori, Hikaru Sasaki, Takumi Hachimine et al. | Submitted: 2026-03-05 | arXiv: 2603.04845
Categories: cs.RO
Research Background: Vision-based imitation learning has shown promise for robotic manipulation; however, its generalization remains limited in practical agricultural tasks. This limitation stems from scarce demonstration data and substantial visual domain gaps caused by i) crop-specific appearance diversity and ii) background variations.
研究背景: 在機器人學習領域,Vision-based imitation learning has shown promise for robotic manipulation; however, its generalization remains limited in practical agricultural tasks. This limitation stems from
Technical Approach: To address this limitation, we propose Dual-Region Augmentation for Imitation Learning (DRAIL), a region-aware augmentation framework designed for generalizable vision-based imitation learning in agricultural manipulation.
技術方法: 本文提出的方法:To address this limitation, we propose Dual-Region Augmentation for Imitation Learning (DRAIL), a region-aware augmentation framework designed for generalizable vision-based imitation learning in agri
Key Takeaway: The results show consistent improvements in success rates under unseen visual conditions compared to baseline methods.
核心發現: 核心結果:The results show consistent improvements in success rates under unseen visual conditions compared to baseline methods.
TEGA: A Tactile-Enhanced Grasping Assistant for Assistive Robotics via Sensor Fusion and Closed-Loop Haptic Feedback
Authors: Hengxu You, Tianyu Zhou, Fang Xu et al. | Submitted: 2026-03-05 | arXiv: 2603.05552
Categories: cs.RO
Research Background: Recent advances in teleoperation have enabled sophisticated manipulation of dexterous robotic hands, with most systems concentrating on guiding finger positions to achieve desired grasp configurations. However, while accurate finger positioning is essential, it often overlooks the equally critical task of grasp force modulation, vital for handling objects of diverse hardness, texture, and shape.
研究背景: 在機器人學習領域,Recent advances in teleoperation have enabled sophisticated manipulation of dexterous robotic hands, with most systems concentrating on guiding finger positions to achieve desired
Technical Approach: To address this gap, We present the tactile enhanced grasping assistant (TEGA), a closed loop assistive teleoperation framework that fuses EMG based intent2force inference with visuotactile sensing mapped into real time vibrotactile feedback via a wearable haptic vest, enabling intuitive, proportional force adjustment during manipulation.
技術方法: 本文提出的方法:To address this gap, We present the tactile enhanced grasping assistant (TEGA), a closed loop assistive teleoperation framework that fuses EMG based intent2force inference with visuotactile sensing ma
Key Takeaway: User studies confirm that the system substantially improves grasp stability and task success, underscoring its potential for assistive robotic applications.
核心發現: 核心結果:User studies confirm that the system substantially improves grasp stability and task success, underscoring its potential for assistive robotic applications.
Diffusion Policy through Conditional Proximal Policy Optimization
Authors: Ben Liu, Shunpeng Yang, Hua Chen | Submitted: 2026-03-05 | arXiv: 2603.04790
Categories: cs.LG, cs.RO
Research Background: Reinforcement learning (RL) has been extensively employed in a wide range of decision-making problems, such as games and robotics. Recently, diffusion policies have shown strong potential in modeling multi-modal behaviors, enabling more diverse and flexible action generation compared to the conventional Gaussian policy.
研究背景: 在機器人學習領域,Reinforcement learning (RL) has been extensively employed in a wide range of decision-making problems, such as games and robotics. Recently, diffusion policies have shown strong po
Technical Approach: To overcome this challenge, we propose a novel and efficient method to train a diffusion policy in an on-policy setting that requires only evaluating a simple Gaussian probability.
技術方法: 本文提出的方法:To overcome this challenge, we propose a novel and efficient method to train a diffusion policy in an on-policy setting that requires only evaluating a simple Gaussian probability.
Key Takeaway: Experiments demonstrate that the proposed method produces multimodal policy behaviors and achieves superior performance on a variety of benchmark tasks in both IsaacLab and MuJoCo Playground.
核心發現: 核心結果:Experiments demonstrate that the proposed method produces multimodal policy behaviors and achieves superior performance on a variety of benchmark tasks in both IsaacLab and MuJoCo Playground.
Latent Wasserstein Adversarial Imitation Learning
Authors: Siqi Yang, Kai Yan, Alexander G. Schwing et al. | Submitted: 2026-03-05 | arXiv: 2603.05440
Categories: cs.LG
Research Background: Imitation Learning (IL) enables agents to mimic expert behavior by learning from demonstrations. However, traditional IL methods require large amounts of medium-to-high-quality demonstrations as well as actions of expert demonstrations, both of which are often unavailable.
研究背景: 在機器人學習領域,Imitation Learning (IL) enables agents to mimic expert behavior by learning from demonstrations. However, traditional IL methods require large amounts of medium-to-high-quality dem
Technical Approach: To reduce this need, we propose Latent Wasserstein Adversarial Imitation Learning (LWAIL), a novel adversarial imitation learning framework that focuses on state-only distribution matching. Through experiments on multiple MuJoCo environments, we demonstrate that our method outperforms prior Wasserstein-based IL methods and prior adversarial IL methods, achieving better results across various tasks.
技術方法: 本文提出的方法:To reduce this need, we propose Latent Wasserstein Adversarial Imitation Learning (LWAIL), a novel adversarial imitation learning framework that focuses on state-only distribution matching. Through ex
Key Takeaway: Through experiments on multiple MuJoCo environments, we demonstrate that our method outperforms prior Wasserstein-based IL methods and prior adversarial IL methods, achieving better results across various tasks.
核心發現: 核心結果:Through experiments on multiple MuJoCo environments, we demonstrate that our method outperforms prior Wasserstein-based IL methods and prior adversarial IL methods, achieving better results across var
CN-CBF: Composite Neural Control Barrier Function for Safe Robot Navigation in Dynamic Environments
Authors: Bojan Derajić, Sebastian Bernhard, Wolfgang Hönig | Submitted: 2026-03-06 | arXiv: 2603.06921
Categories: cs.RO, cs.LG, eess.SY
Research Background: Safe navigation of autonomous robots remains one of the core challenges in the field, especially in dynamic and uncertain environments. One of the prevalent approaches is safety filtering based on control barrier functions (CBFs), which are easy to deploy but difficult to design.
研究背景: 在機器人學習領域,Safe navigation of autonomous robots remains one of the core challenges in the field, especially in dynamic and uncertain environments. One of the prevalent approaches is safety fi
Technical Approach: Motivated by the shortcomings of existing learning- and model-based methods, we propose a simple yet effective neural CBF design method for safe robot navigation in dynamic environments.
技術方法: 本文提出的方法:Motivated by the shortcomings of existing learning- and model-based methods, we propose a simple yet effective neural CBF design method for safe robot navigation in dynamic environments.
Key Takeaway: Also, the method is demonstrated in hardware experiments for both types of robots.
核心發現: 核心結果:Also, the method is demonstrated in hardware experiments for both types of robots.
SysNav: Multi-Level Systematic Cooperation Enables Real-World, Cross-Embodiment Object Navigation
Authors: Haokun Zhu, Zongtai Li, Zihan Liu et al. | Submitted: 2026-03-06 | arXiv: 2603.06914
Categories: cs.RO
Research Background: Object navigation (ObjectNav) in real-world environments is a complex problem that requires simultaneously addressing multiple challenges, including complex spatial structure, long-horizon planning and semantic understanding. Recent advances in Vision-Language Models (VLMs) offer promising capabilities for semantic understanding, yet effectively integrating them into real-world navigation systems remains a non-trivial challenge.
研究背景: 在機器人學習領域,Object navigation (ObjectNav) in real-world environments is a complex problem that requires simultaneously addressing multiple challenges, including complex spatial structure, long
Technical Approach: In this work, we formulate real-world ObjectNav as a system-level problem and introduce SysNav, a three-level ObjectNav system designed for real-world crossembodiment deployment. At the mid-level, we introduce a hierarchical room-based navigation strategy that reserves VLM guidance for room-level decisions, which effectively utilizes its reasoning ability while ensuring system efficiency. We deploy our system on three embodiments, a custom-built wheeled robot, the Unitree Go2 quadruped and the Unitree G1 humanoid, and conduct 190 real-world experiments.
技術方法: 本文提出的方法:In this work, we formulate real-world ObjectNav as a system-level problem and introduce SysNav, a three-level ObjectNav system designed for real-world crossembodiment deployment. At the mid-level, we
Key Takeaway: Furthermore, extensive experiments on four simulation benchmarks demonstrate state-of-the-art performance.
核心發現: 核心結果:Furthermore, extensive experiments on four simulation benchmarks demonstrate state-of-the-art performance.
Nonlinear Performance Degradation of Vision-Based Teleoperation under Network Latency
Authors: Aws Khalil, Jaerock Kwon | Submitted: 2026-03-06 | arXiv: 2603.06850
Categories: cs.RO
Research Background: Teleoperation is increasingly being adopted as a critical fallback for autonomous vehicles. However, the impact of network latency on vision-based, perception-driven control remains insufficiently studied.
研究背景: 在機器人學習領域,Teleoperation is increasingly being adopted as a critical fallback for autonomous vehicles. However, the impact of network latency on vision-based, perception-driven control remain
Technical Approach: To conduct this study, we developed the Latency-Aware Vision Teleoperation testbed (LAVT), a research-oriented ROS 2 framework that enables precise, distributed one-way latency measurement and reproducible delay injection.
技術方法: 本文提出的方法:To conduct this study, we developed the Latency-Aware Vision Teleoperation testbed (LAVT), a research-oriented ROS 2 framework that enables precise, distributed one-way latency measurement and reprodu
Key Takeaway: We further demonstrate that additional control-channel delay compounds these effects, significantly accelerating system failure even under constant visual latency.
核心發現: 核心結果:We further demonstrate that additional control-channel delay compounds these effects, significantly accelerating system failure even under constant visual latency.
Unified Learning of Temporal Task Structure and Action Timing for Bimanual Robot Manipulation
Authors: Christian Dreher, Patrick Dormanns, Andre Meixner et al. | Submitted: 2026-03-06 | arXiv: 2603.06538
Categories: cs.RO
Research Background: Temporal task structure is fundamental for bimanual manipulation: a robot must not only know that one action precedes or overlaps another, but also when each action should occur and how long it should take. While symbolic temporal relations enable high-level reasoning about task structure and alternative execution sequences, concrete timing parameters are equally essential for coordinating two hands at the execution level.
研究背景: 在機器人學習領域,Temporal task structure is fundamental for bimanual manipulation: a robot must not only know that one action precedes or overlaps another, but also when each action should occur an
Technical Approach: We evaluate our approach on several datasets, demonstrating that our method generates temporally parametrized plans closer to human demonstrations than the most characteristic demonstration baseline.
技術方法: 本文提出的方法:We evaluate our approach on several datasets, demonstrating that our method generates temporally parametrized plans closer to human demonstrations than the most characteristic demonstration baseline.
Key Takeaway: We evaluate our approach on several datasets, demonstrating that our method generates temporally parametrized plans closer to human demonstrations than the most characteristic demonstration baseline.
核心發現: 核心結果:We evaluate our approach on several datasets, demonstrating that our method generates temporally parametrized plans closer to human demonstrations than the most characteristic demonstration baseline.
SuperSuit: An Isomorphic Bimodal Interface for Scalable Mobile Manipulation
Authors: Tongqing Chen, Hang Wu, Jiasen Wang et al. | Submitted: 2026-03-06 | arXiv: 2603.06280
Categories: cs.RO
Research Background: High-quality, long-horizon demonstrations are essential for embodied AI, yet acquiring such data for tightly coupled wheeled mobile manipulators remains a fundamental bottleneck. Unlike fixed-base systems, mobile manipulators require continuous coordination between locomotion and precise manipulation, exposing limitations in existing teleoperation and wearable interfaces.
研究背景: 在機器人學習領域,High-quality, long-horizon demonstrations are essential for embodied AI, yet acquiring such data for tightly coupled wheeled mobile manipulators remains a fundamental bottleneck. U
Technical Approach: We present \textbf{SuperSuit}, a bimodal data acquisition framework that supports both robot-in-the-loop teleoperation and active demonstration under a shared kinematic interface.
技術方法: 本文提出的方法:We present \textbf{SuperSuit}, a bimodal data acquisition framework that supports both robot-in-the-loop teleoperation and active demonstration under a shared kinematic interface.
Key Takeaway: These results indicate that consistent kinematic representations across collection modalities enable scalable data acquisition for long-horizon mobile manipulation.
核心發現: 核心結果:These results indicate that consistent kinematic representations across collection modalities enable scalable data acquisition for long-horizon mobile manipulation.
Dual-Agent Multiple-Model Reinforcement Learning for Event-Triggered Human-Robot Co-Adaptation in Decoupled Task Spaces
Authors: Yaqi Li, Zhengqi Han, Huifang Liu et al. | Submitted: 2026-03-06 | arXiv: 2603.06163
Categories: cs.RO
Research Background: This paper presents a shared-control rehabilitation policy for a custom 6-degree-of-freedom (6-DoF) upper-limb robot that decomposes complex reaching tasks into decoupled spatial axes. The patient governs the primary reaching direction using binary commands, while the robot autonomously manages orthogonal corrective motions.
研究背景: 在機器人學習領域,This paper presents a shared-control rehabilitation policy for a custom 6-degree-of-freedom (6-DoF) upper-limb robot that decomposes complex reaching tasks into decoupled spatial a
Technical Approach: This paper presents a shared-control rehabilitation policy for a custom 6-degree-of-freedom (6-DoF) upper-limb robot that decomposes complex reaching tasks into decoupled spatial axes.
技術方法: 本文提出的方法:This paper presents a shared-control rehabilitation policy for a custom 6-degree-of-freedom (6-DoF) upper-limb robot that decomposes complex reaching tasks into decoupled spatial axes.
Key Takeaway: Trained in simulation and deployed across mixed environments, this event-triggered DAMMRL approach effectively suppresses waypoint chatter, balances spatial precision with temporal efficiency, and significantly improves success rates in object acquisition tasks.
核心發現: 核心結果:Trained in simulation and deployed across mixed environments, this event-triggered DAMMRL approach effectively suppresses waypoint chatter, balances spatial precision with temporal efficiency, and sig
Lifelong Embodied Navigation Learning
Authors: Xudong Wang, Jiahua Dong, Baichen Liu et al. | Submitted: 2026-03-06 | arXiv: 2603.06073
Categories: cs.RO, cs.AI
Research Background: Embodied navigation agents powered by large language models have shown strong performance on individual tasks but struggle to continually acquire new navigation skills, which suffer from catastrophic forgetting. We formalize this challenge as lifelong embodied navigation learning (LENL), where an agent is required to adapt to a sequence of navigation tasks spanning multiple scenes and diverse user instruction styles, while retaining previously learned knowledge.
研究背景: 在機器人學習領域,Embodied navigation agents powered by large language models have shown strong performance on individual tasks but struggle to continually acquire new navigation skills, which suffe
Technical Approach: To tackle this problem, we propose Uni-Walker, a lifelong embodied navigation framework that decouples navigation knowledge into task-shared and task-specific components with Decoder Extension LoRA (DE-LoRA). To learn the shared knowledge, we design a knowledge inheritance strategy and an experts co-activation strategy to facilitate shared knowledge transfer and refinement across multiple navigation tasks. To learn the specific knowledge, we propose an expert subspace orthogonality constraint together and a navigation-specific chain-of-thought reasoning mechanism to capture specific knowledge and enhance instruction-style understanding.
技術方法: 本文提出的方法:To tackle this problem, we propose Uni-Walker, a lifelong embodied navigation framework that decouples navigation knowledge into task-shared and task-specific components with Decoder Extension LoRA (D
Key Takeaway: Extensive experiments demonstrate the superiority of Uni-Walker for building universal navigation agents with lifelong learning.
核心發現: 核心結果:Extensive experiments demonstrate the superiority of Uni-Walker for building universal navigation agents with lifelong learning.
Devil is in Narrow Policy: Unleashing Exploration in Driving VLA Models
Authors: Canyu Chen, Yuguang Yang, Zhewen Tan et al. | Submitted: 2026-03-06 | arXiv: 2603.06049
Categories: cs.CV, cs.RO
Research Background: We identify a fundamental Narrow Policy limitation undermining the performance of autonomous VLA models, where driving Imitation Learning (IL) tends to collapse exploration and limit the potential of subsequent Reinforcement Learning (RL) stages, which often saturate prematurely due to insufficient feedback diversity. Thereby, we propose Curious-VLA, a framework that alleviates the exploit-explore dilemma through a two-stage design.
研究背景: 在機器人學習領域,We identify a fundamental Narrow Policy limitation undermining the performance of autonomous VLA models, where driving Imitation Learning (IL) tends to collapse exploration and lim
Technical Approach: Thereby, we propose Curious-VLA, a framework that alleviates the exploit-explore dilemma through a two-stage design. During IL, we introduce a Feasible Trajectory Expansion (FTE) strategy to generate multiple physically valid trajectories and a step-wise normalized trajectory representation to adapt this diverse data. In the RL stage, we present Adaptive Diversity-Aware Sampling (ADAS) that prioritizes high-diversity samples and introduce Spanning Driving Reward (SDR) with a focal style weighting to amplify reward’s value span for improving sensitivity to driving quality.
技術方法: 本文提出的方法:Thereby, we propose Curious-VLA, a framework that alleviates the exploit-explore dilemma through a two-stage design. During IL, we introduce a Feasible Trajectory Expansion (FTE) strategy to generate
Key Takeaway: On the Navsim benchmark, Curious-VLA achieves SoTA results (PDMS 90.3, EPDMS 85.4) and a Best-of-N PDMS of 94.8, demonstrating its effectiveness in unlocking the exploratory potential of VLA models.
核心發現: 核心結果:On the Navsim benchmark, Curious-VLA achieves SoTA results (PDMS 90.3, EPDMS 85.4) and a Best-of-N PDMS of 94.8, demonstrating its effectiveness in unlocking the exploratory potential of VLA models.
Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
Authors: Ninghao Zhang, Bin Zhu, Shijie Zhou et al. | Submitted: 2026-03-06 | arXiv: 2603.06001
Categories: cs.RO, cs.AI, cs.CV
Research Background: Vision-Language-Action (VLA) models enable robots to perform manipulation tasks directly from natural language instructions and are increasingly viewed as a foundation for generalist robotic policies. However, their reliability under Out-of-Distribution (OOD) instructions remains underexplored.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models enable robots to perform manipulation tasks directly from natural language instructions and are increasingly viewed as a foundation for generali
Technical Approach: In this paper, we reveal a critical failure mode in which VLA policies continue executing visually plausible actions even when the language instruction contradicts the scene. To systematically analyze this issue, we introduce ICBench, a diagnostic benchmark constructed from the LIBERO dataset that probes language-action coupling by injecting controlled OOD instruction contradictions while keeping the visual environment unchanged. To mitigate this issue, we propose Instruction-Guided Attention Recalibration (IGAR), a train-free inference-time mechanism that rebalances attention distributions to restore the influence of language instructions.
技術方法: 本文提出的方法:In this paper, we reveal a critical failure mode in which VLA policies continue executing visually plausible actions even when the language instruction contradicts the scene. To systematically analyze
Key Takeaway: Experiments across 30 LIBERO tasks demonstrate that IGAR substantially reduces erroneous execution under OOD contradictory instructions while preserving baseline task performance.
核心發現: 核心結果:Experiments across 30 LIBERO tasks demonstrate that IGAR substantially reduces erroneous execution under OOD contradictory instructions while preserving baseline task performance.
HarvestFlex: Strawberry Harvesting via Vision-Language-Action Policy Adaptation in the Wild
Authors: Ziyang Zhao, Shuheng Wang, Zhonghua Miao et al. | Submitted: 2026-03-06 | arXiv: 2603.05982
Categories: cs.RO, cs.CV
Research Background: This work presents the first study on transferring vision-language-action (VLA) policies to real greenhouse tabletop strawberry harvesting, a long-horizon, unstructured task challenged by occlusion and specular reflections. We built an end-to-end closed-loop system on the HarvestFlex platform using three-view RGB sensing (two fixed scene views plus a wrist-mounted view) and intentionally avoided depth clouds and explicit geometric calibration.
研究背景: 在機器人學習領域,This work presents the first study on transferring vision-language-action (VLA) policies to real greenhouse tabletop strawberry harvesting, a long-horizon, unstructured task challe
Technical Approach: We built an end-to-end closed-loop system on the HarvestFlex platform using three-view RGB sensing (two fixed scene views plus a wrist-mounted view) and intentionally avoided depth clouds and explicit geometric calibration. We collected 3.71 h of VR teleoperated demonstrations (227 episodes) and fine-tuned pi_0, pi_0.5, and WALL-OSS with full fine-tuning and LoRA. Under a unified 50 trials real-greenhouse protocol and metrics spanning completion, pi_0.5 with full fine-tuning achieved success rate of 74.0% with 32.6 s/pick and damage rate of 4.1%.
技術方法: 本文提出的方法:We built an end-to-end closed-loop system on the HarvestFlex platform using three-view RGB sensing (two fixed scene views plus a wrist-mounted view) and intentionally avoided depth clouds and explicit
Key Takeaway: Results showed non-trivial closed-loop picking with fewer than four hours of real data, while remaining limited by close-range observability loss and contact-dynamics mismatch.
核心發現: 核心結果:Results showed non-trivial closed-loop picking with fewer than four hours of real data, while remaining limited by close-range observability loss and contact-dynamics mismatch.
AnyCamVLA: Zero-Shot Camera Adaptation for Viewpoint Robust Vision-Language-Action Models
Authors: Hyeongjun Heo, Seungyeon Woo, Sang Min Kim et al. | Submitted: 2026-03-06 | arXiv: 2603.05868
Categories: cs.RO
Research Background: Despite remarkable progress in Vision-Language-Action models (VLAs) for robot manipulation, these large pre-trained models require fine-tuning to be deployed in specific environments. These fine-tuned models are highly sensitive to camera viewpoint changes that frequently occur in unstructured environments.
研究背景: 在機器人學習領域,Despite remarkable progress in Vision-Language-Action models (VLAs) for robot manipulation, these large pre-trained models require fine-tuning to be deployed in specific environmen
Technical Approach: In this paper, we propose a zero-shot camera adaptation framework without additional demonstration data, policy fine-tuning, or architectural modification. Through extensive experiments on the LIBERO benchmark, our method consistently outperforms baselines that use data augmentation for policy fine-tuning or additional 3D-aware features for visual input. We further validate that our approach constantly enhances viewpoint robustness in real-world robotic manipulation scenarios, including settings with varying camera extrinsics, intrinsics, and freely moving handheld cameras.
技術方法: 本文提出的方法:In this paper, we propose a zero-shot camera adaptation framework without additional demonstration data, policy fine-tuning, or architectural modification. Through extensive experiments on the LIBERO
Key Takeaway: Through extensive experiments on the LIBERO benchmark, our method consistently outperforms baselines that use data augmentation for policy fine-tuning or additional 3D-aware features for visual input.
核心發現: 核心結果:Through extensive experiments on the LIBERO benchmark, our method consistently outperforms baselines that use data augmentation for policy fine-tuning or additional 3D-aware features for visual input.
DexEMG: Towards Dexterous Teleoperation System via EMG2Pose Generalization
Authors: Qianyou Zhao, Wenqiao Li, Chiyu Wang et al. | Submitted: 2026-03-06 | arXiv: 2603.05861
Categories: cs.RO
Research Background: High-fidelity teleoperation of dexterous robotic hands is essential for bringing robots into unstructured domestic environments. However, existing teleoperation systems often face a trade-off between performance and portability: vision-based capture systems are constrained by costs and line-of-sight requirements, while mechanical exoskeletons are bulky and physically restrictive.
研究背景: 在機器人學習領域,High-fidelity teleoperation of dexterous robotic hands is essential for bringing robots into unstructured domestic environments. However, existing teleoperation systems often face
Technical Approach: In this paper, we present DexEMG, a lightweight and cost-effective teleoperation system leveraging surface electromyography (sEMG) to bridge the gap between human intent and robotic execution. To ensure seamless control, we develop a robust hand retargeting algorithm that maps the predicted poses onto a multi-fingered dexterous hand in real-time. Notably, our system exhibits strong generalization capabilities across novel objects and complex environments without the need for intensive individual-specific recalibration.
技術方法: 本文提出的方法:In this paper, we present DexEMG, a lightweight and cost-effective teleoperation system leveraging surface electromyography (sEMG) to bridge the gap between human intent and robotic execution. To ensu
Key Takeaway: Experimental results demonstrate that DexEMG achieves high precision in diverse teleoperation tasks.
核心發現: 核心結果:Experimental results demonstrate that DexEMG achieves high precision in diverse teleoperation tasks.
CDF-Glove: A Cable-Driven Force Feedback Glove for Dexterous Teleoperation
Authors: Huayue Liang, Ruochong Li, Yaodong Yang et al. | Submitted: 2026-03-06 | arXiv: 2603.05804
Categories: cs.RO
Research Background: High-quality teleoperated demonstrations are a primary bottleneck for imitation learning (IL) in dexterous manipulation. However, haptic feedback provides operators with real-time contact information, enabling real-time finger posture adjustments, and thereby improving demonstration quality.
研究背景: 在機器人學習領域,High-quality teleoperated demonstrations are a primary bottleneck for imitation learning (IL) in dexterous manipulation. However, haptic feedback provides operators with real-time
Technical Approach: We introduce CDF-Glove, a lightweight and low cost cable-driven force-feedback glove. We develop a kinematic model and control stack for the glove, and validate them across multiple robotic hands with diverse kinematics and DoF.
技術方法: 本文提出的方法:We introduce CDF-Glove, a lightweight and low cost cable-driven force-feedback glove. We develop a kinematic model and control stack for the glove, and validate them across multiple robotic hands with
Key Takeaway: Compared to kinesthetic teaching, the policies trained in our teleoperated demonstrations increase the average success rate by 55% and reduce the mean completion time by approximately 15.2 seconds (a 47.2% relative reduction).
核心發現: 核心結果:Compared to kinesthetic teaching, the policies trained in our teleoperated demonstrations increase the average success rate by 55% and reduce the mean completion time by approximately 15.2 seconds (a
Task-Level Decisions to Gait Level Control: A Hierarchical Policy Approach for Quadruped Navigation
Authors: Sijia Li, Haoyu Wang, Shenghai Yuan et al. | Submitted: 2026-03-06 | arXiv: 2603.05783
Categories: cs.RO
Research Background: Real-world quadruped navigation is constrained by a scale mismatch between high-level navigation decisions and low-level gait execution, as well as by instabilities under out-of-distribution environmental changes. Such variations challenge sim-to-real transfer and can trigger falls when policies lack explicit interfaces for adaptation.
研究背景: 在機器人學習領域,Real-world quadruped navigation is constrained by a scale mismatch between high-level navigation decisions and low-level gait execution, as well as by instabilities under out-of-di
Technical Approach: In this paper, we present a hierarchical policy architecture for quadrupedal navigation, termed Task-level Decision to Gait Control (TDGC). We introduce a structured curriculum with performance-driven progression that expands environmental difficulty and disturbance ranges.
技術方法: 本文提出的方法:In this paper, we present a hierarchical policy architecture for quadrupedal navigation, termed Task-level Decision to Gait Control (TDGC). We introduce a structured curriculum with performance-driven
Key Takeaway: Experiments show higher task success rates on mixed terrains and out-of-distribution tests.
核心發現: 核心結果:Experiments show higher task success rates on mixed terrains and out-of-distribution tests.
A Closed-Loop CPR Training Glove with Integrated Tactile Sensing and Haptic Feedback
Authors: Jaeyoung Moon, Mingzhuo Ma, Qifeng Yang et al. | Submitted: 2026-03-06 | arXiv: 2603.05793
Categories: cs.HC
Research Background: Cardiopulmonary resuscitation (CPR) is a critical life-saving procedure, and effective training benefits from self-directed practice beyond instructor-led sessions. In this paper, we propose a closed-loop CPR training glove that integrates a high-resolution tactile sensing array and vibrotactile actuators for self-directed practice.
研究背景: 在機器人學習領域,Cardiopulmonary resuscitation (CPR) is a critical life-saving procedure, and effective training benefits from self-directed practice beyond instructor-led sessions. In this paper,
Technical Approach: In this paper, we propose a closed-loop CPR training glove that integrates a high-resolution tactile sensing array and vibrotactile actuators for self-directed practice.
技術方法: 本文提出的方法:In this paper, we propose a closed-loop CPR training glove that integrates a high-resolution tactile sensing array and vibrotactile actuators for self-directed practice.
Key Takeaway: These results highlight the feasibility of the proposed system and offer design insights for future haptic CPR self-training system.
核心發現: 核心結果:These results highlight the feasibility of the proposed system and offer design insights for future haptic CPR self-training system.
Information-Theoretic Constraints for Continual Vision-Language-Action Alignment
Authors: Libang Zhao, Qixin Zeng, Hongyin Zhang et al. | Submitted: 2026-03-06 | arXiv: 2603.13335
Categories: cs.CV, cs.AI
Research Background: When deployed in open-ended robotic environments, Vision—Language—Action (VLA) models need to continually acquire new skills, yet suffer from severe catastrophic forgetting. We observe that this degradation is related to the deterioration of cross-modal information structure, where dependencies among visual observations, language instructions, and actions progressively diffuse during continual adaptation.
研究背景: 在機器人學習領域,When deployed in open-ended robotic environments, Vision—Language—Action (VLA) models need to continually acquire new skills, yet suffer from severe catastrophic forgetting. We o
Technical Approach: Thus, we propose Info-VLA, an information-preserving continual learning framework that maintains cross-modal information structure through two complementary constraints.
技術方法: 本文提出的方法:Thus, we propose Info-VLA, an information-preserving continual learning framework that maintains cross-modal information structure through two complementary constraints.
Key Takeaway: Furthermore, experiments on the LIBERO show that Info-VLA significantly outperforms existing methods in both task retention and adaptation.
核心發現: 核心結果:Furthermore, experiments on the LIBERO show that Info-VLA significantly outperforms existing methods in both task retention and adaptation.
Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots
Authors: Mingzhe Li, Mengyin Liu, Zekai Wu et al. | Submitted: 2026-03-06 | arXiv: 2603.06181
Categories: cs.CV
Research Background: Humanoid robots have achieved significant progress in motion generation and control, exhibiting movements that appear increasingly natural and human-like. Inspired by the Turing Test, we propose the Motion Turing Test, a framework that evaluates whether human observers can discriminate between humanoid robot and human poses using only kinematic information.
研究背景: 在機器人學習領域,Humanoid robots have achieved significant progress in motion generation and control, exhibiting movements that appear increasingly natural and human-like. Inspired by the Turing Te
Technical Approach: Inspired by the Turing Test, we propose the Motion Turing Test, a framework that evaluates whether human observers can discriminate between humanoid robot and human poses using only kinematic information. To facilitate this evaluation, we present the Human-Humanoid Motion (HHMotion) dataset, which consists of 1,000 motion sequences spanning 15 action categories, performed by 11 humanoid models and 10 human subjects. Building on HHMotion, we formulate a human-likeness evaluation task that aims to automatically predict human-likeness scores from motion data.
技術方法: 本文提出的方法:Inspired by the Turing Test, we propose the Motion Turing Test, a framework that evaluates whether human observers can discriminate between humanoid robot and human poses using only kinematic informat
Key Takeaway: To address this, we propose a simple baseline model and demonstrate that it outperforms several contemporary LLM-based methods.
核心發現: 核心結果:To address this, we propose a simple baseline model and demonstrate that it outperforms several contemporary LLM-based methods.
RoTri-Diff: A Spatial Robot-Object Triadic Interaction-Guided Diffusion Model for Bimanual Manipulation
Authors: Zixuan Chen, Nga Teng Chan, Yiwen Hou et al. | Submitted: 2026-03-07 | arXiv: 2603.07165
Categories: cs.RO
Research Background: Bimanual manipulation is a fundamental robotic skill that requires continuous and precise coordination between two arms. While imitation learning (IL) is the dominant paradigm for acquiring this capability, existing approaches, whether robot-centric or object-centric, often overlook the dynamic geometric relationship among the two arms and the manipulated object.
研究背景: 在機器人學習領域,Bimanual manipulation is a fundamental robotic skill that requires continuous and precise coordination between two arms. While imitation learning (IL) is the dominant paradigm for
Technical Approach: To address this, in this paper we explicitly models the Robot-Object Triadic Interaction (RoTri) representation in bimanual systems, by encoding the relative 6D poses between the two arms and the object to capture their spatial triadic relationship and establish continuous triangular geometric constraints. Extensive experiments show that our approach outperforms state-of-the-art baselines by 10.2% on 11 representative RLBench2 tasks and achieves stable performance on 4 challenging real-world bimanual tasks.
技術方法: 本文提出的方法:To address this, in this paper we explicitly models the Robot-Object Triadic Interaction (RoTri) representation in bimanual systems, by encoding the relative 6D poses between the two arms and the obje
Key Takeaway: Extensive experiments show that our approach outperforms state-of-the-art baselines by 10.2% on 11 representative RLBench2 tasks and achieves stable performance on 4 challenging real-world bimanual tasks.
核心發現: 核心結果:Extensive experiments show that our approach outperforms state-of-the-art baselines by 10.2% on 11 representative RLBench2 tasks and achieves stable performance on 4 challenging real-world bimanual ta
DexKnot: Generalizable Visuomotor Policy Learning for Dexterous Bag-Knotting Manipulation
Authors: Jiayuan Zhang, Ruihai Wu, Haojun Chen et al. | Submitted: 2026-03-07 | arXiv: 2603.07136
Categories: cs.RO
Research Background: Knotting plastic bags is a common task in daily life, yet it is challenging for robots due to the bags’ infinite degrees of freedom and complex physical dynamics. Existing methods often struggle in generalization to unseen bag instances or deformations.
研究背景: 在機器人學習領域,Knotting plastic bags is a common task in daily life, yet it is challenging for robots due to the bags’ infinite degrees of freedom and complex physical dynamics. Existing methods
Technical Approach: To address this, we present DexKnot, a framework that combines keypoint affordance with diffusion policy to learn a generalizable bag-knotting policy. Our approach learns a shape-agnostic representation of bags from keypoint correspondence data collected through real-world manual deformation.
技術方法: 本文提出的方法:To address this, we present DexKnot, a framework that combines keypoint affordance with diffusion policy to learn a generalizable bag-knotting policy. Our approach learns a shape-agnostic representati
Key Takeaway: Experiments show that DexKnot achieves reliable and consistent knotting performance across a variety of previously unseen instances and deformations.
核心發現: 核心結果:Experiments show that DexKnot achieves reliable and consistent knotting performance across a variety of previously unseen instances and deformations.
Towards Scalable Probabilistic Human Motion Prediction with Gaussian Processes for Safe Human-Robot Collaboration
Authors: Jinger Chong, Xiaotong Zhang, Kamal Youcef-Toumi | Submitted: 2026-03-07 | arXiv: 2603.07096
Categories: cs.RO
Research Background: Accurate human motion prediction with well-calibrated uncertainty is critical for safe human-robot collaboration (HRC), where robots must anticipate and react to human movements in real time. We propose a structured multitask variational Gaussian Process (GP) framework for full-body human motion prediction that captures temporal correlations and leverages joint-dimension-level factorization for scalability, while using a continuous 6D rotation representation to preserve kinematic consistency.
研究背景: 在機器人學習領域,Accurate human motion prediction with well-calibrated uncertainty is critical for safe human-robot collaboration (HRC), where robots must anticipate and react to human movements in
Technical Approach: We propose a structured multitask variational Gaussian Process (GP) framework for full-body human motion prediction that captures temporal correlations and leverages joint-dimension-level factorization for scalability, while using a continuous 6D rotation representation to preserve kinematic consistency.
技術方法: 本文提出的方法:We propose a structured multitask variational Gaussian Process (GP) framework for full-body human motion prediction that captures temporal correlations and leverages joint-dimension-level factorizatio
Key Takeaway: These results demonstrate that scalable GP-based models can deliver competitive accuracy together with reliable and interpretable uncertainty estimates for downstream robotics tasks such as motion planning and collision avoidance.
核心發現: 核心結果:These results demonstrate that scalable GP-based models can deliver competitive accuracy together with reliable and interpretable uncertainty estimates for downstream robotics tasks such as motion pla
ACLM: ADMM-Based Distributed Model Predictive Control for Collaborative Loco-Manipulation
Authors: Ziyi Zhou, Pengyuan Shu, Ruize Cao et al. | Submitted: 2026-03-07 | arXiv: 2603.07095
Categories: cs.RO, eess.SY
Research Background: Collaborative transportation of heavy payloads via loco-manipulation is a challenging yet essential capability for legged robots operating in complex, unstructured environments. Centralized planning methods, e.g., holistic trajectory optimization, capture dynamic coupling among robots and payloads but scale poorly with system size, limiting real-time applicability.
研究背景: 在機器人學習領域,Collaborative transportation of heavy payloads via loco-manipulation is a challenging yet essential capability for legged robots operating in complex, unstructured environments. Ce
Technical Approach: Centralized planning methods, e.g., holistic trajectory optimization, capture dynamic coupling among robots and payloads but scale poorly with system size, limiting real-time applicability. In contrast, hierarchical and fully decentralized approaches often neglect force and dynamic interactions, leading to conservative behavior. This study proposes an Alternating Direction Method of Multipliers (ADMM)-based distributed model predictive control framework for collaborative loco-manipulation with a team of quadruped robots with manipulators.
技術方法: 本文提出的方法:Centralized planning methods, e.g., holistic trajectory optimization, capture dynamic coupling among robots and payloads but scale poorly with system size, limiting real-time applicability. In contras
Key Takeaway: Extensive simulations with up to four robots demonstrate scalability, real-time performance, and robustness to model uncertainty.
核心發現: 核心結果:Extensive simulations with up to four robots demonstrate scalability, real-time performance, and robustness to model uncertainty.
Learning Quadruped Walking from Seconds of Demonstration
Authors: Ruipeng Zhang, Hongzhan Yu, Ya-Chien Chang et al. | Submitted: 2026-03-07 | arXiv: 2603.06961
Categories: cs.LG, cs.AI
Research Background: Quadruped locomotion provides a natural setting for understanding when model-free learning can outperform model-based control design, by exploiting data patterns to bypass the difficulty of optimizing over discrete contacts and the combinatorial explosion of mode changes. We give a principled analysis of why imitation learning with quadrupeds can be inherently effective in a small data regime, based on the structure of its limit cycles, Poincaré return maps, and local numerical properties of neural networks.
研究背景: 在機器人學習領域,Quadruped locomotion provides a natural setting for understanding when model-free learning can outperform model-based control design, by exploiting data patterns to bypass the diff
Technical Approach: We give a principled analysis of why imitation learning with quadrupeds can be inherently effective in a small data regime, based on the structure of its limit cycles, Poincaré return maps, and local numerical properties of neural networks. The understanding motivates a new imitation learning method that regulates the alignment between variations in a latent space and those over the output actions.
技術方法: 本文提出的方法:We give a principled analysis of why imitation learning with quadrupeds can be inherently effective in a small data regime, based on the structure of its limit cycles, Poincaré return maps, and local
Key Takeaway: Hardware experiments confirm that a few seconds of demonstration is sufficient to train various locomotion policies from scratch entirely offline with reasonable robustness.
核心發現: 核心結果:Hardware experiments confirm that a few seconds of demonstration is sufficient to train various locomotion policies from scratch entirely offline with reasonable robustness.
RoboPCA: Pose-centered Affordance Learning from Human Demonstrations for Robot Manipulation
Authors: Zhanqi Xiao, Ruiping Wang, Xilin Chen | Submitted: 2026-03-08 | arXiv: 2603.07691
Categories: cs.RO, cs.CV
Research Background: Understanding spatial affordances — comprising the contact regions of object interaction and the corresponding contact poses — is essential for robots to effectively manipulate objects and accomplish diverse tasks. However, existing spatial affordance prediction methods mainly focus on locating the contact regions while delegating the pose to independent pose estimation approaches, which can lead to task failures due to inconsistencies between predicted contact regions and candidate poses.
研究背景: 在機器人學習領域,Understanding spatial affordances — comprising the contact regions of object interaction and the corresponding contact poses — is essential for robots to effectively manipulate o
Technical Approach: In this work, we propose RoboPCA, a pose-centered affordance prediction framework that jointly predicts task-appropriate contact regions and poses conditioned on instructions.
技術方法: 本文提出的方法:In this work, we propose RoboPCA, a pose-centered affordance prediction framework that jointly predicts task-appropriate contact regions and poses conditioned on instructions.
Key Takeaway: By integrating geometry-appearance cues through an RGB-D encoder and incorporating mask-enhanced features to emphasize task-relevant object regions into the diffusion-based framework, RoboPCA outperforms baseline methods on image datasets, simulation, and real robots, and exhibits strong generalization across tasks and categories.
核心發現: 核心結果:By integrating geometry-appearance cues through an RGB-D encoder and incorporating mask-enhanced features to emphasize task-relevant object regions into the diffusion-based framework, RoboPCA outperfo
Low-Cost Teleoperation Extension for Mobile Manipulators
Authors: Danil Belov, Artem Erkhov, Yaroslav Savotin et al. | Submitted: 2026-03-08 | arXiv: 2603.07672
Categories: cs.RO
Research Background: Teleoperation of mobile bimanual manipulators requires simultaneous control of high-dimensional systems, often necessitating expensive specialized equipment. We present an open-source teleoperation framework that enables intuitive whole body control using readily available commodity hardware.
研究背景: 在機器人學習領域,Teleoperation of mobile bimanual manipulators requires simultaneous control of high-dimensional systems, often necessitating expensive specialized equipment. We present an open-sou
Technical Approach: We present an open-source teleoperation framework that enables intuitive whole body control using readily available commodity hardware. Our system combines smartphone-based head tracking for camera control, leader arms for bilateral manipulation, and foot pedals for hands-free base navigation. We validate our approach through user studies that demonstrate improved task performance and reduced cognitive load compared to keyboard-based control.
技術方法: 本文提出的方法:We present an open-source teleoperation framework that enables intuitive whole body control using readily available commodity hardware. Our system combines smartphone-based head tracking for camera co
Key Takeaway: We validate our approach through user studies that demonstrate improved task performance and reduced cognitive load compared to keyboard-based control.
核心發現: 核心結果:We validate our approach through user studies that demonstrate improved task performance and reduced cognitive load compared to keyboard-based control.
DAISS: Phase-Aware Imitation Learning for Dual-Arm Robotic Ultrasound-Guided Interventions
Authors: Feng Li, Pei Liu, Shiting Wang et al. | Submitted: 2026-03-08 | arXiv: 2603.07663
Categories: cs.RO
Research Background: Imitation learning has shown strong potential for automating complex robotic manipulation. In medical robotics, ultrasound-guided needle insertion demands precise bimanual coordination, as clinicians must simultaneously manipulate an ultrasound probe to maintain an optimal acoustic view while steering an interventional needle.
研究背景: 在機器人學習領域,Imitation learning has shown strong potential for automating complex robotic manipulation. In medical robotics, ultrasound-guided needle insertion demands precise bimanual coordina
Technical Approach: In this paper, we present the Dual-Arm Interventional Surgical System (DAISS), a teleoperated platform that collects high-fidelity dual-arm demonstrations and learns a phase-aware imitation policy for ultrasound-guided interventions. To support robust execution under real-time ultrasound feedback, we develop a lightweight, data-efficient imitation policy.
技術方法: 本文提出的方法:In this paper, we present the Dual-Arm Interventional Surgical System (DAISS), a teleoperated platform that collects high-fidelity dual-arm demonstrations and learns a phase-aware imitation policy for
Key Takeaway: Experimental results show that DAISS can learn personalized expert strategies from limited demonstrations.
核心發現: 核心結果:Experimental results show that DAISS can learn personalized expert strategies from limited demonstrations.
TempoFit: Plug-and-Play Layer-Wise Temporal KV Memory for Long-Horizon Vision-Language-Action Manipulation
Authors: Jun Sun, Boyu Yang, Jiahao Zhang et al. | Submitted: 2026-03-08 | arXiv: 2603.07647
Categories: cs.RO
Research Background: Pretrained Vision-Language-Action (VLA) policies have achieved strong single-step manipulation, but their inference remains largely memoryless, which is brittle in non-Markovian long-horizon settings with occlusion, state aliasing, and subtle post-action changes. Prior approaches inject history either by stacking frames, which scales visual tokens and latency while adding near-duplicate pixels, or by learning additional temporal interfaces that require (re-)training and may break the original single-frame inference graph.
研究背景: 在機器人學習領域,Pretrained Vision-Language-Action (VLA) policies have achieved strong single-step manipulation, but their inference remains largely memoryless, which is brittle in non-Markovian lo
Technical Approach: We present TempoFit, a training-free temporal retrofit that upgrades frozen VLAs through state-level memory.
技術方法: 本文提出的方法:We present TempoFit, a training-free temporal retrofit that upgrades frozen VLAs through state-level memory.
Key Takeaway: On LIBERO-LONG, TempoFit improves strong pretrained backbones by up to +4.0% average success rate while maintaining near-real-time latency, and it transfers consistently to CALVIN and real-robot long-horizon tasks.
核心發現: 核心結果:On LIBERO-LONG, TempoFit improves strong pretrained backbones by up to +4.0% average success rate while maintaining near-real-time latency, and it transfers consistently to CALVIN and real-robot long-
Approximate Imitation Learning for Event-based Quadrotor Flight in Cluttered Environments
Authors: Nico Messikommer, Jiaxu Xing, Leonard Bauersfeld et al. | Submitted: 2026-03-08 | arXiv: 2603.07578
Categories: cs.RO
Research Background: Event cameras offer high temporal resolution and low latency, making them ideal sensors for high-speed robotic applications where conventional cameras suffer from motion blur. However, their widespread adoption in robot learning is severely bottlenecked by the computational cost of simulating high-frequency event data during online training.
研究背景: 在機器人學習領域,Event cameras offer high temporal resolution and low latency, making them ideal sensors for high-speed robotic applications where conventional cameras suffer from motion blur. Howe
Technical Approach: In this work, we present Approximate Imitation Learning, a novel framework that fundamentally resolves this bottleneck, reducing policy training time for complex, agile drone flight from 52.44 hours to just 1.86 hours - a 28x computational speedup. Furthermore, our approach eliminates the reliance on standard cameras or intermediate representations during deployment, mapping events directly to control commands. In simulation, our method matches or exceeds the performance of standard imitation learning baselines that require full online event rendering.
技術方法: 本文提出的方法:In this work, we present Approximate Imitation Learning, a novel framework that fundamentally resolves this bottleneck, reducing policy training time for complex, agile drone flight from 52.44 hours t
Key Takeaway: Finally, we successfully validate the framework in the real world, demonstrating that a policy trained via this ultra-efficient paradigm enables a quadrotor to fly through highly cluttered environments at remarkable speeds of up to 9.8 m/s.
核心發現: 核心結果:Finally, we successfully validate the framework in the real world, demonstrating that a policy trained via this ultra-efficient paradigm enables a quadrotor to fly through highly cluttered environment
ICLR: In-Context Imitation Learning with Visual Reasoning
Authors: Toan Nguyen, Weiduo Yuan, Songlin Wei et al. | Submitted: 2026-03-08 | arXiv: 2603.07530
Categories: cs.RO
Research Background: In-context imitation learning enables robots to adapt to new tasks from a small number of demonstrations without additional training. However, existing approaches typically condition only on state-action trajectories and lack explicit representations of task intent.
研究背景: 在機器人學習領域,In-context imitation learning enables robots to adapt to new tasks from a small number of demonstrations without additional training. However, existing approaches typically conditi
Technical Approach: To address this, we present In-Context Imitation Learning with Visual Reasoning (ICLR), a novel framework that augments demonstration prompts with structured visual reasoning traces representing anticipated future robot trajectories in image space.
技術方法: 本文提出的方法:To address this, we present In-Context Imitation Learning with Visual Reasoning (ICLR), a novel framework that augments demonstration prompts with structured visual reasoning traces representing antic
Key Takeaway: These results suggest that incorporating embodied visual reasoning represents a promising direction for enhancing the robustness and generalization of robotic in-context learning systems.
核心發現: 核心結果:These results suggest that incorporating embodied visual reasoning represents a promising direction for enhancing the robustness and generalization of robotic in-context learning systems.
HSC-VLA: Hierarchical Scene-Clearing for Robust Bimanual Manipulation in Dense Clutter
Authors: Zhen Liu, Xinyu Ning, Zhe Hu et al. | Submitted: 2026-03-08 | arXiv: 2603.07484
Categories: cs.RO
Research Background: Modern Vision—Language—Action models often suffer from critical instruction-following failures in high-density manipulation environments, where task-irrelevant visual clutter dilutes attention, corrupts grounding, and substantially degrades performance in complex long-horizon scenarios. To overcome the representation bottleneck of monolithic end-to-end architectures, we propose HSC-VLA, a hierarchical framework that decouples high-level visual-semantic reasoning from low-level, high-frequency sensorimotor execution through an explicit scene-clearing abstraction.
研究背景: 在機器人學習領域,Modern Vision—Language—Action models often suffer from critical instruction-following failures in high-density manipulation environments, where task-irrelevant visual clutter dil
Technical Approach: To overcome the representation bottleneck of monolithic end-to-end architectures, we propose HSC-VLA, a hierarchical framework that decouples high-level visual-semantic reasoning from low-level, high-frequency sensorimotor execution through an explicit scene-clearing abstraction.
技術方法: 本文提出的方法:To overcome the representation bottleneck of monolithic end-to-end architectures, we propose HSC-VLA, a hierarchical framework that decouples high-level visual-semantic reasoning from low-level, high-
Key Takeaway: Extensive experiments in densely cluttered supermarket shelves demonstrate that HSC-VLA achieves 86.7% aggregate success under high-density clutter, surpassing the best monolithic baseline (-Full FT at 34.3%) by 52.4%.
核心發現: 核心結果:Extensive experiments in densely cluttered supermarket shelves demonstrate that HSC-VLA achieves 86.7% aggregate success under high-density clutter, surpassing the best monolithic baseline (-Ful
Adaptive Capacity Allocation for Vision Language Action Fine-tuning
Authors: Donghoon Kim, Minji Bae, Unghui Nam et al. | Submitted: 2026-03-08 | arXiv: 2603.07404
Categories: cs.RO, cs.AI
Research Background: Vision language action models (VLAs) are increasingly used for Physical AI, but deploying a pre-trained VLA model to unseen environments, embodiments, or tasks still requires adaptation. Parameter-efficient fine-tuning (PEFT), especially LoRA, is common for VLA policies, yet the exposed capacity knob, the rank, does not transfer uniformly: robotics transfer exhibits a higher and task-varying intrinsic rank than language fine-tuning.
研究背景: 在機器人學習領域,Vision language action models (VLAs) are increasingly used for Physical AI, but deploying a pre-trained VLA model to unseen environments, embodiments, or tasks still requires adapt
Technical Approach: We present LoRA-SP (Select-Prune), a rank-adaptive fine-tuning method that replaces fixed-rank updates with input- and layer-wise capacity.
技術方法: 本文提出的方法:We present LoRA-SP (Select-Prune), a rank-adaptive fine-tuning method that replaces fixed-rank updates with input- and layer-wise capacity.
Key Takeaway: On four real-robot manipulation tasks collected on an unseen AgileX PiPER arm, across two VLA backbones ( and SmolVLA), LoRA-SP matches or exceeds full fine-tuning with far fewer trainable parameters, and improves multi-task success by up to 31.6% over standard LoRA while remaining robust to rank choice.
核心發現: 核心結果:On four real-robot manipulation tasks collected on an unseen AgileX PiPER arm, across two VLA backbones ( and SmolVLA), LoRA-SP matches or exceeds full fine-tuning with far fewer trainable parame
Underwater Embodied Intelligence for Autonomous Robots: A Constraint-Coupled Perspective on Planning, Control, and Deployment
Authors: Jingzehua Xu, Guanwen Xie, Jiwei Tang et al. | Submitted: 2026-03-08 | arXiv: 2603.07393
Categories: cs.RO, eess.SY
Research Background: Autonomous underwater robots are increasingly deployed for environmental monitoring, infrastructure inspection, subsea resource exploration, and long-horizon exploration. Yet, despite rapid advances in learning-based planning and control, reliable autonomy in real ocean environments remains fundamentally constrained by tightly coupled physical limits.
研究背景: 在機器人學習領域,Autonomous underwater robots are increasingly deployed for environmental monitoring, infrastructure inspection, subsea resource exploration, and long-horizon exploration. Yet, desp
Technical Approach: To unify these observations, we introduce a cross-layer failure taxonomy spanning epistemic, dynamic, and coordination breakdowns, and analyze how errors cascade across autonomy layers under uncertainty.
技術方法: 本文提出的方法:To unify these observations, we introduce a cross-layer failure taxonomy spanning epistemic, dynamic, and coordination breakdowns, and analyze how errors cascade across autonomy layers under uncertain
Key Takeaway: Across representative application domains, we show how environmental monitoring, inspection, exploration, and cooperative missions expose distinct stress profiles of cross-layer coupling.
核心發現: 核心結果:Across representative application domains, we show how environmental monitoring, inspection, exploration, and cooperative missions expose distinct stress profiles of cross-layer coupling.
Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisons
Authors: Anthony Liang, Yigit Korkmaz, Jiahui Zhang et al. | Submitted: 2026-03-02 | arXiv: 2603.02115
Categories: cs.RO, cs.AI, cs.LG
Research Background: General-purpose robot reward models are typically trained to predict absolute task progress from expert demonstrations, providing only local, frame-level supervision. While effective for expert demonstrations, this paradigm scales poorly to large-scale robotics datasets where failed and suboptimal trajectories are abundant and assigning dense progress labels is ambiguous.
研究背景: 在機器人學習領域,General-purpose robot reward models are typically trained to predict absolute task progress from expert demonstrations, providing only local, frame-level supervision. While effecti
Technical Approach: We introduce Robometer, a scalable reward modeling framework that combines intra-trajectory progress supervision with inter-trajectory preference supervision.
技術方法: 本文提出的方法:We introduce Robometer, a scalable reward modeling framework that combines intra-trajectory progress supervision with inter-trajectory preference supervision.
Key Takeaway: Across benchmarks and real-world evaluations, Robometer learns more generalizable reward functions than prior methods and improves robot learning performance across a diverse set of downstream applications.
核心發現: 核心結果:Across benchmarks and real-world evaluations, Robometer learns more generalizable reward functions than prior methods and improves robot learning performance across a diverse set of downstream applica
Learning Vision-Based Omnidirectional Navigation: A Teacher-Student Approach Using Monocular Depth Estimation
Authors: Jan Finke, Wayne Paul Martis, Adrian Schmelter et al. | Submitted: 2026-03-02 | arXiv: 2603.01999
Categories: cs.RO, cs.CV, cs.LG
Research Background: Reliable obstacle avoidance in industrial settings demands 3D scene understanding, but widely used 2D LiDAR sensors perceive only a single horizontal slice of the environment, missing critical obstacles above or below the scan plane. We present a teacher-student framework for vision-based mobile robot navigation that eliminates the need for LiDAR sensors.
研究背景: 在機器人學習領域,Reliable obstacle avoidance in industrial settings demands 3D scene understanding, but widely used 2D LiDAR sensors perceive only a single horizontal slice of the environment, miss
Technical Approach: We present a teacher-student framework for vision-based mobile robot navigation that eliminates the need for LiDAR sensors.
技術方法: 本文提出的方法:We present a teacher-student framework for vision-based mobile robot navigation that eliminates the need for LiDAR sensors.
Key Takeaway: In real-world experiments, the MDE-based student outperforms the 2D LiDAR teacher when navigating around obstacles with complex 3D geometries, such as overhanging structures and low-profile objects, that fall outside the single scan plane of a 2D LiDAR.
核心發現: 核心結果:In real-world experiments, the MDE-based student outperforms the 2D LiDAR teacher when navigating around obstacles with complex 3D geometries, such as overhanging structures and low-profile objects, t
Rethinking Policy Diversity in Ensemble Policy Gradient in Large-Scale Reinforcement Learning
Authors: Naoki Shitanda, Motoki Omura, Tatsuya Harada et al. | Submitted: 2026-03-02 | arXiv: 2603.01741
Categories: cs.LG, cs.AI, cs.RO
Research Background: Scaling reinforcement learning to tens of thousands of parallel environments requires overcoming the limited exploration capacity of a single policy. Ensemble-based policy gradient methods, which employ multiple policies to collect diverse samples, have recently been proposed to promote exploration.
研究背景: 在機器人學習領域,Scaling reinforcement learning to tens of thousands of parallel environments requires overcoming the limited exploration capacity of a single policy. Ensemble-based policy gradient
Technical Approach: Ensemble-based policy gradient methods, which employ multiple policies to collect diverse samples, have recently been proposed to promote exploration. However, merely broadening the exploration space does not always enhance learning capability, since excessive exploration can reduce exploration quality or compromise training stability. In this work, we theoretically analyze the impact of inter-policy diversity on learning efficiency in policy ensembles, and propose Coupled Policy Optimization which regulates diversity through KL constraints between policies.
技術方法: 本文提出的方法:Ensemble-based policy gradient methods, which employ multiple policies to collect diverse samples, have recently been proposed to promote exploration. However, merely broadening the exploration space
Key Takeaway: Our results indicate that diverse exploration under appropriate regulation is key to achieving stable and sample-efficient learning in ensemble policy gradient methods.
核心發現: 核心結果:Our results indicate that diverse exploration under appropriate regulation is key to achieving stable and sample-efficient learning in ensemble policy gradient methods.
A Safety-Aware Shared Autonomy Framework with BarrierIK Using Control Barrier Functions
Authors: Berk Guler, Kay Pompetzki, Yuanzheng Sun et al. | Submitted: 2026-03-02 | arXiv: 2603.01705
Categories: cs.RO
Research Background: Shared autonomy blends operator intent with autonomous assistance. In cluttered environments, linear blending can produce unsafe commands even when each source is individually collision-free.
研究背景: 在機器人學習領域,Shared autonomy blends operator intent with autonomous assistance. In cluttered environments, linear blending can produce unsafe commands even when each source is individually coll
Technical Approach: Our approach is evaluated in simulation on representative cluttered environments and in a VR teleoperation study comparing pure teleoperation with shared autonomy.
技術方法: 本文提出的方法:Our approach is evaluated in simulation on representative cluttered environments and in a VR teleoperation study comparing pure teleoperation with shared autonomy.
Key Takeaway: Our approach is evaluated in simulation on representative cluttered environments and in a VR teleoperation study comparing pure teleoperation with shared autonomy.
核心發現: 核心結果:Our approach is evaluated in simulation on representative cluttered environments and in a VR teleoperation study comparing pure teleoperation with shared autonomy.
TacMamba: A Tactile History Compression Adapter Bridging Fast Reflexes and Slow VLA Reasoning
Authors: Zhenan Wang, Yanzhe Wang, Meixuan Ren et al. | Submitted: 2026-03-02 | arXiv: 2603.01700
Categories: cs.RO
Research Background: In visually ambiguous manipulation such as detecting button click tactile feedback is often the sole source of ground truth. However, fusing tactile data poses a significant challenge due to a spatiotemporal mismatch: tactile perception requires high-frequency processing with long-horizon memory (System 1), whereas visual policies operate at low control frequencies (System 2).
研究背景: 在機器人學習領域,In visually ambiguous manipulation such as detecting button click tactile feedback is often the sole source of ground truth. However, fusing tactile data poses a significant challe
Technical Approach: In this paper, we introduce TacMamba, a hierarchical architecture that aligns high-bandwidth tactile reflexes with low-frequency visual planning. Our approach comprises three core contributions: (1) a custom high-frequency tactile interface designed for flexible integration; (2) a Mamba-based Tactile History Compressor that encodes continuous force history into a compact state with O(1) inference latency (0.45 ms), enabling plug-and-play fusion with VLA models without joint pre-training and (3) a Tactile-Guided Dual-Stage Training strategy that leverages temporal discrimination for self-supervised representation learning and phase-uniform sampling to mitigate data sparsity.
技術方法: 本文提出的方法:In this paper, we introduce TacMamba, a hierarchical architecture that aligns high-bandwidth tactile reflexes with low-frequency visual planning. Our approach comprises three core contributions: (1) a
Key Takeaway: Experiments on discrete counting and implicit state switching demonstrate that TacMamba achieves 100% success rates, significantly outperforming the visual-only pi_0.5 baseline, while strictly satisfying hard real-time constraints.
核心發現: 核心結果:Experiments on discrete counting and implicit state switching demonstrate that TacMamba achieves 100% success rates, significantly outperforming the visual-only pi_0.5 baseline, while strictly satisfy
FATE: Closed-Loop Feasibility-Aware Task Generation with Active Repair for Physically Grounded Robotic Curricula
Authors: Bingchuan Wei, Bingqi Huang, Jingheng Ma et al. | Submitted: 2026-03-02 | arXiv: 2603.01505
Categories: cs.RO
Research Background: Recent breakthroughs in generative simulation have harnessed Large Language Models (LLMs) to generate diverse robotic task curricula, yet these open-loop paradigms frequently produce linguistically coherent but physically infeasible goals, stemming from ungrounded task specifications or misaligned objective formulations. To address this critical limitation, we propose FATE (Feasibility-Aware Task gEneration), a closed-loop, self-correcting framework that reimagines task generation as an iterative validation-and-refinement process.
研究背景: 在機器人學習領域,Recent breakthroughs in generative simulation have harnessed Large Language Models (LLMs) to generate diverse robotic task curricula, yet these open-loop paradigms frequently produ
Technical Approach: To address this critical limitation, we propose FATE (Feasibility-Aware Task gEneration), a closed-loop, self-correcting framework that reimagines task generation as an iterative validation-and-refinement process.
技術方法: 本文提出的方法:To address this critical limitation, we propose FATE (Feasibility-Aware Task gEneration), a closed-loop, self-correcting framework that reimagines task generation as an iterative validation-and-refine
Key Takeaway: Extensive experiments validate that FATE generates semantically diverse, physically grounded task curricula while achieving a substantial reduction in execution failure rates relative to state-of-the-art generative baselines.
核心發現: 核心結果:Extensive experiments validate that FATE generates semantically diverse, physically grounded task curricula while achieving a substantial reduction in execution failure rates relative to state-of-the-
Towards Robot Skill Learning and Adaptation with Gaussian Processes
Authors: A K M Nadimul Haque, Fouad Sukkar, Sheila Sujipto et al. | Submitted: 2026-03-02 | arXiv: 2603.01480
Categories: cs.RO
Research Background: General robot skill adaptation requires expressive representations robust to varying task configurations. While recent learning-based skill adaptation methods refined via Reinforcement Learning (RL), have shown success, existing skill models often lack sufficient representational capacity for anything beyond minor environmental changes.
研究背景: 在機器人學習領域,General robot skill adaptation requires expressive representations robust to varying task configurations. While recent learning-based skill adaptation methods refined via Reinforce
Technical Approach: This paper proposes a novel, robust skill adaptation framework that utilises GPs with sparse via-points for compact and expressive modelling. We present three adaptation methods to cater for the variability between initial and observed configurations.
技術方法: 本文提出的方法:This paper proposes a novel, robust skill adaptation framework that utilises GPs with sparse via-points for compact and expressive modelling. We present three adaptation methods to cater for the varia
Key Takeaway: Overall, our formulation provides a compact representation capable of adapting to large deviations from a single demonstrated skill.
核心發現: 核心結果:Overall, our formulation provides a compact representation capable of adapting to large deviations from a single demonstrated skill.
Multimodal Adversarial Quality Policy for Safe Grasping
Authors: Kunlin Xie, Chenghao Li, Haolan Zhang et al. | Submitted: 2026-03-02 | arXiv: 2603.01479
Categories: cs.RO
Research Background: Vision-guided robot grasping based on Deep Neural Networks (DNNs) generalizes well but poses safety risks in the Human-Robot Interaction (HRI). Recent works solved it by designing benign adversarial attacks and patches with RGB modality, yet depth-independent characteristics limit their effectiveness on RGBD modality.
研究背景: 在機器人學習領域,Vision-guided robot grasping based on Deep Neural Networks (DNNs) generalizes well but poses safety risks in the Human-Robot Interaction (HRI). Recent works solved it by designing
Technical Approach: In this work, we propose the Multimodal Adversarial Quality Policy (MAQP) to realize multimodal safe grasping. Our framework introduces two key components.
技術方法: 本文提出的方法:In this work, we propose the Multimodal Adversarial Quality Policy (MAQP) to realize multimodal safe grasping. Our framework introduces two key components.
Key Takeaway: We conduct extensive experiments on the benchmark datasets and a cobot, showing the effectiveness of MAQP.
核心發現: 核心結果:We conduct extensive experiments on the benchmark datasets and a cobot, showing the effectiveness of MAQP.
Unifying Language-Action Understanding and Generation for Autonomous Driving
Authors: Xinyang Wang, Qian Liu, Wenjie Ding et al. | Submitted: 2026-03-02 | arXiv: 2603.01441
Categories: cs.CV, cs.RO
Research Background: Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer from two critical limitations: a persistent misalignment between language instructions and action outputs, and the inherent inefficiency of typical auto-regressive action generation.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about
Technical Approach: In this paper, we introduce LinkVLA, a novel architecture that directly addresses these challenges to enhance both alignment and efficiency. Second, to create a deep semantic link, we introduce an auxiliary action understanding objective that trains the model to generate descriptive captions from trajectories, fostering a bidirectional language-action mapping.
技術方法: 本文提出的方法:In this paper, we introduce LinkVLA, a novel architecture that directly addresses these challenges to enhance both alignment and efficiency. Second, to create a deep semantic link, we introduce an aux
Key Takeaway: Experiments on closed-loop driving benchmarks show consistent gains in instruction following accuracy and driving performance, alongside reduced inference latency.
核心發現: 核心結果:Experiments on closed-loop driving benchmarks show consistent gains in instruction following accuracy and driving performance, alongside reduced inference latency.
Jailbreaking Embodied LLMs via Action-level Manipulation
Authors: Xinyu Huang, Qiang Yang, Leming Shen et al. | Submitted: 2026-03-02 | arXiv: 2603.01414
Categories: cs.RO
Research Background: Embodied Large Language Models (LLMs) enable AI agents to interact with the physical world through natural language instructions and actions. However, beyond the language-level risks inherent to LLMs themselves, embodied LLMs with real-world actuation introduce a new vulnerability: instructions that appear semantically benign may still lead to dangerous real-world consequences, revealing a fundamental misalignment between linguistic security and physical outcomes.
研究背景: 在機器人學習領域,Embodied Large Language Models (LLMs) enable AI agents to interact with the physical world through natural language instructions and actions. However, beyond the language-level ris
Technical Approach: In this paper, we introduce Blindfold, an automated attack framework that leverages the limited causal reasoning capabilities of embodied LLMs in real-world action contexts.
技術方法: 本文提出的方法:In this paper, we introduce Blindfold, an automated attack framework that leverages the limited causal reasoning capabilities of embodied LLMs in real-world action contexts.
Key Takeaway: Evaluations on both embodied AI simulators and a real-world 6DoF robotic arm show that Blindfold achieves up to 53% higher attack success rates than SOTA baselines, highlighting the urgent need to move beyond surface-level language censorship and toward consequence-aware defense mechanisms to secure embodied LLMs.
核心發現: 核心結果:Evaluations on both embodied AI simulators and a real-world 6DoF robotic arm show that Blindfold achieves up to 53% higher attack success rates than SOTA baselines, highlighting the urgent need to mov
How to Peel with a Knife: Aligning Fine-Grained Manipulation with Human Preference
Authors: Toru Lin, Shuying Deng, Zhao-Heng Yin et al. | Submitted: 2026-03-03 | arXiv: 2603.03280
Categories: cs.RO, cs.AI, cs.CV, cs.LG, eess.SY
Research Background: Many essential manipulation tasks - such as food preparation, surgery, and craftsmanship - remain intractable for autonomous robots. These tasks are characterized not only by contact-rich, force-sensitive dynamics, but also by their “implicit” success criteria: unlike pick-and-place, task quality in these domains is continuous and subjective (e.g. how well a potato is peeled), making quantitative evaluation and reward engineering difficult.
研究背景: 在機器人學習領域,Many essential manipulation tasks - such as food preparation, surgery, and craftsmanship - remain intractable for autonomous robots. These tasks are characterized not only by conta
Technical Approach: We present a learning framework for such tasks, using peeling with a knife as a representative example. Our approach follows a two-stage pipeline: first, we learn a robust initial policy via force-aware data collection and imitation learning, enabling generalization across object variations; second, we refine the policy through preference-based finetuning using a learned reward model that combines quantitative task metrics with qualitative human feedback, aligning policy behavior with human notions of task quality. Using only 50-200 peeling trajectories, our system achieves over 90% average success rates on challenging produce including cucumbers, apples, and potatoes, with performance improving by up to 40% through preference-based finetuning.
技術方法: 本文提出的方法:We present a learning framework for such tasks, using peeling with a knife as a representative example. Our approach follows a two-stage pipeline: first, we learn a robust initial policy via force-awa
Key Takeaway: Remarkably, policies trained on a single produce category exhibit strong zero-shot generalization to unseen in-category instances and to out-of-distribution produce from different categories while maintaining over 90% success rates.
核心發現: 核心結果:Remarkably, policies trained on a single produce category exhibit strong zero-shot generalization to unseen in-category instances and to out-of-distribution produce from different categories while mai
ACE-Brain-0: Spatial Intelligence as a Shared Scaffold for Universal Embodiments
Authors: Ziyang Gong, Zehang Luo, Anke Tang et al. | Submitted: 2026-03-03 | arXiv: 2603.03198
Categories: cs.RO, cs.CL, cs.CV
Research Background: Universal embodied intelligence demands robust generalization across heterogeneous embodiments, such as autonomous driving, robotics, and unmanned aerial vehicles (UAVs). However, existing embodied brain in training a unified model over diverse embodiments frequently triggers long-tail data, gradient interference, and catastrophic forgetting, making it notoriously difficult to balance universal generalization with domain-specific proficiency.
研究背景: 在機器人學習領域,Universal embodied intelligence demands robust generalization across heterogeneous embodiments, such as autonomous driving, robotics, and unmanned aerial vehicles (UAVs). However,
Technical Approach: In this report, we introduce ACE-Brain-0, a generalist foundation brain that unifies spatial reasoning, autonomous driving, and embodied manipulation within a single multimodal large language model~(MLLM). Building on this insight, we propose the Scaffold-Specialize-Reconcile~(SSR) paradigm, which first establishes a shared spatial foundation, then cultivates domain-specialized experts, and finally harmonizes them through data-free model merging.
技術方法: 本文提出的方法:In this report, we introduce ACE-Brain-0, a generalist foundation brain that unifies spatial reasoning, autonomous driving, and embodied manipulation within a single multimodal large language model~(M
Key Takeaway: Extensive experiments demonstrate that ACE-Brain-0 achieves competitive and even state-of-the-art performance across 24 spatial and embodiment-related benchmarks.
核心發現: 核心結果:Extensive experiments demonstrate that ACE-Brain-0 achieves competitive and even state-of-the-art performance across 24 spatial and embodiment-related benchmarks.
Chain of World: World Model Thinking in Latent Motion
Authors: Fuxiang Yang, Donglin Di, Lulu Tang et al. | Submitted: 2026-03-03 | arXiv: 2603.03195
Categories: cs.CV, cs.AI, cs.RO
Research Background: Vision-Language-Action (VLA) models are a promising path toward embodied intelligence, yet they often overlook the predictive and temporal-causal structure underlying visual dynamics. World-model VLAs address this by predicting future frames, but waste capacity reconstructing redundant backgrounds.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models are a promising path toward embodied intelligence, yet they often overlook the predictive and temporal-causal structure underlying visual dynami
Technical Approach: To overcome these limitations, we introduce CoWVLA (Chain-of-World VLA), a new “Chain of World” paradigm that unifies world-model temporal reasoning with a disentangled latent motion representation.
技術方法: 本文提出的方法:To overcome these limitations, we introduce CoWVLA (Chain-of-World VLA), a new “Chain of World” paradigm that unifies world-model temporal reasoning with a disentangled latent motion representation.
Key Takeaway: Extensive experiments on robotic simulation benchmarks show that CoWVLA outperforms existing world-model and latent-action approaches and achieves moderate computational efficiency, highlighting its potential as a more effective VLA pretraining paradigm.
核心發現: 核心結果:Extensive experiments on robotic simulation benchmarks show that CoWVLA outperforms existing world-model and latent-action approaches and achieves moderate computational efficiency, highlighting its p
RL-Based Coverage Path Planning for Deformable Objects on 3D Surfaces
Authors: Yuhang Zhang, Jinming Ma, Feng Wu | Submitted: 2026-03-03 | arXiv: 2603.03137
Categories: cs.RO
Research Background: Currently, manipulation tasks for deformable objects often focus on activities like folding clothes, handling ropes, and manipulating bags. However, research on contact-rich tasks involving deformable objects remains relatively underdeveloped.
研究背景: 在機器人學習領域,Currently, manipulation tasks for deformable objects often focus on activities like folding clothes, handling ropes, and manipulating bags. However, research on contact-rich tasks
Technical Approach: To address this, we propose a method that leverages efficient and accessible simulators for task execution. Experiments demonstrate that our method outperforms previous approaches in key metrics, including total path length and coverage area. We deploy these paths on a Kinova Gen3 manipulator to perform wiping experiments on the back of a torso model, validating the feasibility of our approach.
技術方法: 本文提出的方法:To address this, we propose a method that leverages efficient and accessible simulators for task execution. Experiments demonstrate that our method outperforms previous approaches in key metrics, incl
Key Takeaway: We deploy these paths on a Kinova Gen3 manipulator to perform wiping experiments on the back of a torso model, validating the feasibility of our approach.
核心發現: 核心結果:We deploy these paths on a Kinova Gen3 manipulator to perform wiping experiments on the back of a torso model, validating the feasibility of our approach.
DreamFlow: Local Navigation Beyond Observation via Conditional Flow Matching in the Latent Space
Authors: Jiwon Park, Dongkyu Lee, I Made Aswin Nahrendra et al. | Submitted: 2026-03-03 | arXiv: 2603.02976
Categories: cs.RO
Research Background: Local navigation in cluttered environments often suffers from dense obstacles and frequent local minima. Conventional local planners rely on heuristics and are prone to failure, while deep reinforcement learning(DRL)based approaches provide adaptability but are constrained by limited onboard sensing.
研究背景: 在機器人學習領域,Local navigation in cluttered environments often suffers from dense obstacles and frequent local minima. Conventional local planners rely on heuristics and are prone to failure, wh
Technical Approach: In this paper, we propose DreamFlow, a DRL-based local navigation framework that extends the robot’s perceptual horizon through conditional flow matching(CFM).
技術方法: 本文提出的方法:In this paper, we propose DreamFlow, a DRL-based local navigation framework that extends the robot’s perceptual horizon through conditional flow matching(CFM).
Key Takeaway: Experimental results demonstrate that DreamFlow outperforms existing methods in terms of latent prediction accuracy and navigation performance in simulation.
核心發現: 核心結果:Experimental results demonstrate that DreamFlow outperforms existing methods in terms of latent prediction accuracy and navigation performance in simulation.
Tracing Back Error Sources to Explain and Mitigate Pose Estimation Failures
Authors: Loris Schneider, Yitian Shi, Rosa Wolf et al. | Submitted: 2026-03-03 | arXiv: 2603.02881
Categories: cs.RO
Research Background: Robust estimation of object poses in robotic manipulation is often addressed using foundational general estimators, that aim to handle diverse error sources naively within a single model. Still, they struggle due to environmental uncertainties, while requiring long inference times and heavy computation.
研究背景: 在機器人學習領域,Robust estimation of object poses in robotic manipulation is often addressed using foundational general estimators, that aim to handle diverse error sources naively within a single
Technical Approach: In contrast, we propose a modular, uncertainty-aware framework that attributes pose estimation errors to specific error sources and applies targeted mitigation strategies only when necessary. Instantiated with Iterative Closest Point (ICP) as a simple and lightweight pose estimator, we leverage our framework for real-world robotic grasping tasks.
技術方法: 本文提出的方法:In contrast, we propose a modular, uncertainty-aware framework that attributes pose estimation errors to specific error sources and applies targeted mitigation strategies only when necessary. Instanti
Key Takeaway: By decomposing pose estimation into failure detection, error attribution, and targeted recovery, we significantly improve the robustness of ICP and achieve competitive performance compared to foundation models, while relying on a substantially simpler and faster pose estimator.
核心發現: 核心結果:By decomposing pose estimation into failure detection, error attribution, and targeted recovery, we significantly improve the robustness of ICP and achieve competitive performance compared to foundati
Retrieval-Augmented Robots via Retrieve-Reason-Act
Authors: Izat Temiraliev, Diji Yang, Yi Zhang | Submitted: 2026-03-03 | arXiv: 2603.02688
Categories: cs.AI, cs.RO
Research Background: To achieve general-purpose utility, we argue that robots must evolve from passive executors into active Information Retrieval users. In strictly zero-shot settings where no prior demonstrations exist, robots face a critical information gap, such as the exact sequence required to assemble a complex furniture kit, that cannot be satisfied by internal parametric knowledge (common sense) or past internal memory.
研究背景: 在機器人學習領域,To achieve general-purpose utility, we argue that robots must evolve from passive executors into active Information Retrieval users. In strictly zero-shot settings where no prior d
Technical Approach: In this paper, we define the paradigm as Retrieval-Augmented Robotics (RAR), empowering the robot with the information-seeking capability that bridges the gap between visual documentation and physical actuation. We formulate the task execution as an iterative Retrieve-Reason-Act loop: the robot or embodied agent actively retrieves relevant visual procedural manuals from an unstructured corpus, grounds the abstract 2D diagrams to 3D physical parts via cross-modal alignment, and synthesizes executable plans.
技術方法: 本文提出的方法:In this paper, we define the paradigm as Retrieval-Augmented Robotics (RAR), empowering the robot with the information-seeking capability that bridges the gap between visual documentation and physical
Key Takeaway: Our experiments demonstrate that grounding robotic planning in retrieved visual documents significantly outperforms baselines relying on zero-shot reasoning or few-shot example retrieval.
核心發現: 核心結果:Our experiments demonstrate that grounding robotic planning in retrieved visual documents significantly outperforms baselines relying on zero-shot reasoning or few-shot example retrieval.
LiteVLA-Edge: Quantized On-Device Multimodal Control for Embedded Robotics
Authors: Justin Williams, Kishor Datta Gupta, Roy George et al. | Submitted: 2026-03-03 | arXiv: 2603.03380
Categories: cs.RO, cs.AI
Research Background: Vision-Language-Action (VLA) models provide a unified framework for perception, language conditioning, and action generation, but many existing systems remain difficult to deploy in embedded robotic settings because of their computational requirements and inference latency. In this paper, we present LiteVLA-Edge, a deployment-oriented VLA pipeline for fully on-device inference on Jetson Orin-class hardware.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models provide a unified framework for perception, language conditioning, and action generation, but many existing systems remain difficult to deploy i
Technical Approach: In this paper, we present LiteVLA-Edge, a deployment-oriented VLA pipeline for fully on-device inference on Jetson Orin-class hardware. Our approach combines supervised image-to-action fine-tuning in FP32 with post-training 4-bit GGUF quantization and GPU-accelerated inference through the \texttt{llama.cpp} runtime.
技術方法: 本文提出的方法:In this paper, we present LiteVLA-Edge, a deployment-oriented VLA pipeline for fully on-device inference on Jetson Orin-class hardware. Our approach combines supervised image-to-action fine-tuning in
Key Takeaway: These results establish timing feasibility for reactive language-conditioned control and provide a reproducible baseline for future task-level evaluation of on-device VLAs in robotics.
核心發現: 核心結果:These results establish timing feasibility for reactive language-conditioned control and provide a reproducible baseline for future task-level evaluation of on-device VLAs in robotics.
Learning Object-Centric Spatial Reasoning for Sequential Manipulation in Cluttered Environments
Authors: Chrisantus Eze, Ryan C Julian, Christopher Crick | Submitted: 2026-03-03 | arXiv: 2603.02511
Categories: cs.RO, cs.AI
Research Background: Robotic manipulation in cluttered environments presents a critical challenge for automation. Recent large-scale, end-to-end models demonstrate impressive capabilities but often lack the data efficiency and modularity required for retrieving objects in dense clutter.
研究背景: 在機器人學習領域,Robotic manipulation in cluttered environments presents a critical challenge for automation. Recent large-scale, end-to-end models demonstrate impressive capabilities but often lac
Technical Approach: Recent large-scale, end-to-end models demonstrate impressive capabilities but often lack the data efficiency and modularity required for retrieving objects in dense clutter. In this work, we argue for a paradigm of specialized, decoupled systems and present Unveiler, a framework that explicitly separates high-level spatial reasoning from low-level action execution. Unveiler’s core is a lightweight, transformer-based Spatial Relationship Encoder (SRE) that sequentially identifies the most critical obstacle for removal.
技術方法: 本文提出的方法:Recent large-scale, end-to-end models demonstrate impressive capabilities but often lack the data efficiency and modularity required for retrieving objects in dense clutter. In this work, we argue for
Key Takeaway: Additionally, we demonstrate that the SRE’s spatial reasoning transfers zero-shot to real scenes, and validate the full system on a physical robot requiring only geometric workspace calibration; no learned components are retrained.
核心發現: 核心結果:Additionally, we demonstrate that the SRE’s spatial reasoning transfers zero-shot to real scenes, and validate the full system on a physical robot requiring only geometric workspace calibration; no le
Utonia: Toward One Encoder for All Point Clouds
Authors: Yujia Zhang, Xiaoyang Wu, Yunhan Yang et al. | Submitted: 2026-03-03 | arXiv: 2603.03283
Categories: cs.CV
Research Background: We dream of a future where point clouds from all domains can come together to shape a single model that benefits them all. Toward this goal, we present Utonia, a first step toward training a single self-supervised point transformer encoder across diverse domains, spanning remote sensing, outdoor LiDAR, indoor RGB-D sequences, object-centric CAD models, and point clouds lifted from RGB-only videos.
研究背景: 在機器人學習領域,We dream of a future where point clouds from all domains can come together to shape a single model that benefits them all. Toward this goal, we present Utonia, a first step toward
Technical Approach: Toward this goal, we present Utonia, a first step toward training a single self-supervised point transformer encoder across diverse domains, spanning remote sensing, outdoor LiDAR, indoor RGB-D sequences, object-centric CAD models, and point clouds lifted from RGB-only videos.
技術方法: 本文提出的方法:Toward this goal, we present Utonia, a first step toward training a single self-supervised point transformer encoder across diverse domains, spanning remote sensing, outdoor LiDAR, indoor RGB-D sequen
Key Takeaway: Beyond perception, we observe that Utonia representations can also benefit embodied and multimodal reasoning: conditioning vision-language-action policies on Utonia features improves robotic manipulation, and integrating them into vision-language models yields gains on spatial reasoning.
核心發現: 核心結果:Beyond perception, we observe that Utonia representations can also benefit embodied and multimodal reasoning: conditioning vision-language-action policies on Utonia features improves robotic manipulat
GIANT - Global Path Integration and Attentive Graph Networks for Multi-Agent Trajectory Planning
Authors: Jonas le Fevre Sejersen, Toyotaro Suzumura, Erdal Kayacan | Submitted: 2026-03-04 | arXiv: 2603.04659
Categories: cs.RO, cs.AI
Research Background: This paper presents a novel approach to multi-robot collision avoidance that integrates global path planning with local navigation strategies, utilizing attentive graph neural networks to manage dynamic interactions among agents. We introduce a local navigation model that leverages pre-planned global paths, allowing robots to adhere to optimal routes while dynamically adjusting to environmental changes.
研究背景: 在機器人學習領域,This paper presents a novel approach to multi-robot collision avoidance that integrates global path planning with local navigation strategies, utilizing attentive graph neural netw
Technical Approach: This paper presents a novel approach to multi-robot collision avoidance that integrates global path planning with local navigation strategies, utilizing attentive graph neural networks to manage dynamic interactions among agents. We introduce a local navigation model that leverages pre-planned global paths, allowing robots to adhere to optimal routes while dynamically adjusting to environmental changes. Our approach is evaluated against established baselines, including NH-ORCA, DRL-NAV, and GA3C-CADRL, across various structurally diverse simulated scenarios.
技術方法: 本文提出的方法:This paper presents a novel approach to multi-robot collision avoidance that integrates global path planning with local navigation strategies, utilizing attentive graph neural networks to manage dynam
Key Takeaway: The results demonstrate that our model achieves consistently higher success rates, lower collision rates, and more efficient navigation, particularly in challenging scenarios where baseline models struggle.
核心發現: 核心結果:The results demonstrate that our model achieves consistently higher success rates, lower collision rates, and more efficient navigation, particularly in challenging scenarios where baseline models str
RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policies
Authors: Yinpei Dai, Hongze Fu, Jayjun Lee et al. | Submitted: 2026-03-04 | arXiv: 2603.04639
Categories: cs.RO, cs.AI
Research Background: Memory is critical for long-horizon and history-dependent robotic manipulation. Such tasks often involve counting repeated actions or manipulating objects that become temporarily occluded.
研究背景: 在機器人學習領域,Memory is critical for long-horizon and history-dependent robotic manipulation. Such tasks often involve counting repeated actions or manipulating objects that become temporarily o
Technical Approach: To address these challenges, we introduce RoboMME: a large-scale standardized benchmark for evaluating and advancing VLA models in long-horizon, history-dependent scenarios.
技術方法: 本文提出的方法:To address these challenges, we introduce RoboMME: a large-scale standardized benchmark for evaluating and advancing VLA models in long-horizon, history-dependent scenarios.
Key Takeaway: Experimental results show that the effectiveness of memory representations is highly task-dependent, with each design offering distinct advantages and limitations across different tasks.
核心發現: 核心結果:Experimental results show that the effectiveness of memory representations is highly task-dependent, with each design offering distinct advantages and limitations across different tasks.
ELLIPSE: Evidential Learning for Robust Waypoints and Uncertainties
Authors: Zihao Dong, Chanyoung Chung, Dong-Ki Kim et al. | Submitted: 2026-03-04 | arXiv: 2603.04585
Categories: cs.RO
Research Background: Robust waypoint prediction is crucial for mobile robots operating in open-world, safety-critical settings. While Imitation Learning (IL) methods have demonstrated great success in practice, they are susceptible to distribution shifts: the policy can become dangerously overconfident in unfamiliar states.
研究背景: 在機器人學習領域,Robust waypoint prediction is crucial for mobile robots operating in open-world, safety-critical settings. While Imitation Learning (IL) methods have demonstrated great success in
Technical Approach: In this paper, we present \textit{ELLIPSE}, a method building on multivariate deep evidential regression to output waypoints and multivariate Student-t predictive distributions in a single forward pass. To reduce covariate-shift-induced overconfidence under viewpoint and pose perturbations near expert trajectories, we introduce a lightweight domain augmentation procedure that synthesizes plausible viewpoint/pose variations without collecting additional demonstrations.
技術方法: 本文提出的方法:In this paper, we present \textit{ELLIPSE}, a method building on multivariate deep evidential regression to output waypoints and multivariate Student-t predictive distributions in a single forward pas
Key Takeaway: Extensive real world evaluations show that \textit{ELLIPSE} improves both task success rate and uncertainty coverage compared to baselines.
核心發現: 核心結果:Extensive real world evaluations show that \textit{ELLIPSE} improves both task success rate and uncertainty coverage compared to baselines.
Force-Aware Residual DAgger via Trajectory Editing for Precision Insertion with Impedance Control
Authors: Yiou Huang, Ning Ma, Weichu Zhao et al. | Submitted: 2026-03-04 | arXiv: 2603.04038
Categories: cs.RO
Research Background: Imitation learning (IL) has shown strong potential for contact-rich precision insertion tasks. However, its practical deployment is often hindered by covariate shift and the need for continuous expert monitoring to recover from failures during execution.
研究背景: 在機器人學習領域,Imitation learning (IL) has shown strong potential for contact-rich precision insertion tasks. However, its practical deployment is often hindered by covariate shift and the need f
Technical Approach: In this paper, we propose Trajectory Editing Residual Dataset Aggregation (TER-DAgger), a scalable and force-aware human-in-the-loop imitation learning framework that mitigates covariate shift by learning residual policies through optimization-based trajectory editing. Second, we introduce a force-aware failure anticipation mechanism that triggers human intervention only when discrepancies arise between predicted and measured end-effector forces, significantly reducing the requirement for continuous expert monitoring.
技術方法: 本文提出的方法:In this paper, we propose Trajectory Editing Residual Dataset Aggregation (TER-DAgger), a scalable and force-aware human-in-the-loop imitation learning framework that mitigates covariate shift by lear
Key Takeaway: Extensive experiments in both simulation and real-world precision insertion tasks show that TER-DAgger improves the average success rate by over 37% compared to behavior cloning, human-guided correction, retraining, and fine-tuning baselines, demonstrating its effectiveness in mitigating covariate shift and enabling scalable deployment in contact-rich manipulation.
核心發現: 核心結果:Extensive experiments in both simulation and real-world precision insertion tasks show that TER-DAgger improves the average success rate by over 37% compared to behavior cloning, human-guided correct
Self-adapting Robotic Agents through Online Continual Reinforcement Learning with World Model Feedback
Authors: Fabian Domberg, Georg Schildbach | Submitted: 2026-03-04 | arXiv: 2603.04029
Categories: cs.RO, cs.AI
Research Background: As learning-based robotic controllers are typically trained offline and deployed with fixed parameters, their ability to cope with unforeseen changes during operation is limited. Biologically inspired, this work presents a framework for online Continual Reinforcement Learning that enables automated adaptation during deployment.
研究背景: 在機器人學習領域,As learning-based robotic controllers are typically trained offline and deployed with fixed parameters, their ability to cope with unforeseen changes during operation is limited. B
Technical Approach: Biologically inspired, this work presents a framework for online Continual Reinforcement Learning that enables automated adaptation during deployment. Building on DreamerV3, a model-based Reinforcement Learning algorithm, the proposed method leverages world model prediction residuals to detect out-of-distribution events and automatically trigger finetuning. Adaptation progress is monitored using both task-level performance signals and internal training metrics, allowing convergence to be assessed without external supervision and domain knowledge.
技術方法: 本文提出的方法:Biologically inspired, this work presents a framework for online Continual Reinforcement Learning that enables automated adaptation during deployment. Building on DreamerV3, a model-based Reinforcemen
Key Takeaway: The results sketch out how autonomous robotic agents could once move beyond static training regimes toward adaptive systems capable of self-reflection and -improvement during operation, just like their biological counterparts.
核心發現: 核心結果:The results sketch out how autonomous robotic agents could once move beyond static training regimes toward adaptive systems capable of self-reflection and -improvement during operation, just like thei
Lightweight Visual Reasoning for Socially-Aware Robots
Authors: Alessio Galatolo, Ronald Cumbal, Alexandros Rouchitsas et al. | Submitted: 2026-03-04 | arXiv: 2603.03942
Categories: cs.RO
Research Background: Robots operating in shared human environments must not only navigate, interact, and detect their surroundings, they must also interpret and respond to dynamic, and often unpredictable, human behaviours. Although recent advances have shown promise in enhancing robotic perception and instruction-following using Vision-Language Models (VLMs), they remain limited in addressing the complexities of multimodal human-robot interactions (HRI).
研究背景: 在機器人學習領域,Robots operating in shared human environments must not only navigate, interact, and detect their surroundings, they must also interpret and respond to dynamic, and often unpredicta
Technical Approach: Motivated by this challenge, we introduce a lightweight language-to-vision feedback module that closes the loop between an LLM and the vision encoder in VLMs. Results show that our method improves Qwen 2.5 (7B) by (less distance), description score, and accuracy, with less than extra parameters; Gemma 3 (4B) and LLaVA OV 1.5 (4B) show mixed navigation results but gains and on the latter two tasks.
技術方法: 本文提出的方法:Motivated by this challenge, we introduce a lightweight language-to-vision feedback module that closes the loop between an LLM and the vision encoder in VLMs. Results show that our method improves Qwe
Key Takeaway: Results show that our method improves Qwen 2.5 (7B) by (less distance), description score, and accuracy, with less than extra parameters; Gemma 3 (4B) and LLaVA OV 1.5 (4B) show mixed navigation results but gains and on the latter two tasks.
核心發現: 核心結果:Results show that our method improves Qwen 2.5 (7B) by (less distance), description score, and accuracy, with less than extra parameters; Gemma 3 (4B) and LLaVA OV 1.5
IROSA: Interactive Robot Skill Adaptation using Natural Language
Authors: Markus Knauer, Samuel Bustamante, Thomas Eiband et al. | Submitted: 2026-03-04 | arXiv: 2603.03897
Categories: cs.RO, cs.AI, cs.CL, cs.HC, cs.LG
Research Background: Foundation models have demonstrated impressive capabilities across diverse domains, while imitation learning provides principled methods for robot skill adaptation from limited data. Combining these approaches holds significant promise for direct application to robotics, yet this combination has received limited attention, particularly for industrial deployment.
研究背景: 在機器人學習領域,Foundation models have demonstrated impressive capabilities across diverse domains, while imitation learning provides principled methods for robot skill adaptation from limited dat
Technical Approach: We present a novel framework that enables open-vocabulary skill adaptation through a tool-based architecture, maintaining a protective abstraction layer between the language model and robot hardware. Our approach leverages pre-trained LLMs to select and parameterize specific tools for adapting robot skills without requiring fine-tuning or direct model-to-robot interaction.
技術方法: 本文提出的方法:We present a novel framework that enables open-vocabulary skill adaptation through a tool-based architecture, maintaining a protective abstraction layer between the language model and robot hardware.
Key Takeaway: We demonstrate the framework on a 7-DoF torque-controlled robot performing an industrial bearing ring insertion task, showing successful skill adaptation through natural language commands for speed adjustment, trajectory correction, and obstacle avoidance while maintaining safety, transparency, and interpretability.
核心發現: 核心結果:We demonstrate the framework on a 7-DoF torque-controlled robot performing an industrial bearing ring insertion task, showing successful skill adaptation through natural language commands for speed ad
SkillVLA: Tackling Combinatorial Diversity in Dual-Arm Manipulation via Skill Reuse
Authors: Xuanran Zhai, Zekai Huang, Longyan Wu et al. | Submitted: 2026-03-04 | arXiv: 2603.03836
Categories: cs.RO
Research Background: Recent progress in vision-language-action (VLA) models has demonstrated strong potential for dual-arm manipulation, enabling complex behaviors and generalization to unseen environments. However, mainstream bimanual VLA formulations largely overlook the critical challenge of combinatorial diversity.
研究背景: 在機器人學習領域,Recent progress in vision-language-action (VLA) models has demonstrated strong potential for dual-arm manipulation, enabling complex behaviors and generalization to unseen environm
Technical Approach: To address this limitation, we propose SkillVLA, a framework explicitly designed to enable skill reuse in dual-arm manipulation.
技術方法: 本文提出的方法:To address this limitation, we propose SkillVLA, a framework explicitly designed to enable skill reuse in dual-arm manipulation.
Key Takeaway: Extensive experiments demonstrate that SkillVLA substantially improves skill composition, increasing overall success rate from 0% to 51%, and achieves strong performance on cooperative and long-horizon tasks.
核心發現: 核心結果:Extensive experiments demonstrate that SkillVLA substantially improves skill composition, increasing overall success rate from 0% to 51%, and achieves strong performance on cooperative and long-horizo
TimeSpot: Benchmarking Geo-Temporal Understanding in Vision-Language Models in Real-World Settings
Authors: Azmine Toushik Wasi, Shahriyar Zaman Ridoy, Koushik Ahamed Tonmoy et al. | Submitted: 2026-03-04 | arXiv: 2603.06687
Categories: cs.CV, cs.CL, cs.ET, cs.MM, cs.RO
Research Background: Geo-temporal understanding, the ability to infer location, time, and contextual properties from visual input alone, underpins applications such as disaster management, traffic planning, embodied navigation, world modeling, and geography education. Although recent vision-language models (VLMs) have advanced image geo-localization using cues like landmarks and road signs, their ability to reason about temporal signals and physically grounded spatial cues remains limited.
研究背景: 在機器人學習領域,Geo-temporal understanding, the ability to infer location, time, and contextual properties from visual input alone, underpins applications such as disaster management, traffic plan
Technical Approach: To address this gap, we introduce TimeSpot, a benchmark for evaluating real-world geo-temporal reasoning in VLMs.
技術方法: 本文提出的方法:To address this gap, we introduce TimeSpot, a benchmark for evaluating real-world geo-temporal reasoning in VLMs.
Key Takeaway: While supervised fine-tuning yields improvements, results remain insufficient, highlighting the need for new methods to achieve robust, physically grounded geo-temporal understanding TimeSpot is available at: https://TimeSpot-GT.github.io.
核心發現: 核心結果:While supervised fine-tuning yields improvements, results remain insufficient, highlighting the need for new methods to achieve robust, physically grounded geo-temporal understanding TimeSpot is avail
Cognition to Control - Multi-Agent Learning for Human-Humanoid Collaborative Transport
Authors: Hao Zhang, Ding Zhao, H. Eric Tseng | Submitted: 2026-03-04 | arXiv: 2603.03768
Categories: cs.RO, cs.AI
Research Background: Effective human-robot collaboration (HRC) requires translating high-level intent into contact-stable whole-body motion while continuously adapting to a human partner. Many vision-language-action (VLA) systems learn end-to-end mappings from observations and instructions to actions, but they often emphasize reactive (System 1-like) behavior and leave under-specified how sustained System 2-style deliberation can be integrated with reliable, low-latency continuous control.
研究背景: 在機器人學習領域,Effective human-robot collaboration (HRC) requires translating high-level intent into contact-stable whole-body motion while continuously adapting to a human partner. Many vision-l
Technical Approach: Many vision-language-action (VLA) systems learn end-to-end mappings from observations and instructions to actions, but they often emphasize reactive (System 1-like) behavior and leave under-specified how sustained System 2-style deliberation can be integrated with reliable, low-latency continuous control. This gap is acute in multi-agent HRC, where long-horizon coordination decisions and physical execution must co-evolve under contact, feasibility, and safety constraints. We address this limitation with cognition-to-control (C2C), a three-layer hierarchy that makes the deliberation-to-control pathway explicit: (i) a VLM-based grounding layer that maintains persistent scene referents and infers embodiment-aware affordances/constraints; (ii) a deliberative skill/coordination layer-the System 2 core-that optimizes long-horizon skill choices and sequences under human-robot coupling via decentralized MARL cast as a Markov potential game with a shared potential encoding task progress; and (iii) a whole-body control layer that executes the selected skills at high frequency while enforcing kinematic/dynamic feasibility and contact stability.
技術方法: 本文提出的方法:Many vision-language-action (VLA) systems learn end-to-end mappings from observations and instructions to actions, but they often emphasize reactive (System 1-like) behavior and leave under-specified
Key Takeaway: Experiments on collaborative manipulation tasks show higher success and robustness than single-agent and end-to-end baselines, with stable coordination and emergent leader-follower behaviors.
核心發現: 核心結果:Experiments on collaborative manipulation tasks show higher success and robustness than single-agent and end-to-end baselines, with stable coordination and emergent leader-follower behaviors.
Whole-Body Safe Control of Robotic Systems with Koopman Neural Dynamics
Authors: Sebin Jung, Abulikemu Abuduweili, Jiaxing Li et al. | Submitted: 2026-03-04 | arXiv: 2603.03740
Categories: cs.RO
Research Background: Controlling robots with strongly nonlinear, high-dimensional dynamics remains challenging, as direct nonlinear optimization with safety constraints is often intractable in real time. The Koopman operator offers a way to represent nonlinear systems linearly in a lifted space, enabling the use of efficient linear control.
研究背景: 在機器人學習領域,Controlling robots with strongly nonlinear, high-dimensional dynamics remains challenging, as direct nonlinear optimization with safety constraints is often intractable in real tim
Technical Approach: We propose a data-driven framework that learns a Koopman embedding and operator from data, and integrates the resulting linear model with the Safe Set Algorithm (SSA).
技術方法: 本文提出的方法:We propose a data-driven framework that learns a Koopman embedding and operator from data, and integrates the resulting linear model with the Safe Set Algorithm (SSA).
Key Takeaway: We validate the method on a Kinova Gen3 manipulator and a Go2 quadruped, showing accurate tracking and obstacle avoidance.
核心發現: 核心結果:We validate the method on a Kinova Gen3 manipulator and a Go2 quadruped, showing accurate tracking and obstacle avoidance.
Touch2Insert: Zero-Shot Peg Insertion by Touching Intersections of Peg and Hole
Authors: Masaru Yajima, Yuma Shin, Rei Kawakami et al. | Submitted: 2026-03-04 | arXiv: 2603.03627
Categories: cs.RO
Research Background: Reliable insertion of industrial connectors remains a central challenge in robotics, requiring sub-millimeter precision under uncertainty and often without full visual access. Vision-based approaches struggle with occlusion and limited generalization, while learning-based policies frequently fail to transfer to unseen geometries.
研究背景: 在機器人學習領域,Reliable insertion of industrial connectors remains a central challenge in robotics, requiring sub-millimeter precision under uncertainty and often without full visual access. Visi
Technical Approach: To address these limitations, we leverage tactile sensing, which captures local surface geometry at the point of contact and thus provides reliable information even under occlusion and across novel connector shapes. Building on this capability, we present \emph{Touch2Insert}, a tactile-based framework for arbitrary peg insertion. Our method reconstructs cross-sectional geometry from high-resolution tactile images and estimates the relative pose of the hole with respect to the peg in a zero-shot manner.
技術方法: 本文提出的方法:To address these limitations, we leverage tactile sensing, which captures local surface geometry at the point of contact and thus provides reliable information even under occlusion and across novel co
Key Takeaway: The results indicate that Touch2Insert achieved sub-millimeter pose estimation accuracy for all connectors in simulation, and attained an average success rate of 86.7% on the real robot, thereby confirming the robustness and generalizability of tactile sensing for real-world robotic connector insertion.
核心發現: 核心結果:The results indicate that Touch2Insert achieved sub-millimeter pose estimation accuracy for all connectors in simulation, and attained an average success rate of 86.7% on the real robot, thereby conf
Real Eyes Realize Faster: Gaze Stability and Pupil Novelty for Efficient Egocentric Learning
Authors: Ajan Subramanian, Sumukh Bettadapura, Rohan Sathish | Submitted: 2026-03-04 | arXiv: 2603.04098
Categories: cs.CV, cs.HC
Research Background: Always-on egocentric cameras are increasingly used as demonstrations for embodied robotics, imitation learning, and assistive AR, but the resulting video streams are dominated by redundant and low-quality frames. Under the storage and battery constraints of wearable devices, choosing which frames to keep is as important as how to learn from them.
研究背景: 在機器人學習領域,Always-on egocentric cameras are increasingly used as demonstrations for embodied robotics, imitation learning, and assistive AR, but the resulting video streams are dominated by r
Technical Approach: Our method requires no model inference and operates at capture time, offering a path toward efficient, always-on egocentric data curation.
技術方法: 本文提出的方法:Our method requires no model inference and operates at capture time, offering a path toward efficient, always-on egocentric data curation.
Key Takeaway: The benefit is task-dependent: pupil ranking improves activity recognition, while gaze-only selection already dominates for scene recognition, confirming that the two signals serve genuinely different roles.
核心發現: 核心結果:The benefit is task-dependent: pupil ranking improves activity recognition, while gaze-only selection already dominates for scene recognition, confirming that the two signals serve genuinely different
EmboAlign: Aligning Video Generation with Compositional Constraints for Zero-Shot Manipulation
Authors: Gehao Zhang, Zhenyang Ni, Payal Mohapatra et al. | Submitted: 2026-03-05 | arXiv: 2603.05757
Categories: cs.RO
Research Background: Video generative models (VGMs) pretrained on large-scale internet data can produce temporally coherent rollout videos that capture rich object dynamics, offering a compelling foundation for zero-shot robotic manipulation. However, VGMs often produce physically implausible rollouts, and converting their pixel-space motion into robot actions through geometric retargeting further introduces cumulative errors from imperfect depth estimation and keypoint tracking.
研究背景: 在機器人學習領域,Video generative models (VGMs) pretrained on large-scale internet data can produce temporally coherent rollout videos that capture rich object dynamics, offering a compelling found
Technical Approach: To address these challenges, we present \method{}, a data-free framework that aligns VGM outputs with compositional constraints generated by vision-language models (VLMs) at inference time.
技術方法: 本文提出的方法:To address these challenges, we present \method{}, a data-free framework that aligns VGM outputs with compositional constraints generated by vision-language models (VLMs) at inference time.
Key Takeaway: We evaluate \method{} on six real-robot manipulation tasks requiring precise, constraint-sensitive execution, improving the overall success rate by 43.3% points over the strongest baseline without any task-specific training data.
核心發現: 核心結果:We evaluate \method{} on six real-robot manipulation tasks requiring precise, constraint-sensitive execution, improving the overall success rate by 43.3% points over the strongest baseline without an
Contact-Grounded Policy: Dexterous Visuotactile Policy with Generative Contact Grounding
Authors: Zhengtong Xu, Yeping Wang, Ben Abbatematteo et al. | Submitted: 2026-03-05 | arXiv: 2603.05687
Categories: cs.RO
Research Background: Contact-rich dexterous manipulation with multi-finger hands remains an open challenge in robotics because task success depends on multi-point contacts that continuously evolve and are highly sensitive to object geometry, frictional transitions, and slip. Recently, tactile-informed manipulation policies have shown promise.
研究背景: 在機器人學習領域,Contact-rich dexterous manipulation with multi-finger hands remains an open challenge in robotics because task success depends on multi-point contacts that continuously evolve and
Technical Approach: We present Contact-Grounded Policy (CGP), a visuotactile policy that grounds multi-point contacts by predicting coupled trajectories of actual robot state and tactile feedback, and using a learned contact-consistency mapping to convert these predictions into executable target robot states for a compliance controller.
技術方法: 本文提出的方法:We present Contact-Grounded Policy (CGP), a visuotactile policy that grounds multi-point contacts by predicting coupled trajectories of actual robot state and tactile feedback, and using a learned con
Key Takeaway: Across a range of dexterous tasks including in-hand manipulation, delicate grasping, and tool use, CGP outperforms visuomotor and visuotactile diffusion-policy baselines.
核心發現: 核心結果:Across a range of dexterous tasks including in-hand manipulation, delicate grasping, and tool use, CGP outperforms visuomotor and visuotactile diffusion-policy baselines.
TransMASK: Masked State Representation through Learned Transformation
Authors: Sagar Parekh, Preston Culbertson, Dylan P. Losey | Submitted: 2026-03-05 | arXiv: 2603.05670
Categories: cs.RO
Research Background: Humans train robots to complete tasks in one environment, and expect robots to perform those same tasks in new environments. As humans, we know which aspects of the environment (i.e., the state) are relevant to the task.
研究背景: 在機器人學習領域,Humans train robots to complete tasks in one environment, and expect robots to perform those same tasks in new environments. As humans, we know which aspects of the environment (i.
Technical Approach: In this paper we therefore propose a self-supervised method to learn a mask which, when multiplied by the observed state, transforms that state into a latent representation that is biased towards relevant elements. Our method — which we call TransMASK — can be combined with a variety of imitation learning frameworks (such as diffusion policies) without any additional labels or alterations to the loss function. We compare our approach to other methods that extract relevant states for downstream imitation learning.
技術方法: 本文提出的方法:In this paper we therefore propose a self-supervised method to learn a mask which, when multiplied by the observed state, transforms that state into a latent representation that is biased towards rele
Key Takeaway: To achieve this, we recognize that the learned policy updates to better match the human’s true policy.
核心發現: 核心結果:To achieve this, we recognize that the learned policy updates to better match the human’s true policy.
RFM-HRI : A Multimodal Dataset of Medical Robot Failure, User Reaction and Recovery Preferences for Item Retrieval Tasks
Authors: Yashika Batra, Giuliano Pioldi, Promise Ekpo et al. | Submitted: 2026-03-05 | arXiv: 2603.05641
Categories: cs.RO, cs.HC
Research Background: While robots deployed in real-world environments inevitably experience interaction failures, understanding how users respond through verbal and non-verbal behaviors remains under-explored in human-robot interaction (HRI). This gap is particularly significant in healthcare-inspired settings, where interaction failures can directly affect task performance and user trust.
研究背景: 在機器人學習領域,While robots deployed in real-world environments inevitably experience interaction failures, understanding how users respond through verbal and non-verbal behaviors remains under-e
Technical Approach: We present the Robot Failures in Medical HRI (RFM-HRI) Dataset, a multimodal dataset capturing dyadic interactions between humans and robots embodied in crash carts, where communication failures are systematically induced during item retrieval tasks.
技術方法: 本文提出的方法:We present the Robot Failures in Medical HRI (RFM-HRI) Dataset, a multimodal dataset capturing dyadic interactions between humans and robots embodied in crash carts, where communication failures are s
Key Takeaway: Our findings provide a foundation for failure detection and recovery methods in embodied HRI.
核心發現: 核心結果:Our findings provide a foundation for failure detection and recovery methods in embodied HRI.
RoboPocket: Improve Robot Policies Instantly with Your Phone
Authors: Junjie Fang, Wendi Chen, Han Xue et al. | Submitted: 2026-03-05 | arXiv: 2603.05504
Categories: cs.RO, cs.AI, cs.LG
Research Background: Scaling imitation learning is fundamentally constrained by the efficiency of data collection. While handheld interfaces have emerged as a scalable solution for in-the-wild data acquisition, they predominantly operate in an open-loop manner: operators blindly collect demonstrations without knowing the underlying policy’s weaknesses, leading to inefficient coverage of critical state distributions.
研究背景: 在機器人學習領域,Scaling imitation learning is fundamentally constrained by the efficiency of data collection. While handheld interfaces have emerged as a scalable solution for in-the-wild data acq
Technical Approach: To reconcile this trade-off, we introduce RoboPocket, a portable system that enables Robot-Free Instant Policy Iteration using single consumer smartphones.
技術方法: 本文提出的方法:To reconcile this trade-off, we introduce RoboPocket, a portable system that enables Robot-Free Instant Policy Iteration using single consumer smartphones.
Key Takeaway: Extensive experiments demonstrate that RoboPocket adheres to data scaling laws and doubles the data efficiency compared to offline scaling strategies, overcoming their long-standing efficiency bottleneck.
核心發現: 核心結果:Extensive experiments demonstrate that RoboPocket adheres to data scaling laws and doubles the data efficiency compared to offline scaling strategies, overcoming their long-standing efficiency bottlen
NEFFY 2.0: A Breathing Companion Robot: User-Centered Design and Findings from a Study with Ukrainian Refugees
Authors: Ilona Buchem, Jessica Kazubski, Charly Goerke | Submitted: 2026-03-05 | arXiv: 2604.15325
Categories: cs.HC, cs.ET, cs.RO
Research Background: This paper presents the design of NEFFY 2.0, a social robot designed as a haptic slow-paced breathing companion for stress reduction, and reports findings from a mixed-methods user study with 14 refugees from Ukraine. Developed through a user-centered design process, NEFFY 2.0 builds on NEFFY 1.0 and integrates embodiment and multi-sensory interaction to provide low-threshold, accessible guidance of slow-paced breathing for stress relief, which may be particularly valuable for individuals experiencing prolonged periods of anxiety.
研究背景: 在機器人學習領域,This paper presents the design of NEFFY 2.0, a social robot designed as a haptic slow-paced breathing companion for stress reduction, and reports findings from a mixed-methods user
Technical Approach: This paper presents the design of NEFFY 2.0, a social robot designed as a haptic slow-paced breathing companion for stress reduction, and reports findings from a mixed-methods user study with 14 refugees from Ukraine.
技術方法: 本文提出的方法:This paper presents the design of NEFFY 2.0, a social robot designed as a haptic slow-paced breathing companion for stress reduction, and reports findings from a mixed-methods user study with 14 refug
Key Takeaway: Physiological data reveled mixed results combined with large inter-personal variability.
核心發現: 核心結果:Physiological data reveled mixed results combined with large inter-personal variability.
PhysiFlow: Physics-Aware Humanoid Whole-Body VLA via Multi-Brain Latent Flow Matching and Robust Tracking
Authors: Weikai Qin, Sichen Wu, Ci Chen et al. | Submitted: 2026-03-05 | arXiv: 2603.05410
Categories: cs.RO
Research Background: In the domain of humanoid robot control, the fusion of Vision-Language-Action (VLA) with whole-body control is essential for semantically guided execution of real-world tasks. However, existing methods encounter challenges in terms of low VLA inference efficiency or an absence of effective semantic guidance for whole-body control, resulting in instability in dynamic limb-coordinated tasks.
研究背景: 在機器人學習領域,In the domain of humanoid robot control, the fusion of Vision-Language-Action (VLA) with whole-body control is essential for semantically guided execution of real-world tasks. Howe
Technical Approach: To bridge this gap, we present a semantic-motion intent guided, physics-aware multi-brain VLA framework for humanoid whole-body control.
技術方法: 本文提出的方法:To bridge this gap, we present a semantic-motion intent guided, physics-aware multi-brain VLA framework for humanoid whole-body control.
Key Takeaway: The experimental results demonstrated that the framework enabled reliable vision-language-guided full-body coordination for humanoid robots.
核心發現: 核心結果:The experimental results demonstrated that the framework enabled reliable vision-language-guided full-body coordination for humanoid robots.
Accelerating Sampling-Based Control via Learned Linear Koopman Dynamics
Authors: Wenjian Hao, Yuxuan Fang, Zehui Lu et al. | Submitted: 2026-03-05 | arXiv: 2603.05385
Categories: cs.RO, eess.SY
Research Background: This paper presents an efficient model predictive path integral (MPPI) control framework for systems with complex nonlinear dynamics. To improve the computational efficiency of classic MPPI while preserving control performance, we replace the nonlinear dynamics used for trajectory propagation with a learned linear deep Koopman operator (DKO) model, enabling faster rollout and more efficient trajectory sampling.
研究背景: 在機器人學習領域,This paper presents an efficient model predictive path integral (MPPI) control framework for systems with complex nonlinear dynamics. To improve the computational efficiency of cla
Technical Approach: This paper presents an efficient model predictive path integral (MPPI) control framework for systems with complex nonlinear dynamics.
技術方法: 本文提出的方法:This paper presents an efficient model predictive path integral (MPPI) control framework for systems with complex nonlinear dynamics.
Key Takeaway: Experimental results demonstrate that MPPI-DK achieves control performance close to MPPI with true dynamics while substantially reducing computational cost, enabling efficient real-time control on robotic platforms.
核心發現: 核心結果:Experimental results demonstrate that MPPI-DK achieves control performance close to MPPI with true dynamics while substantially reducing computational cost, enabling efficient real-time control on rob
Task Parameter Extrapolation via Learning Inverse Tasks from Forward Demonstrations
Authors: Serdar Bahar, Fatih Dogangun, Matteo Saveriano et al. | Submitted: 2026-03-05 | arXiv: 2603.05576
Categories: cs.RO
Research Background: Generalizing skill policies to novel conditions remains a key challenge in robot learning. Imitation learning methods, while data-efficient, are largely confined to the training region and consistently fail on input data outside it, leading to unpredictable policy failures.
研究背景: 在機器人學習領域,Generalizing skill policies to novel conditions remains a key challenge in robot learning. Imitation learning methods, while data-efficient, are largely confined to the training re
Technical Approach: Our method constructs a common representation of the forward and inverse tasks, and leverages auxiliary forward demonstrations from novel configurations to successfully execute the corresponding inverse tasks, without any direct supervision. We show the extrapolation capabilities of our framework via ablation studies and experiments in simulated and real-world environments that require complex manipulation skills with a diverse set of objects and tools, where we outperform diffusion-based alternatives.
技術方法: 本文提出的方法:Our method constructs a common representation of the forward and inverse tasks, and leverages auxiliary forward demonstrations from novel configurations to successfully execute the corresponding inver
Key Takeaway: We show the extrapolation capabilities of our framework via ablation studies and experiments in simulated and real-world environments that require complex manipulation skills with a diverse set of objects and tools, where we outperform diffusion-based alternatives.
核心發現: 核心結果:We show the extrapolation capabilities of our framework via ablation studies and experiments in simulated and real-world environments that require complex manipulation skills with a diverse set of obj
PRISM: Personalized Refinement of Imitation Skills for Manipulation via Human Instructions
Authors: Arnau Boix-Granell, Alberto San-Miguel-Tello, Magí Dalmau-Moreno et al. | Submitted: 2026-03-05 | arXiv: 2603.05574
Categories: cs.RO, cs.AI
Research Background: This paper presents PRISM: an instruction-conditioned refinement method for imitation policies in robotic manipulation. This approach bridges Imitation Learning (IL) and Reinforcement Learning (RL) frameworks into a seamless pipeline, such that an imitation policy on a broad generic task, generated from a set of user-guided demonstrations, can be refined through reinforcement to generate new unseen fine-grain behaviours.
研究背景: 在機器人學習領域,This paper presents PRISM: an instruction-conditioned refinement method for imitation policies in robotic manipulation. This approach bridges Imitation Learning (IL) and Reinforcem
Technical Approach: This paper presents PRISM: an instruction-conditioned refinement method for imitation policies in robotic manipulation.
技術方法: 本文提出的方法:This paper presents PRISM: an instruction-conditioned refinement method for imitation policies in robotic manipulation.
Key Takeaway: Results for a pick-and-place task in a simulated scenario show that proposed method outperforms policies without human feedback, improving robustness on deployment and reducing computational burden.
核心發現: 核心結果:Results for a pick-and-place task in a simulated scenario show that proposed method outperforms policies without human feedback, improving robustness on deployment and reducing computational burden.
OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
Authors: Esteban Padilla-Cerdio, Boyang Sun, Marc Pollefeys et al. | Submitted: 2026-03-05 | arXiv: 2603.05377
Categories: cs.RO, cs.CV
Research Background: Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely on dense 3D reconstruction and hand-crafted goal metrics, which limits their generalization across tasks and environments.
研究背景: 在機器人學習領域,Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely
Technical Approach: We formulate navigation as a sparse subgoal identification and reaching problem and observe that providing visual anchoring targets for high-level semantic priors enables highly efficient goal-conditioned navigation.
技術方法: 本文提出的方法:We formulate navigation as a sparse subgoal identification and reaching problem and observe that providing visual anchoring targets for high-level semantic priors enables highly efficient goal-conditi
Key Takeaway: We evaluate OpenFrontier across multiple navigation benchmarks and demonstrate strong zero-shot performance, as well as effective real-world deployment on a mobile robot.
核心發現: 核心結果:We evaluate OpenFrontier across multiple navigation benchmarks and demonstrate strong zero-shot performance, as well as effective real-world deployment on a mobile robot.
OmniDP: Beyond-FOV Large-Workspace Humanoid Manipulation with Omnidirectional 3D Perception
Authors: Pei Qu, Zheng Li, Yufei Jia et al. | Submitted: 2026-03-05 | arXiv: 2603.05355
Categories: cs.RO
Research Background: The deployment of humanoid robots for dexterous manipulation in unstructured environments remains challenging due to perceptual limitations that constrain the effective workspace. In scenarios where physical constraints prevent the robot from repositioning itself, maintaining omnidirectional awareness becomes far more critical than color or semantic information.While recent advances in visuomotor policy learning have improved manipulation capabilities, conventional RGB-D solutions suffer from narrow fields of view (FOV) and self-occlusion, requiring frequent base movements that introduce motion uncertainty and safety risks.
研究背景: 在機器人學習領域,The deployment of humanoid robots for dexterous manipulation in unstructured environments remains challenging due to perceptual limitations that constrain the effective workspace.
Technical Approach: In this work, We propose OmniDP, an end-to-end LiDAR-driven 3D visuomotor policy that enables robust manipulation in large workspaces. Our method processes panoramic point clouds through a Time-Aware Attention Pooling mechanism, efficiently encoding sparse 3D data while capturing temporal dependencies. To support policy learning, we develop a whole-body teleoperation system for efficient data collection on full-body coordination.
技術方法: 本文提出的方法:In this work, We propose OmniDP, an end-to-end LiDAR-driven 3D visuomotor policy that enables robust manipulation in large workspaces. Our method processes panoramic point clouds through a Time-Aware
Key Takeaway: Extensive experiments in simulation and real-world environments show that OmniDP achieves robust performance in large-workspace and cluttered scenarios, outperforming baselines that rely on egocentric depth cameras.
核心發現: 核心結果:Extensive experiments in simulation and real-world environments show that OmniDP achieves robust performance in large-workspace and cluttered scenarios, outperforming baselines that rely on egocentric
UltraDexGrasp: Learning Universal Dexterous Grasping for Bimanual Robots with Synthetic Data
Authors: Sizhe Yang, Yiman Xie, Zhixuan Liang et al. | Submitted: 2026-03-05 | arXiv: 2603.05312
Categories: cs.RO
Research Background: Grasping is a fundamental capability for robots to interact with the physical world. Humans, equipped with two hands, autonomously select appropriate grasp strategies based on the shape, size, and weight of objects, enabling robust grasping and subsequent manipulation.
研究背景: 在機器人學習領域,Grasping is a fundamental capability for robots to interact with the physical world. Humans, equipped with two hands, autonomously select appropriate grasp strategies based on the
Technical Approach: To address these issues, we introduce UltraDexGrasp, a framework for universal dexterous grasping with bimanual robots.
技術方法: 本文提出的方法:To address these issues, we introduce UltraDexGrasp, a framework for universal dexterous grasping with bimanual robots.
Key Takeaway: Trained exclusively on synthetic data, the policy achieves robust zero-shot sim-to-real transfer and consistently succeeds on novel objects with varied shapes, sizes, and weights, attaining an average success rate of 81.2% in real-world universal dexterous grasping.
核心發現: 核心結果:Trained exclusively on synthetic data, the policy achieves robust zero-shot sim-to-real transfer and consistently succeeds on novel objects with varied shapes, sizes, and weights, attaining an average
Rethinking the Role of Collaborative Robots in Rehabilitation
Authors: Vivek Gupte, Shalutha Rajapakshe, Emmanuel Senft | Submitted: 2026-03-05 | arXiv: 2603.05252
Categories: cs.RO
Research Background: Current research on collaborative robots (cobots) in physical rehabilitation largely focuses on repeated motion training for people undergoing physical therapy (PuPT), even though these sessions include phases that could benefit from robotic collaboration and assistance. Meanwhile, access to physical therapy remains limited for people with disabilities and chronic illnesses.
研究背景: 在機器人學習領域,Current research on collaborative robots (cobots) in physical rehabilitation largely focuses on repeated motion training for people undergoing physical therapy (PuPT), even though
Technical Approach: We propose extending the scope of cobots by imagining their role in assisting therapists and PuPT before, during, and after a therapy session.
技術方法: 本文提出的方法:We propose extending the scope of cobots by imagining their role in assisting therapists and PuPT before, during, and after a therapy session.
Key Takeaway: This view opens new research questions and opportunities to draw from the HRI community’s advances in assistive robotics.
核心發現: 核心結果:This view opens new research questions and opportunities to draw from the HRI community’s advances in assistive robotics.
Digital Twin Driven Textile Classification and Foreign Object Recognition in Automated Sorting Systems
Authors: Serkan Ergun, Tobias Mitterer, Hubert Zangl | Submitted: 2026-03-05 | arXiv: 2603.05230
Categories: cs.CV, cs.RO
Research Background: The increasing demand for sustainable textile recycling requires robust automation solutions capable of handling deformable garments and detecting foreign objects in cluttered environments. This work presents a digital twin driven robotic sorting system that integrates grasp prediction, multi modal perception, and semantic reasoning for real world textile classification.
研究背景: 在機器人學習領域,The increasing demand for sustainable textile recycling requires robust automation solutions capable of handling deformable garments and detecting foreign objects in cluttered envi
Technical Approach: This work presents a digital twin driven robotic sorting system that integrates grasp prediction, multi modal perception, and semantic reasoning for real world textile classification. A dual arm robotic cell equipped with RGBD sensing, capacitive tactile feedback, and collision-aware motion planning autonomously separates garments from an unsorted basket, transfers them to an inspection zone, and classifies them using state of the art Visual Language Models (VLMs). We benchmark nine VLM s from five model families on a dataset of 223 inspection scenarios comprising shirts, socks, trousers, underwear, foreign objects (including garments outside of the aforementioned classes), and empty scenes.
技術方法: 本文提出的方法:This work presents a digital twin driven robotic sorting system that integrates grasp prediction, multi modal perception, and semantic reasoning for real world textile classification. A dual arm robot
Key Takeaway: The presented system demonstrates the feasibility of combining semantic VLM reasoning with conventional grasp detection and digital twin technology for scalable, autonomous textile sorting in realistic industrial settings.
核心發現: 核心結果:The presented system demonstrates the feasibility of combining semantic VLM reasoning with conventional grasp detection and digital twin technology for scalable, autonomous textile sorting in realisti
GaussTwin: Unified Simulation and Correction with Gaussian Splatting for Robotic Digital Twins
Authors: Yichen Cai, Paul Jansonnie, Cristiana de Farias et al. | Submitted: 2026-03-05 | arXiv: 2603.05108
Categories: cs.RO
Research Background: Digital twins promise to enhance robotic manipulation by maintaining a consistent link between real-world perception and simulation. However, most existing systems struggle with the lack of a unified model, complex dynamic interactions, and the real-to-sim gap, which limits downstream applications such as model predictive control.
研究背景: 在機器人學習領域,Digital twins promise to enhance robotic manipulation by maintaining a consistent link between real-world perception and simulation. However, most existing systems struggle with th
Technical Approach: Thus, we propose GaussTwin, a real-time digital twin that combines position-based dynamics with discrete Cosserat rod formulations for physically grounded simulation, and Gaussian splatting for efficient rendering and visual correction.
技術方法: 本文提出的方法:Thus, we propose GaussTwin, a real-time digital twin that combines position-based dynamics with discrete Cosserat rod formulations for physically grounded simulation, and Gaussian splatting for effici
Key Takeaway: These results highlight GaussTwin as a step toward unified, physically meaningful digital twins that can support closed-loop robotic interaction and learning.
核心發現: 核心結果:These results highlight GaussTwin as a step toward unified, physically meaningful digital twins that can support closed-loop robotic interaction and learning.
Data-Driven Control of a Magnetically Actuated Fish-Like Robot
Authors: Akiyuki Koyama, Hiroaki Kawashima | Submitted: 2026-03-05 | arXiv: 2603.04787
Categories: cs.RO, eess.SY
Research Background: Magnetically actuated fish-like robots offer promising solutions for underwater exploration due to their miniaturization and agility; however, precise control remains a significant challenge because of nonlinear fluid dynamics, flexible fin hysteresis, and the variable-duration control steps inherent to the actuation mechanism. This paper proposes a comprehensive data-driven control framework to address these complexities without relying on analytical modeling.
研究背景: 在機器人學習領域,Magnetically actuated fish-like robots offer promising solutions for underwater exploration due to their miniaturization and agility; however, precise control remains a significant
Technical Approach: This paper proposes a comprehensive data-driven control framework to address these complexities without relying on analytical modeling. Our methodology comprises three core components: 1) developing a forward dynamics model (FDM) using a neural network trained on real-world experimental data to capture state transitions under varying time steps; 2) integrating this FDM into a gradient-based model predictive control (G-MPC) architecture to optimize control inputs for path following; and 3) applying imitation learning to approximate the G-MPC policy, thereby reducing the computational cost for real-time implementation.
技術方法: 本文提出的方法:This paper proposes a comprehensive data-driven control framework to address these complexities without relying on analytical modeling. Our methodology comprises three core components: 1) developing a
Key Takeaway: The results demonstrate that the G-MPC framework achieves accurate path convergence with minimal root mean square error (RMSE), and the imitation learning controller (ILC) effectively replicates this performance.
核心發現: 核心結果:The results demonstrate that the G-MPC framework achieves accurate path convergence with minimal root mean square error (RMSE), and the imitation learning controller (ILC) effectively replicates this
LEGS-POMDP: Language and Gesture-Guided Object Search in Partially Observable Environments
Authors: Ivy Xiao He, Stefanie Tellex, Jason Xinyu Liu | Submitted: 2026-03-05 | arXiv: 2603.04705
Categories: cs.RO, cs.HC
Research Background: To assist humans in open-world environments, robots must interpret ambiguous instructions to locate desired objects. Foundation model-based approaches excel at multimodal grounding, but they lack a principled mechanism for modeling uncertainty in long-horizon tasks.
研究背景: 在機器人學習領域,To assist humans in open-world environments, robots must interpret ambiguous instructions to locate desired objects. Foundation model-based approaches excel at multimodal grounding
Technical Approach: We introduce LanguagE and Gesture-Guided Object Search in Partially Observable Environments (LEGS-POMDP), a modular POMDP system that integrates language, gesture, and visual observations for open-world object search.
技術方法: 本文提出的方法:We introduce LanguagE and Gesture-Guided Object Search in Partially Observable Environments (LEGS-POMDP), a modular POMDP system that integrates language, gesture, and visual observations for open-wor
Key Takeaway: Finally, we demonstrate the full system on a quadruped mobile manipulator, where real-world experiments qualitatively validate robust multimodal perception and uncertainty reduction under ambiguous instructions.
核心發現: 核心結果:Finally, we demonstrate the full system on a quadruped mobile manipulator, where real-world experiments qualitatively validate robust multimodal perception and uncertainty reduction under ambiguous in
RealWonder: Real-Time Physical Action-Conditioned Video Generation
Authors: Wei Liu, Ziyu Chen, Zizhang Li et al. | Submitted: 2026-03-05 | arXiv: 2603.05449
Categories: cs.CV, cs.AI, cs.GR
Research Background: Current video generation models cannot simulate physical consequences of 3D actions like forces and robotic manipulations, as they lack structural understanding of how actions affect 3D scenes. We present RealWonder, the first real-time system for action-conditioned video generation from a single image.
研究背景: 在機器人學習領域,Current video generation models cannot simulate physical consequences of 3D actions like forces and robotic manipulations, as they lack structural understanding of how actions affe
Technical Approach: We present RealWonder, the first real-time system for action-conditioned video generation from a single image. Our system achieves 13.2 FPS at 480x832 resolution, enabling interactive exploration of forces, robot actions, and camera controls on rigid objects, deformable bodies, fluids, and granular materials.
技術方法: 本文提出的方法:We present RealWonder, the first real-time system for action-conditioned video generation from a single image. Our system achieves 13.2 FPS at 480x832 resolution, enabling interactive exploration of f
Key Takeaway: Our system achieves 13.2 FPS at 480x832 resolution, enabling interactive exploration of forces, robot actions, and camera controls on rigid objects, deformable bodies, fluids, and granular materials.
核心發現: 核心結果:Our system achieves 13.2 FPS at 480x832 resolution, enabling interactive exploration of forces, robot actions, and camera controls on rigid objects, deformable bodies, fluids, and granular materials.
Collaborative Planning with Concurrent Synchronization for Operationally Constrained UAV-UGV Teams
Authors: Zihao Deng, Qianhuang Li, Peng Gao et al. | Submitted: 2026-03-06 | arXiv: 2603.06898
Categories: cs.RO
Research Background: Collaborative planning under operational constraints is an essential capability for heterogeneous robot teams tackling complex large-scale real-world tasks. Unmanned Aerial Vehicles (UAVs) offer rapid environmental coverage, but flight time is often limited by energy constraints, whereas Unmanned Ground Vehicles (UGVs) have greater energy capacity to support long-duration missions, but movement is constrained by traversable terrain.
研究背景: 在機器人學習領域,Collaborative planning under operational constraints is an essential capability for heterogeneous robot teams tackling complex large-scale real-world tasks. Unmanned Aerial Vehicle
Technical Approach: To enable these capabilities, we propose Collaborative Planning with Concurrent Synchronization (CoPCS), a learning-based approach that integrates a heterogeneous graph transformer for operationally constrained task encoding with a transformer decoder for joint, synchronized co-planning that enables UAVs and UGVs to act concurrently in a coordinated manner. Experimental results demonstrate that our method provides the novel multi-robot capability of synchronized concurrent co-planning and substantially improves team performance.
技術方法: 本文提出的方法:To enable these capabilities, we propose Collaborative Planning with Concurrent Synchronization (CoPCS), a learning-based approach that integrates a heterogeneous graph transformer for operationally c
Key Takeaway: Experimental results demonstrate that our method provides the novel multi-robot capability of synchronized concurrent co-planning and substantially improves team performance.
核心發現: 核心結果:Experimental results demonstrate that our method provides the novel multi-robot capability of synchronized concurrent co-planning and substantially improves team performance.
MotionBits: Video Segmentation through Motion-Level Analysis of Rigid Bodies
Authors: Howard H. Qian, Kejia Ren, Yu Xiang et al. | Submitted: 2026-03-06 | arXiv: 2603.06846
Categories: cs.CV, cs.RO
Research Background: Rigid bodies constitute the smallest manipulable elements in the real world, and understanding how they physically interact is fundamental to embodied reasoning and robotic manipulation. Thus, accurate detection, segmentation, and tracking of moving rigid bodies is essential for enabling reasoning modules to interpret and act in diverse environments.
研究背景: 在機器人學習領域,Rigid bodies constitute the smallest manipulable elements in the real world, and understanding how they physically interact is fundamental to embodied reasoning and robotic manipul
Technical Approach: To address this gap, we introduce MotionBit, a novel concept that, unlike prior formulations, defines the smallest unit in motion-based segmentation through kinematic spatial twist equivalence, independent of semantics. In this paper, we contribute (1) the MotionBit concept and definition, (2) a hand-labeled benchmark, called MoRiBo, for evaluating moving rigid-body segmentation across robotic manipulation and human-in-the-wild videos, and (3) a learning-free graph-based MotionBits segmentation method that outperforms state-of-the-art embodied perception methods by 37.3% in macro-averaged mIoU on the MoRiBo benchmark.
技術方法: 本文提出的方法:To address this gap, we introduce MotionBit, a novel concept that, unlike prior formulations, defines the smallest unit in motion-based segmentation through kinematic spatial twist equivalence, indepe
Key Takeaway: Finally, we demonstrate the effectiveness of MotionBits segmentation for downstream embodied reasoning and manipulation tasks, highlighting its importance as a fundamental primitive for understanding physical interactions.
核心發現: 核心結果:Finally, we demonstrate the effectiveness of MotionBits segmentation for downstream embodied reasoning and manipulation tasks, highlighting its importance as a fundamental primitive for understanding
A Multi-Layer Sim-to-Real Framework for Gaze-Driven Assistive Neck Exoskeletons
Authors: Colin Rubow, Eric Brewer, Ian Bales et al. | Submitted: 2026-03-06 | arXiv: 2603.06779
Categories: cs.RO
Research Background: Dropped head syndrome, caused by neck muscle weakness from neurological diseases, severely impairs an individual’s ability to support and move their head, causing pain and making everyday tasks challenging. Our long-term goal is to develop an assistive powered neck exoskeleton that restores natural movement.
研究背景: 在機器人學習領域,Dropped head syndrome, caused by neck muscle weakness from neurological diseases, severely impairs an individual’s ability to support and move their head, causing pain and making e
Technical Approach: We leverage virtual reality (VR) to collect coupled eye and head movement data from healthy individuals to train models capable of predicting head movement based solely on eye gaze.
技術方法: 本文提出的方法:We leverage virtual reality (VR) to collect coupled eye and head movement data from healthy individuals to train models capable of predicting head movement based solely on eye gaze.
Key Takeaway: Our work demonstrates the utility of VR-based evaluation for accelerating the development of intuitive, safe, and personalized assistive robots.
核心發現: 核心結果:Our work demonstrates the utility of VR-based evaluation for accelerating the development of intuitive, safe, and personalized assistive robots.
HybridMimic: Hybrid RL-Centroidal Control for Humanoid Motion Mimicking
Authors: Ludwig Chee-Ying Tay, I-Chia Chang, Yan Gu | Submitted: 2026-03-06 | arXiv: 2603.06775
Categories: cs.RO
Research Background: Motion mimicking, i.e., encouraging the control policy to mimic human motion, facilitates the learning of complex tasks via reinforcement learning (RL) for humanoid robots. Although standard RL frameworks demonstrate impressive locomotion agility, they often bypass explicit reasoning about robot dynamics during deployment, which is a design choice that can lead to physically infeasible commands when the robot encounters out-of-distribution environments.
研究背景: 在機器人學習領域,Motion mimicking, i.e., encouraging the control policy to mimic human motion, facilitates the learning of complex tasks via reinforcement learning (RL) for humanoid robots. Althoug
Technical Approach: This paper introduces HybridMimic, a framework in which a learned policy dynamically modulates a centroidal-model-based controller by predicting continuous contact states and desired centroidal velocities.
技術方法: 本文提出的方法:This paper introduces HybridMimic, a framework in which a learned policy dynamically modulates a centroidal-model-based controller by predicting continuous contact states and desired centroidal veloci
Key Takeaway: Through hardware experiments on the Booster T1 humanoid, HybridMimic reduces the average base position tracking error by 13% compared to a state-of-the-art RL baseline, demonstrating the robustness of dynamics-aware deployment.
核心發現: 核心結果:Through hardware experiments on the Booster T1 humanoid, HybridMimic reduces the average base position tracking error by 13% compared to a state-of-the-art RL baseline, demonstrating the robustness o
Stability-Guided Exploration for Diverse Motion Generation
Authors: Eckart Cobo-Briesewitz, Tilman Burghoff, Denis Shcherba et al. | Submitted: 2026-03-06 | arXiv: 2603.06773
Categories: cs.RO
Research Background: Scaling up datasets is highly effective in improving the performance of deep learning models, including in the field of robot learning. However, data collection still proves to be a bottleneck.
研究背景: 在機器人學習領域,Scaling up datasets is highly effective in improving the performance of deep learning models, including in the field of robot learning. However, data collection still proves to be
Technical Approach: In this work, we propose a novel method capable of finding diverse long-horizon manipulations through black-box simulation.
技術方法: 本文提出的方法:In this work, we propose a novel method capable of finding diverse long-horizon manipulations through black-box simulation.
Key Takeaway: We demonstrate the method’s ability to discover diverse manipulation strategies, including pushing, grasping, pivoting, throwing, and tool use, across different robot morphologies, without task-specific guidance.
核心發現: 核心結果:We demonstrate the method’s ability to discover diverse manipulation strategies, including pushing, grasping, pivoting, throwing, and tool use, across different robot morphologies, without task-specif
History-Conditioned Spatio-Temporal Visual Token Pruning for Efficient Vision-Language Navigation
Authors: Qitong Wang, Yijun Liang, Ming Li et al. | Submitted: 2026-03-06 | arXiv: 2603.06480
Categories: cs.RO
Research Background: Vision-Language Navigation (VLN) enables robots to follow natural-language instructions in visually grounded environments, serving as a key capability for embodied robotic systems. Recent Vision-Language-Action (VLA) models have demonstrated strong navigation performance, but their high computational cost introduces latency that limits real-time deployment.
研究背景: 在機器人學習領域,Vision-Language Navigation (VLN) enables robots to follow natural-language instructions in visually grounded environments, serving as a key capability for embodied robotic systems.
Technical Approach: We propose a training-free spatio-temporal vision token pruning framework tailored to VLA-based VLN. Through experiments on standard VLN benchmarks, we confirm that our method significantly outperforms existing pruning strategies.
技術方法: 本文提出的方法:We propose a training-free spatio-temporal vision token pruning framework tailored to VLA-based VLN. Through experiments on standard VLN benchmarks, we confirm that our method significantly outperform
Key Takeaway: Through experiments on standard VLN benchmarks, we confirm that our method significantly outperforms existing pruning strategies.
核心發現: 核心結果:Through experiments on standard VLN benchmarks, we confirm that our method significantly outperforms existing pruning strategies.
Data Analogies Enable Efficient Cross-Embodiment Transfer
Authors: Jonathan Yang, Chelsea Finn, Dorsa Sadigh | Submitted: 2026-03-06 | arXiv: 2603.06450
Categories: cs.RO
Research Background: Generalist robot policies are trained on demonstrations collected across a wide variety of robots, scenes, and viewpoints. Yet it remains unclear how to best organize and scale such heterogeneous data so that it genuinely improves performance in a given target setting.
研究背景: 在機器人學習領域,Generalist robot policies are trained on demonstrations collected across a wide variety of robots, scenes, and viewpoints. Yet it remains unclear how to best organize and scale suc
Technical Approach: Yet it remains unclear how to best organize and scale such heterogeneous data so that it genuinely improves performance in a given target setting. In this work, we ask: what form of demonstration data is most useful for enabling transfer across robot set-ups? We conduct controlled experiments that vary end-effector morphology, robot platform appearance, and camera perspective, and compare the effects of simply scaling the number of demonstrations against systematically broadening the diversity in different ways.
技術方法: 本文提出的方法:Yet it remains unclear how to best organize and scale such heterogeneous data so that it genuinely improves performance in a given target setting. In this work, we ask: what form of demonstration data
Key Takeaway: Informed by the simulation results, we improve real-world cross-embodiment transfer success by an average of over large-scale, unpaired datasets by changing only the composition of the data.
核心發現: 核心結果:Informed by the simulation results, we improve real-world cross-embodiment transfer success by an average of over large-scale, unpaired datasets by changing only the composition of the data.
Towards Robotic Lake Maintenance: Integrating SONAR and Satellite Data to Assist Human Operators
Authors: Ahmed H. Elsayed, Christoph Manss, Tarek A. El-Mihoub et al. | Submitted: 2026-03-06 | arXiv: 2603.06266
Categories: cs.RO
Research Background: Artificial Water Bodies (AWBs) are human-made systems that require continuous monitoring due to their artificial biological processes. These systems demand regular maintenance to manage their ecosystems effectively.
研究背景: 在機器人學習領域,Artificial Water Bodies (AWBs) are human-made systems that require continuous monitoring due to their artificial biological processes. These systems demand regular maintenance to m
Technical Approach: This paper proposes a two-step approach to support targeted weed harvesting for the maintenance of artificial lakes. The first step is the initial detection of Submerged Aquatic Vegetation (SAV), also referred to in this paper as areas of interest, is performed using satellite-derived indices, specifically the Aquatic Plants and Algae (APA) index, which highlights submerged vegetation in water bodies.
技術方法: 本文提出的方法:This paper proposes a two-step approach to support targeted weed harvesting for the maintenance of artificial lakes. The first step is the initial detection of Submerged Aquatic Vegetation (SAV), also
Key Takeaway: Preliminary results demonstrate the feasibility of integrating satellite imagery and underwater acoustic sensing to improve vegetation management in artificial lakes.
核心發現: 核心結果:Preliminary results demonstrate the feasibility of integrating satellite imagery and underwater acoustic sensing to improve vegetation management in artificial lakes.
Few-Shot Neural Differentiable Simulator: Real-to-Sim Rigid-Contact Modeling
Authors: Zhenhao Huang, Siyuan Luo, Bingyang Zhou et al. | Submitted: 2026-03-06 | arXiv: 2603.06218
Categories: cs.RO
Research Background: Accurate physics simulation is essential for robotic learning and control, yet analytical simulators often fail to capture complex contact dynamics, while learning-based simulators typically require large amounts of costly real-world data. To bridge this gap, we propose a few-shot real-to-sim approach that combines the physical consistency of analytical formulations with the representational capacity of graph neural network (GNN)-based models.
研究背景: 在機器人學習領域,Accurate physics simulation is essential for robotic learning and control, yet analytical simulators often fail to capture complex contact dynamics, while learning-based simulators
Technical Approach: To bridge this gap, we propose a few-shot real-to-sim approach that combines the physical consistency of analytical formulations with the representational capacity of graph neural network (GNN)-based models. Using only a small amount of real-world data, our method calibrates analytical simulators to generate large-scale synthetic datasets that capture diverse contact interactions. On this foundation, we introduce a mesh-based GNN that implicitly models rigid-body forward dynamics and derive surrogate gradients for collision detection, achieving full differentiability.
技術方法: 本文提出的方法:To bridge this gap, we propose a few-shot real-to-sim approach that combines the physical consistency of analytical formulations with the representational capacity of graph neural network (GNN)-based
Key Takeaway: Extensive experiments show that our framework not only improves simulation fidelity with minimal supervision but also increases the efficiency of policy learning.
核心發現: 核心結果:Extensive experiments show that our framework not only improves simulation fidelity with minimal supervision but also increases the efficiency of policy learning.
KISS-IMU: Self-supervised Inertial Odometry with Motion-balanced Learning and Uncertainty-aware Inference
Authors: Jiwon Choi, Hogyun Kim, Geonmo Yang et al. | Submitted: 2026-03-06 | arXiv: 2603.06205
Categories: cs.RO
Research Background: Inertial measurement units (IMUs), which provide high-frequency linear acceleration and angular velocity measurements, serve as fundamental sensing modalities in robotic systems. Recent advances in deep neural networks have led to remarkable progress in inertial odometry.
研究背景: 在機器人學習領域,Inertial measurement units (IMUs), which provide high-frequency linear acceleration and angular velocity measurements, serve as fundamental sensing modalities in robotic systems. R
Technical Approach: We propose KISS-IMU, a novel self-supervised inertial odometry framework that eliminates ground truth dependency by leveraging simple LiDAR-based ICP registration and pose graph optimization as a supervisory signal. Our approach embodies two key principles: keeping the IMU stable through motion-aware balanced training and keeping the IMU strong through uncertainty-driven adaptive weighting during inference.
技術方法: 本文提出的方法:We propose KISS-IMU, a novel self-supervised inertial odometry framework that eliminates ground truth dependency by leveraging simple LiDAR-based ICP registration and pose graph optimization as a supe
Key Takeaway: To evaluate performance across diverse motion patterns and scenarios, we conducted comprehensive experiments on various real-world platforms, including quadruped robots.
核心發現: 核心結果:To evaluate performance across diverse motion patterns and scenarios, we conducted comprehensive experiments on various real-world platforms, including quadruped robots.
DreamToNav: Generalizable Navigation for Robots via Generative Video Planning
Authors: Valerii Serpiva, Jeffrin Sam, Chidera Simon et al. | Submitted: 2026-03-06 | arXiv: 2603.06190
Categories: cs.RO
Research Background: We present DreamToNav, a novel autonomous robot framework that uses generative video models to enable intuitive, human-in-the-loop control. Instead of relying on rigid waypoint navigation, users provide natural language prompts (e.g. “Follow the person carefully”), which the system translates into executable motion.
研究背景: 在機器人學習領域,We present DreamToNav, a novel autonomous robot framework that uses generative video models to enable intuitive, human-in-the-loop control. Instead of relying on rigid waypoint nav
Technical Approach: We present DreamToNav, a novel autonomous robot framework that uses generative video models to enable intuitive, human-in-the-loop control.
技術方法: 本文提出的方法:We present DreamToNav, a novel autonomous robot framework that uses generative video models to enable intuitive, human-in-the-loop control.
Key Takeaway: These results demonstrate that trajectories extracted from generative video predictions can be reliably executed on physical robots across different locomotion platforms.
核心發現: 核心結果:These results demonstrate that trajectories extracted from generative video predictions can be reliably executed on physical robots across different locomotion platforms.
RODEO: RObotic DEcentralized Organization
Authors: Milan Groshev, Eduardo Castelló Ferrer | Submitted: 2026-03-06 | arXiv: 2603.06058
Categories: cs.RO
Research Background: Robots are improving their autonomy with minimal human supervision. However, auditable actions, transparent decision processes, and new human-robot interaction models are still missing requirements to achieve extended robot autonomy.
研究背景: 在機器人學習領域,Robots are improving their autonomy with minimal human supervision. However, auditable actions, transparent decision processes, and new human-robot interaction models are still mis
Technical Approach: To tackle these challenges, we propose RODEO (RObotic DEcentralized Organization), a blockchain-based framework that integrates trust and accountability mechanisms for robots. This paper formalizes Decentralized Autonomous Organizations (DAOs) for service robots.
技術方法: 本文提出的方法:To tackle these challenges, we propose RODEO (RObotic DEcentralized Organization), a blockchain-based framework that integrates trust and accountability mechanisms for robots. This paper formalizes De
Key Takeaway: The results of this research give insights about how robots and organizations can coordinate tasks and payments with auditable execution proofs and on-chain settlement.
核心發現: 核心結果:The results of this research give insights about how robots and organizations can coordinate tasks and payments with auditable execution proofs and on-chain settlement.
Moving Through Clutter: Scaling Data Collection and Benchmarking for 3D Scene-Aware Humanoid Locomotion via Virtual Reality
Authors: Beichen Wang, Yuanjie Lu, Linji Wang et al. | Submitted: 2026-03-06 | arXiv: 2603.05993
Categories: cs.RO
Research Background: Recent advances in humanoid locomotion have enabled dynamic behaviors such as dancing, martial arts, and parkour, yet these capabilities are predominantly demonstrated in open, flat, and obstacle-free settings. In contrast, real-world environments such as homes, offices, and public spaces, are densely cluttered, three-dimensional, and geometrically constrained, requiring scene-aware whole-body coordination, precise balance control, and reasoning over spatial constraints imposed by furniture and household objects.
研究背景: 在機器人學習領域,Recent advances in humanoid locomotion have enabled dynamic behaviors such as dancing, martial arts, and parkour, yet these capabilities are predominantly demonstrated in open, fla
Technical Approach: To address this gap, we present Moving Through Clutter (MTC), an opensource Virtual Reality (VR) based data collection and evaluation framework for scene-aware humanoid locomotion in cluttered environments. Our system procedurally generates scenes with controllable clutter levels and captures embodiment-consistent, whole-body human motion through immersive VR navigation, which is then automatically retargeted to a humanoid robot model.
技術方法: 本文提出的方法:To address this gap, we present Moving Through Clutter (MTC), an opensource Virtual Reality (VR) based data collection and evaluation framework for scene-aware humanoid locomotion in cluttered environ
Key Takeaway: To address this gap, we present Moving Through Clutter (MTC), an opensource Virtual Reality (VR) based data collection and evaluation framework for scene-aware humanoid locomotion in cluttered environments.
核心發現: 核心結果:To address this gap, we present Moving Through Clutter (MTC), an opensource Virtual Reality (VR) based data collection and evaluation framework for scene-aware humanoid locomotion in cluttered environ
Systematic Evaluation of Novel View Synthesis for Video Place Recognition
Authors: Muhammad Zawad Mahmud, Samiha Islam, Damian Lyons | Submitted: 2026-03-06 | arXiv: 2603.05876
Categories: cs.CV, cs.RO
Research Background: The generation of synthetic novel views has the potential to positively impact robot navigation in several ways. In image-based navigation, a novel overhead view generated from a scene taken by a ground robot could be used to guide an aerial robot to that location.
研究背景: 在機器人學習領域,The generation of synthetic novel views has the potential to positively impact robot navigation in several ways. In image-based navigation, a novel overhead view generated from a s
Technical Approach: This paper presents a systematic evaluation of synthetic novel views in VPR using five public VPR image databases and seven typical image similarity methods.
技術方法: 本文提出的方法:This paper presents a systematic evaluation of synthetic novel views in VPR using five public VPR image databases and seven typical image similarity methods.
Key Takeaway: We find that for larger additions, the magnitude of viewpoint change is less important than the number of views added and the type of imagery in the dataset.
核心發現: 核心結果:We find that for larger additions, the magnitude of viewpoint change is less important than the number of views added and the type of imagery in the dataset.
ODD-SEC: Onboard Drone Detection with a Spinning Event Camera
Authors: Kuan Dai, Hongxin Zhang, Sheng Zhong et al. | Submitted: 2026-03-06 | arXiv: 2603.06265
Categories: cs.CV
Research Background: The rapid proliferation of drones requires balancing innovation with regulation. To address security and privacy concerns, techniques for drone detection have attracted significant attention.Passive solutions, such as frame camera-based systems, offer versatility and energy efficiency under typical conditions but are fundamentally constrained by their operational principles in scenarios involving fast-moving targets or adverse illumination.Inspired by biological vision, event cameras asynchronously detect per-pixel brightness changes, offering high dynamic range and microsecond-level responsiveness that make them uniquely suited for drone detection in conditions beyond the reach of conventional frame-based cameras.However, the design of most existing event-based solutions assumes a static camera, greatly limiting their applicability to moving carriers—such as quadrupedal robots or unmanned ground vehicles—during field operations.In this paper, we introduce a real-time drone detection system designed for deployment on moving carriers.
研究背景: 在機器人學習領域,The rapid proliferation of drones requires balancing innovation with regulation. To address security and privacy concerns, techniques for drone detection have attracted significant
Technical Approach: To address security and privacy concerns, techniques for drone detection have attracted significant attention.Passive solutions, such as frame camera-based systems, offer versatility and energy efficiency under typical conditions but are fundamentally constrained by their operational principles in scenarios involving fast-moving targets or adverse illumination.Inspired by biological vision, event cameras asynchronously detect per-pixel brightness changes, offering high dynamic range and microsecond-level responsiveness that make them uniquely suited for drone detection in conditions beyond the reach of conventional frame-based cameras.However, the design of most existing event-based solutions assumes a static camera, greatly limiting their applicability to moving carriers—such as quadrupedal robots or unmanned ground vehicles—during field operations.In this paper, we introduce a real-time drone detection system designed for deployment on moving carriers.
技術方法: 本文提出的方法:To address security and privacy concerns, techniques for drone detection have attracted significant attention.Passive solutions, such as frame camera-based systems, offer versatility and energy effici
Key Takeaway: Outdoor experimental results validate reliable detection with a mean angular error below 2° under challenging conditions, underscoring its suitability for real-world surveillance applications.
核心發現: 核心結果:Outdoor experimental results validate reliable detection with a mean angular error below 2° under challenging conditions, underscoring its suitability for real-world surveillance applications.
A Distributed Gaussian Process Model for Multi-Robot Mapping
Authors: Seth Nabarro, Mark van der Wilk, Andrew J. Davison | Submitted: 2026-03-07 | arXiv: 2603.07351
Categories: cs.RO, cs.LG, stat.ML
Research Background: We propose DistGP: a multi-robot learning method for collaborative learning of a global function using only local experience and computation. We utilise a sparse Gaussian process (GP) model with a factorisation that mirrors the multi-robot structure of the task, and admits distributed training via Gaussian belief propagation (GBP).
研究背景: 在機器人學習領域,We propose DistGP: a multi-robot learning method for collaborative learning of a global function using only local experience and computation. We utilise a sparse Gaussian process (
Technical Approach: We propose DistGP: a multi-robot learning method for collaborative learning of a global function using only local experience and computation.
技術方法: 本文提出的方法:We propose DistGP: a multi-robot learning method for collaborative learning of a global function using only local experience and computation.
Key Takeaway: Last, we compare to DiNNO \cite{yu2022dinno}, a distributed neural network (NN) optimiser, and find DistGP achieves superior accuracy, is more robust to sparse communication and is better able to learn continually.
核心發現: 核心結果:Last, we compare to DiNNO \cite{yu2022dinno}, a distributed neural network (NN) optimiser, and find DistGP achieves superior accuracy, is more robust to sparse communication and is better able to lear
Learning From Failures: Efficient Reinforcement Learning Control with Episodic Memory
Authors: Chenyang Miao | Submitted: 2026-03-07 | arXiv: 2603.07110
Categories: cs.RO
Research Background: Reinforcement learning has achieved remarkable success in robot learning. However, under challenging exploration and contact-rich dynamics, early-stage training is frequently dominated by premature terminations such as collisions and falls.
研究背景: 在機器人學習領域,Reinforcement learning has achieved remarkable success in robot learning. However, under challenging exploration and contact-rich dynamics, early-stage training is frequently domin
Technical Approach: To alleviate this issue, we propose a technique called Failure Episodic Memory Alert (FEMA).
技術方法: 本文提出的方法:To alleviate this issue, we propose a technique called Failure Episodic Memory Alert (FEMA).
Key Takeaway: Furthermore, integrating FEMA into a parallelized PPO training pipeline demonstrates its effectiveness on a real-world bipedal robot task.
核心發現: 核心結果:Furthermore, integrating FEMA into a parallelized PPO training pipeline demonstrates its effectiveness on a real-world bipedal robot task.
VLN-Cache: Enabling Token Caching for VLN Models with Visual/Semantic Dynamics Awareness
Authors: Zihao Zheng, Zhihao Mao, Xingyue Zhou et al. | Submitted: 2026-03-07 | arXiv: 2603.07080
Categories: cs.RO, cs.LG
Research Background: Vision-and-Language Navigation (VLN) increasingly relies on large vision-language models, but their inference cost conflicts with real-time deployment. Token caching is a promising training-free strategy that avoids redundant computation by reusing stable visual tokens across frames.
研究背景: 在機器人學習領域,Vision-and-Language Navigation (VLN) increasingly relies on large vision-language models, but their inference cost conflicts with real-time deployment. Token caching is a promising
Technical Approach: We propose VLN-Cache, a visual-dynamic-aware and semantic-dynamic-aware caching framework that introduces view-aligned remapping to recover geometric correspondences and a task-relevance saliency filter to veto reuse at semantic transitions.
技術方法: 本文提出的方法:We propose VLN-Cache, a visual-dynamic-aware and semantic-dynamic-aware caching framework that introduces view-aligned remapping to recover geometric correspondences and a task-relevance saliency filt
Key Takeaway: Experiments on the R2R-CE simulation benchmark show up to 1.52x speedup while maintaining competitive navigation success rates.
核心發現: 核心結果:Experiments on the R2R-CE simulation benchmark show up to 1.52x speedup while maintaining competitive navigation success rates.
Morphology-Independent Facial Expression Imitation for Human-Face Robots
Authors: Xu Chen, Rui Gao, Che Sun et al. | Submitted: 2026-03-07 | arXiv: 2603.07068
Categories: cs.RO
Research Background: Accurate facial expression imitation on human-face robots is crucial for achieving natural human-robot interaction. Most existing methods have achieved photorealistic expression imitation through mapping 2D facial landmarks to a robot’s actuator commands.
研究背景: 在機器人學習領域,Accurate facial expression imitation on human-face robots is crucial for achieving natural human-robot interaction. Most existing methods have achieved photorealistic expression im
Technical Approach: In this paper, we propose a morphology-independent expression imitation method that decouples expressions from facial morphology to eliminate morphological influence and produce more realistic expressions for human-face robots. Extensive experiments demonstrate that our method enables the human-face robot to reproduce a wide range of human-like expressions effectively.
技術方法: 本文提出的方法:In this paper, we propose a morphology-independent expression imitation method that decouples expressions from facial morphology to eliminate morphological influence and produce more realistic express
Key Takeaway: Extensive experiments demonstrate that our method enables the human-face robot to reproduce a wide range of human-like expressions effectively.
核心發現: 核心結果:Extensive experiments demonstrate that our method enables the human-face robot to reproduce a wide range of human-like expressions effectively.
SSP: Safety-guaranteed Surgical Policy via Joint Optimization of Behavioral and Spatial Constraints
Authors: Jianshu Hu, ZhiYuan Guan, Lei Song et al. | Submitted: 2026-03-07 | arXiv: 2603.07032
Categories: cs.RO
Research Background: The paradigm of robot-assisted surgery is shifting toward data-driven autonomy, where policies learned via Reinforcement Learning (RL) or Imitation Learning (IL) enable the execution of complex tasks. However, these “black-box” policies often lack formal safety guarantees, a critical requirement for clinical deployment.
研究背景: 在機器人學習領域,The paradigm of robot-assisted surgery is shifting toward data-driven autonomy, where policies learned via Reinforcement Learning (RL) or Imitation Learning (IL) enable the executi
Technical Approach: In this paper, we propose the Safety-guaranteed Surgical Policy (SSP) framework to bridge the gap between data-driven generality and formal safety. Validation on in both the SurRoL simulation and da Vinci Research Kit (dVRK) demonstrates that our method achieves a near-zero constraint violation rate while maintaining high task success rates compared to unconstrained baselines.
技術方法: 本文提出的方法:In this paper, we propose the Safety-guaranteed Surgical Policy (SSP) framework to bridge the gap between data-driven generality and formal safety. Validation on in both the SurRoL simulation and da V
Key Takeaway: Validation on in both the SurRoL simulation and da Vinci Research Kit (dVRK) demonstrates that our method achieves a near-zero constraint violation rate while maintaining high task success rates compared to unconstrained baselines.
核心發現: 核心結果:Validation on in both the SurRoL simulation and da Vinci Research Kit (dVRK) demonstrates that our method achieves a near-zero constraint violation rate while maintaining high task success rates compa
Foundational World Models Accurately Detect Bimanual Manipulator Failures
Authors: Isaac R. Ward, Michelle Ho, Houjun Liu et al. | Submitted: 2026-03-07 | arXiv: 2603.06987
Categories: cs.RO, cs.AI
Research Background: Deploying visuomotor robots at scale is challenging due to the potential for anomalous failures to degrade performance, cause damage, or endanger human life. Bimanual manipulators are no exception; these robots have vast state spaces comprised of high-dimensional images and proprioceptive signals.
研究背景: 在機器人學習領域,Deploying visuomotor robots at scale is challenging due to the potential for anomalous failures to degrade performance, cause damage, or endanger human life. Bimanual manipulators
Technical Approach: To test these methods, we use the simulated Push-T environment and the Bimanual Cable Manipulation dataset, the latter of which we introduce in this work. We benchmark our methods against baselines from the anomaly detection and out-of-distribution detection literature, and show that our approach considerably outperforms statistical techniques. Furthermore, we show that our approach requires approximately one twentieth of the trainable parameters as the next-best learning-based approach, yet outperforms it by 3.8% in terms of failure detection rate, paving the way toward safely deploying manipulator robots in real-world environments where reliability is non-negotiable.
技術方法: 本文提出的方法:To test these methods, we use the simulated Push-T environment and the Bimanual Cable Manipulation dataset, the latter of which we introduce in this work. We benchmark our methods against baselines fr
Key Takeaway: Furthermore, we show that our approach requires approximately one twentieth of the trainable parameters as the next-best learning-based approach, yet outperforms it by 3.8% in terms of failure detection rate, paving the way toward safely deploying manipulator robots in real-world environments where reliability is non-negotiable.
核心發現: 核心結果:Furthermore, we show that our approach requires approximately one twentieth of the trainable parameters as the next-best learning-based approach, yet outperforms it by 3.8% in terms of failure detecti
Uncertainty Mitigation and Intent Inference: A Dual-Mode Human-Machine Joint Planning System
Authors: Zeyu Fang, Yuxin Lin, Cheng Liu et al. | Submitted: 2026-03-08 | arXiv: 2603.07822
Categories: cs.RO, cs.HC
Research Background: Effective human-robot collaboration in open-world environments requires joint planning under uncertain conditions. However, existing approaches often treat humans as passive supervisors, preventing autonomous agents from becoming human-like teammates that can actively model teammate behaviors, reason about knowledge gaps, query, and elicit responses through communication to resolve uncertainties.
研究背景: 在機器人學習領域,Effective human-robot collaboration in open-world environments requires joint planning under uncertain conditions. However, existing approaches often treat humans as passive superv
Technical Approach: To address these limitations, we propose a unified human-robot joint planning system designed to tackle dual sources of uncertainty: task-relevant knowledge gaps and latent human intent. Our system operates in two complementary modes.
技術方法: 本文提出的方法:To address these limitations, we propose a unified human-robot joint planning system designed to tackle dual sources of uncertainty: task-relevant knowledge gaps and latent human intent. Our system op
Key Takeaway: Experimental results demonstrate that the system significantly cuts the interaction cost by 51.9% in uncertainty-mitigation planning and reduces the task execution time by 25.4% in intent-aware cooperation compared to the baselines.
核心發現: 核心結果:Experimental results demonstrate that the system significantly cuts the interaction cost by 51.9% in uncertainty-mitigation planning and reduces the task execution time by 25.4% in intent-aware cooper
MWM: Mobile World Models for Action-Conditioned Consistent Prediction
Authors: Han Yan, Zishang Xiang, Zeyu Zhang et al. | Submitted: 2026-03-08 | arXiv: 2603.07799
Categories: cs.CV, cs.RO
Research Background: World models enable planning in imagined future predicted space, offering a promising framework for embodied navigation. However, existing navigation world models often lack action-conditioned consistency, so visually plausible predictions can still drift under multi-step rollout and degrade planning.
研究背景: 在機器人學習領域,World models enable planning in imagined future predicted space, offering a promising framework for embodied navigation. However, existing navigation world models often lack action
Technical Approach: To address these challenges, we propose MWM, a mobile world model for planning-based image-goal navigation. Specifically, we introduce a two-stage training framework that combines structure pretraining with Action-Conditioned Consistency (ACC) post-training to improve action-conditioned rollout consistency.
技術方法: 本文提出的方法:To address these challenges, we propose MWM, a mobile world model for planning-based image-goal navigation. Specifically, we introduce a two-stage training framework that combines structure pretrainin
Key Takeaway: Our experiments on benchmark and real-world tasks demonstrate consistent gains in visual fidelity, trajectory accuracy, planning success, and inference efficiency.
核心發現: 核心結果:Our experiments on benchmark and real-world tasks demonstrate consistent gains in visual fidelity, trajectory accuracy, planning success, and inference efficiency.
Residual Control for Fast Recovery from Dynamics Shifts
Authors: Nethmi Jayasinghe, Diana Gontero, Francesco Migliarba et al. | Submitted: 2026-03-08 | arXiv: 2603.07775
Categories: cs.RO
Research Background: Robotic systems operating in real-world environments inevitably encounter unobserved dynamics shifts during continuous execution, including changes in actuation, mass distribution, or contact conditions. When such shifts occur mid-episode, even locally stabilizing learned policies can experience substantial transient performance degradation.
研究背景: 在機器人學習領域,Robotic systems operating in real-world environments inevitably encounter unobserved dynamics shifts during continuous execution, including changes in actuation, mass distribution,
Technical Approach: We propose a stability-aligned residual control architecture in which a reinforcement learning policy trained under nominal dynamics remains fixed at deployment, and adaptation occurs exclusively through a bounded additive residual channel.
技術方法: 本文提出的方法:We propose a stability-aligned residual control architecture in which a reinforcement learning policy trained under nominal dynamics remains fixed at deployment, and adaptation occurs exclusively thro
Key Takeaway: Recovery time is reduced by \textbf{87%} on the Go1 quadruped, \textbf{48%} on the Cassie biped, \textbf{30%} on the H1 humanoid, and \textbf{20%} on the Scout wheeled platform on average across evaluated conditions relative to a frozen SAC policy.
核心發現: 核心結果:Recovery time is reduced by \textbf{87%} on the Go1 quadruped, \textbf{48%} on the Cassie biped, \textbf{30%} on the H1 humanoid, and \textbf{20%} on the Scout wheeled platform on average across e
AtomicVLA: Unlocking the Potential of Atomic Skill Learning in Robots
Authors: Likui Zhang, Tao Tang, Zhihao Zhan et al. | Submitted: 2026-03-08 | arXiv: 2603.07648
Categories: cs.RO, cs.AI, cs.CV
Research Background: Recent advances in Visual-Language-Action (VLA) models have shown promising potential for robotic manipulation tasks. However, real-world robotic tasks often involve long-horizon, multi-step problem-solving and require generalization for continual skill acquisition, extending beyond single actions or skills.
研究背景: 在機器人學習領域,Recent advances in Visual-Language-Action (VLA) models have shown promising potential for robotic manipulation tasks. However, real-world robotic tasks often involve long-horizon,
Technical Approach: To address these challenges, we propose AtomicVLA, a unified planning-and-execution framework that jointly generates task-level plans, atomic skill abstractions, and fine-grained actions. Furthermore, we introduce a flexible routing encoder that automatically assigns dedicated atomic experts to new skills, enabling continual learning. We validate our approach through extensive experiments.
技術方法: 本文提出的方法:To address these challenges, we propose AtomicVLA, a unified planning-and-execution framework that jointly generates task-level plans, atomic skill abstractions, and fine-grained actions. Furthermore,
Key Takeaway: These results highlight the effectiveness of atomic skill abstraction and dynamic expert composition for long-horizon and lifelong robotic tasks.
核心發現: 核心結果:These results highlight the effectiveness of atomic skill abstraction and dynamic expert composition for long-horizon and lifelong robotic tasks.
GeoLoco: Leveraging 3D Geometric Priors from Visual Foundation Model for Robust RGB-Only Humanoid Locomotion
Authors: Yufei Liu, Xieyuanli Chen, Hainan Pan et al. | Submitted: 2026-03-08 | arXiv: 2603.07624
Categories: cs.RO
Research Background: The prevailing paradigm of perceptive humanoid locomotion relies heavily on active depth sensors. However, this depth-centric approach fundamentally discards the rich semantic and dense appearance cues of the visual world, severing low-level control from the high-level reasoning essential for general embodied intelligence.
研究背景: 在機器人學習領域,The prevailing paradigm of perceptive humanoid locomotion relies heavily on active depth sensors. However, this depth-centric approach fundamentally discards the rich semantic and
Technical Approach: To break this deadlock, we propose GeoLoco, a purely RGB-driven locomotion framework that conceptualizes monocular images as high-dimensional 3D latent representations by harnessing the powerful geometric priors of a frozen, scale-aware Visual Foundation Model (VFM). Rather than naive feature concatenation, we design a proprioceptive-query multi-head cross-attention mechanism that dynamically attends to task-critical topological features conditioned on the robot’s real-time gait phase. Crucially, to prevent the policy from overfitting to superficial textures, we introduce a dual-head auxiliary learning scheme.
技術方法: 本文提出的方法:To break this deadlock, we propose GeoLoco, a purely RGB-driven locomotion framework that conceptualizes monocular images as high-dimensional 3D latent representations by harnessing the powerful geome
Key Takeaway: Trained exclusively in simulation, GeoLoco achieves robust zero-shot transfer to the Unitree G1 humanoid and successfully negotiates challenging terrains.
核心發現: 核心結果:Trained exclusively in simulation, GeoLoco achieves robust zero-shot transfer to the Unitree G1 humanoid and successfully negotiates challenging terrains.
InterReal: A Unified Physics-Based Imitation Framework for Learning Human-Object Interaction Skills
Authors: Dayang Liang, Yuhang Lin, Xinzhe Liu et al. | Submitted: 2026-03-08 | arXiv: 2603.07516
Categories: cs.RO, cs.AI
Research Background: Interaction is one of the core abilities of humanoid robots. However, most existing frameworks focus on non-interactive whole-body control, which limits their practical applicability.
研究背景: 在機器人學習領域,Interaction is one of the core abilities of humanoid robots. However, most existing frameworks focus on non-interactive whole-body control, which limits their practical applicabili
Technical Approach: In this work, we develop InterReal, a unified physics-based imitation learning framework for Real-world human-object Interaction (HOI) control. Second, we propose an automatic reward learner to address the challenge of large-scale reward shaping.
技術方法: 本文提出的方法:In this work, we develop InterReal, a unified physics-based imitation learning framework for Real-world human-object Interaction (HOI) control. Second, we propose an automatic reward learner to addres
Key Takeaway: Furthermore, we validate the framework on the real-world robot Unitree G1, which demonstrates its practical effectiveness and robustness beyond simulation.
核心發現: 核心結果:Furthermore, we validate the framework on the real-world robot Unitree G1, which demonstrates its practical effectiveness and robustness beyond simulation.
LITHE: Bridging Best-Effort Python and Real-Time C++ for Hot-Swapping Robotic Control Laws on Commodity Linux
Authors: He Kai Lim, Tyler R. Clites | Submitted: 2026-03-08 | arXiv: 2603.07442
Categories: cs.RO
Research Background: Modern robotic systems rely on hierarchical control, where a high-level “Brain” (Python) directs a lower-level “Spine” (C++ real-time controller). Despite its necessity, this hierarchy makes it difficult for the Brain to completely rewrite the Spine’s immutable control logic, consequently inhibiting fundamental adaptation for different tasks and environments.
研究背景: 在機器人學習領域,Modern robotic systems rely on hierarchical control, where a high-level “Brain” (Python) directs a lower-level “Spine” (C++ real-time controller). Despite its necessity, this hiera
Technical Approach: We present LITHE (Linux Isolated Threading for Hierarchical Execution), a lightweight software architecture that collapses the robot control hierarchy onto a commodity single-board computer (Raspberry Pi 4B with pi3hat), while maintaining safe frequency decoupling between the Brain and Spine.
技術方法: 本文提出的方法:We present LITHE (Linux Isolated Threading for Hierarchical Execution), a lightweight software architecture that collapses the robot control hierarchy onto a commodity single-board computer (Raspberry
Key Takeaway: We demonstrate a novel application where a large language model (LLM) supervisor performs online system identification to evolve a real-time controller on-the-fly, without interrupting the 1 kHz control loop.
核心發現: 核心結果:We demonstrate a novel application where a large language model (LLM) supervisor performs online system identification to evolve a real-time controller on-the-fly, without interrupting the 1 kHz contr
ProgAgent:A Continual RL Agent with Progress-Aware Rewards
Authors: Jinzhou Tan, Gabriel Adineera, Jinoh Kim | Submitted: 2026-03-08 | arXiv: 2603.07784
Categories: cs.LG, cs.AI
Research Background: We present ProgAgent, a continual reinforcement learning (CRL) agent that unifies progress-aware reward learning with a high-throughput, JAX-native system architecture. Lifelong robotic learning grapples with catastrophic forgetting and the high cost of reward specification.
研究背景: 在機器人學習領域,We present ProgAgent, a continual reinforcement learning (CRL) agent that unifies progress-aware reward learning with a high-throughput, JAX-native system architecture. Lifelong ro
Technical Approach: We present ProgAgent, a continual reinforcement learning (CRL) agent that unifies progress-aware reward learning with a high-throughput, JAX-native system architecture.
技術方法: 本文提出的方法:We present ProgAgent, a continual reinforcement learning (CRL) agent that unifies progress-aware reward learning with a high-throughput, JAX-native system architecture.
Key Takeaway: Evaluations on ContinualBench and Meta-World benchmarks highlight ProgAgent’s advantages: it markedly reduces forgetting, boosts learning speed, and outperforms key baselines in visual reward learning (e.g., Rank2Reward, TCN) and continual learning (e.g., Coreset, SI) - surpassing even an idealized perfect memory agent.
核心發現: 核心結果:Evaluations on ContinualBench and Meta-World benchmarks highlight ProgAgent’s advantages: it markedly reduces forgetting, boosts learning speed, and outperforms key baselines in visual reward learning
How Neurotypical and Autistic Children Interact Nonverbally with Anthropomorphic Agents in Open-Ended Tasks
Authors: Chuxuan Zhang, Bermet Burkanova, Lawrence H. Kim et al. | Submitted: 2026-03-08 | arXiv: 2603.07843
Categories: cs.HC
Research Background: What nonverbal behaviors should a robot respond to? Understanding how children-both neurotypical and autistic-engage with embodied artificial agents is critical for developing inclusive and socially interactive systems.
研究背景: 在機器人學習領域,What nonverbal behaviors should a robot respond to? Understanding how children-both neurotypical and autistic-engage with embodied artificial agents is critical for developing incl
Technical Approach: In this paper, we study “open-ended” unconstrained interactions with embodied agents, where little is known about how children behave nonverbally when given few instructions.
技術方法: 本文提出的方法:In this paper, we study “open-ended” unconstrained interactions with embodied agents, where little is known about how children behave nonverbally when given few instructions.
Key Takeaway: We also report the presence of repetitive face and hand movements, which should be considered in the development of nonverbally interactive artificial agents.
核心發現: 核心結果:We also report the presence of repetitive face and hand movements, which should be considered in the development of nonverbally interactive artificial agents.
GLASS: Graph and Vision-Language Assisted Semantic Shape Correspondence
Authors: Qinfeng Xiao, Guofeng Mei, Qilong Liu et al. | Submitted: 2026-03-08 | arXiv: 2603.07652
Categories: cs.CV
Research Background: Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However, learning these mappings without manual supervision remains a formidable challenge, particularly under severe non-isometric deformations and in inter-class settings where geometric cues are ambiguous.
研究背景: 在機器人學習領域,Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However,
Technical Approach: To address this, we present GLASS, a framework that bridges the gap by integrating geometric spectral analysis with rich semantic priors from vision-language foundation models.
技術方法: 本文提出的方法:To address this, we present GLASS, a framework that bridges the gap by integrating geometric spectral analysis with rich semantic priors from vision-language foundation models.
Key Takeaway: Specifically, it achieves average geodesic errors of 0.21, 4.5, and 5.6 on the inter-class benchmark SNIS and non-isometric benchmarks SMAL and TOPKIDS, reducing errors from URSSM baselines of 0.49, 6.0, and 8.9 by 57%, 25%, and 37%, respectively.
核心發現: 核心結果:Specifically, it achieves average geodesic errors of 0.21, 4.5, and 5.6 on the inter-class benchmark SNIS and non-isometric benchmarks SMAL and TOPKIDS, reducing errors from URSSM baselines of 0.49, 6
Diffusion-MPC in Discrete Domains: Feasibility Constraints, Horizon Effects, and Critic Alignment: Case study with Tetris
Authors: Haochuan Kevin Wang | Submitted: 2026-03-02 | arXiv: 2603.02348
Categories: cs.LG, cs.AI, cs.RO
Research Background: We study diffusion-based model predictive control (Diffusion-MPC) in discrete combinatorial domains using Tetris as a case study. Our planner samples candidate placement sequences with a MaskGIT-style discrete denoiser and selects actions via reranking.
研究背景: 在機器人學習領域,We study diffusion-based model predictive control (Diffusion-MPC) in discrete combinatorial domains using Tetris as a case study. Our planner samples candidate placement sequences
Technical Approach: Our planner samples candidate placement sequences with a MaskGIT-style discrete denoiser and selects actions via reranking. We analyze three key factors: (1) feasibility-constrained sampling via logit masking over valid placements, (2) reranking strategies using a heuristic score, a pretrained DQN critic, and a hybrid combination, and (3) compute scaling in candidate count and planning horizon. We find that feasibility masking is necessary in discrete domains, removing invalid action mass (46%) and yielding a 6.8% improvement in score and 5.6% improvement in survival over unconstrained sampling.
技術方法: 本文提出的方法:Our planner samples candidate placement sequences with a MaskGIT-style discrete denoiser and selects actions via reranking. We analyze three key factors: (1) feasibility-constrained sampling via logit
Key Takeaway: Shorter planning horizons outperform longer ones under sparse and delayed rewards, suggesting uncertainty compounding in long imagined rollouts.
核心發現: 核心結果:Shorter planning horizons outperform longer ones under sparse and delayed rewards, suggesting uncertainty compounding in long imagined rollouts.
From Leaderboard to Deployment: Code Quality Challenges in AV Perception Repositories
Authors: Mateus Karvat, Bram Adams, Sidney Givigi | Submitted: 2026-03-02 | arXiv: 2603.02194
Categories: cs.CV, cs.LG, cs.RO, cs.SE
Research Background: Autonomous vehicle (AV) perception models are typically evaluated solely on benchmark performance metrics, with limited attention to code quality, production readiness and long-term maintainability. This creates a significant gap between research excellence and real-world deployment in safety-critical systems subject to international safety standards.
研究背景: 在機器人學習領域,Autonomous vehicle (AV) perception models are typically evaluated solely on benchmark performance metrics, with limited attention to code quality, production readiness and long-ter
Technical Approach: To address this gap, we present the first large-scale empirical study of software quality in AV perception repositories, systematically analyzing 178 unique models from the KITTI and NuScenes 3D Object Detection leaderboards.
技術方法: 本文提出的方法:To address this gap, we present the first large-scale empirical study of software quality in AV perception repositories, systematically analyzing 178 unique models from the KITTI and NuScenes 3D Objec
Key Takeaway: Using static analysis tools (Pylint, Bandit, and Radon), we evaluated code errors, security vulnerabilities, maintainability, and development practices.
核心發現: 核心結果:Using static analysis tools (Pylint, Bandit, and Radon), we evaluated code errors, security vulnerabilities, maintainability, and development practices.
LAD-Drive: Bridging Language and Trajectory with Action-Aware Diffusion Transformers
Authors: Fabian Schmidt, Karol Fedurko, Markus Enzweiler et al. | Submitted: 2026-03-02 | arXiv: 2603.02035
Categories: cs.RO, cs.CV
Research Background: While multimodal large language models (MLLMs) provide advanced reasoning for autonomous driving, translating their discrete semantic knowledge into continuous trajectories remains a fundamental challenge. Existing methods often rely on unimodal planning heads that inherently limit their ability to represent multimodal driving behavior.
研究背景: 在機器人學習領域,While multimodal large language models (MLLMs) provide advanced reasoning for autonomous driving, translating their discrete semantic knowledge into continuous trajectories remains
Technical Approach: To resolve these limitations, we introduce LAD-Drive, a generative framework that structurally disentangles high-level intention from low-level spatial planning.
技術方法: 本文提出的方法:To resolve these limitations, we introduce LAD-Drive, a generative framework that structurally disentangles high-level intention from low-level spatial planning.
Key Takeaway: Extensive evaluations on the LangAuto benchmark demonstrate that LAD-Drive achieves state-of-the-art results, outperforming competitive baselines by up to 59% in Driving Score while significantly reducing route deviations and collisions.
核心發現: 核心結果:Extensive evaluations on the LangAuto benchmark demonstrate that LAD-Drive achieves state-of-the-art results, outperforming competitive baselines by up to 59% in Driving Score while significantly redu
Goal-Oriented Semantic Communication for ISAC-Enabled Robotic Obstacle Avoidance
Authors: Wenjie Liu, Yansha Deng, Henk Wymeersch | Submitted: 2026-03-02 | arXiv: 2603.02291
Categories: cs.RO
Research Background: We investigate an integrated sensing and communication (ISAC)-enabled BS for the unmanned aerial vehicle (UAV) obstacle avoidance task, and propose a goal-oriented semantic communication (GOSC) framework for the BS to transmit sensing and command and control (C&C) signals efficiently and effectively. Our GOSC framework establishes a closed loop for sensing-C&C generation-sensing and C&C transmission: For sensing, a Kalman filter (KF) is applied to continuously predict UAV positions, mitigating the reliance of UAV position acquisition on continuous sensing signal transmission, and enhancing position estimation accuracy through sensing-prediction fusion.
研究背景: 在機器人學習領域,We investigate an integrated sensing and communication (ISAC)-enabled BS for the unmanned aerial vehicle (UAV) obstacle avoidance task, and propose a goal-oriented semantic communi
Technical Approach: Based on the refined estimation position provided by the KF, we develop a Mahalanobis distance-based dynamic window approach (MD-DWA) to generate precise C&C signals under uncertainty, in which we derive the mathematical expression of the minimum Mahalanobis distance required to guarantee collision avoidance. Finally, for efficient sensing and C&C signal transmission, we propose an effectiveness-aware deep Q-network (E-DQN) to determine the transmission of sensing and C&C signals based on their value of information (VoI).
技術方法: 本文提出的方法:Based on the refined estimation position provided by the KF, we develop a Mahalanobis distance-based dynamic window approach (MD-DWA) to generate precise C&C signals under uncertainty, in which we der
Key Takeaway: Compared to the conventional ISAC transmission framework that transmits sensing and C&C signals at every time slot, GOSC achieves the same 100% task success rate while reducing the number of transmitted sensing and C&C signals by 92.4% and the number of transmission time slots by 85.5%.
核心發現: 核心結果:Compared to the conventional ISAC transmission framework that transmits sensing and C&C signals at every time slot, GOSC achieves the same 100% task success rate while reducing the number of transmitt
Event-Only Drone Trajectory Forecasting with RPM-Modulated Kalman Filtering
Authors: Hari Prasanth S. M., Pejman Habibiroudkenar, Eerik Alamikkotervo et al. | Submitted: 2026-03-02 | arXiv: 2603.01997
Categories: cs.CV, cs.RO, eess.IV
Research Background: Event cameras provide high-temporal-resolution visual sensing that is well suited for observing fast-moving aerial objects; however, their use for drone trajectory prediction remains limited. This work introduces an event-only drone forecasting method that exploits propeller-induced motion cues.
研究背景: 在機器人學習領域,Event cameras provide high-temporal-resolution visual sensing that is well suited for observing fast-moving aerial objects; however, their use for drone trajectory prediction remai
Technical Approach: This work introduces an event-only drone forecasting method that exploits propeller-induced motion cues. Propeller rotational speed are extracted directly from raw event data and fused within an RPM-aware Kalman filtering framework. Evaluations on the FRED dataset show that the proposed method outperforms learning-based approaches and vanilla kalman filter in terms of average distance error and final distance error at 0.4s and 0.8s forecasting horizons.
技術方法: 本文提出的方法:This work introduces an event-only drone forecasting method that exploits propeller-induced motion cues. Propeller rotational speed are extracted directly from raw event data and fused within an RPM-a
Key Takeaway: The results demonstrate robust and accurate short- and medium-horizon trajectory forecasting without reliance on RGB imagery or training data.
核心發現: 核心結果:The results demonstrate robust and accurate short- and medium-horizon trajectory forecasting without reliance on RGB imagery or training data.
Streaming Real-Time Trajectory Prediction Using Endpoint-Aware Modeling
Authors: Alexander Prutsch, David Schinagl, Horst Possegger | Submitted: 2026-03-02 | arXiv: 2603.01864
Categories: cs.CV, cs.RO
Research Background: Future trajectories of neighboring traffic agents have a significant influence on the path planning and decision-making of autonomous vehicles. While trajectory forecasting is a well-studied field, research mainly focuses on snapshot-based prediction, where each scenario is treated independently of its global temporal context.
研究背景: 在機器人學習領域,Future trajectories of neighboring traffic agents have a significant influence on the path planning and decision-making of autonomous vehicles. While trajectory forecasting is a we
Technical Approach: We leverage this continuous setting to propose a lightweight yet highly accurate streaming-based trajectory forecasting approach. Our approach efficiently guides its scene encoder to extract highly relevant context information without needing refinement iterations or segment-wise decoding. Our experiments highlight that our approach effectively relays information across consecutive timesteps.
技術方法: 本文提出的方法:We leverage this continuous setting to propose a lightweight yet highly accurate streaming-based trajectory forecasting approach. Our approach efficiently guides its scene encoder to extract highly re
Key Takeaway: We achieve state-of-the-art streaming trajectory prediction results on the Argoverse2 multi-agent and single-agent benchmarks, while requiring substantially fewer resources.2 multi-agent and single-agent benchmarks, while requiring substantially fewer resources.
核心發現: 核心結果:We achieve state-of-the-art streaming trajectory prediction results on the Argoverse
Tiny-DroNeRF: Tiny Neural Radiance Fields aboard Federated Learning-enabled Nano-drones
Authors: Ilenia Carboni, Elia Cereda, Lorenzo Lamberti et al. | Submitted: 2026-03-02 | arXiv: 2603.01850
Categories: cs.RO, cs.CV, eess.SY
Research Background: Sub-30g nano-sized aerial robots can leverage their agility and form factor to autonomously explore cluttered and narrow environments, like in industrial inspection and search and rescue missions. However, the price for their tiny size is a strong limit in their resources, i.e., sub-100 mW microcontroller units (MCUs) delivering 100 GOps/s at best, and memory budgets well below 100 MB.
研究背景: 在機器人學習領域,Sub-30g nano-sized aerial robots can leverage their agility and form factor to autonomously explore cluttered and narrow environments, like in industrial inspection and search and
Technical Approach: However, the price for their tiny size is a strong limit in their resources, i.e., sub-100 mW microcontroller units (MCUs) delivering 100 GOps/s at best, and memory budgets well below 100 MB. Despite these strict constraints, we aim to enable complex vision-based tasks aboard nano-drones, such as dense 3D scene reconstruction: a key robotic task underlying fundamental capabilities like spatial awareness and motion planning. Top-performing 3D reconstruction methods leverage neural radiance fields (NeRF) models, which require GBs of memory and massive computation, usually delivered by high-end GPUs consuming 100s of Watts.
技術方法: 本文提出的方法:However, the price for their tiny size is a strong limit in their resources, i.e., sub-100 mW microcontroller units (MCUs) delivering 100 GOps/s at best, and memory budgets well below 100 MB. De
Key Takeaway: Our experimental results show a 96% reduction in Tiny-DroNeRF’s memory footprint compared to Instant-NGP, with only a 5.7 dB drop in reconstruction accuracy.
核心發現: 核心結果:Our experimental results show a 96% reduction in Tiny-DroNeRF’s memory footprint compared to Instant-NGP, with only a 5.7 dB drop in reconstruction accuracy.
LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization
Authors: Kuangyi Chen, Jun Zhang, Yuxi Hu et al. | Submitted: 2026-03-02 | arXiv: 2603.01839
Categories: cs.CV, cs.RO
Research Background: Event cameras offer high-temporal-resolution sensing that remains reliable under high-speed motion and challenging lighting, making them promising for localization from LiDAR point clouds in GPS-denied and visually degraded environments. However, aligning sparse, asynchronous events with dense LiDAR maps is fundamentally ill-posed, as direct correspondence estimation suffers from modality gaps.
研究背景: 在機器人學習領域,Event cameras offer high-temporal-resolution sensing that remains reliable under high-speed motion and challenging lighting, making them promising for localization from LiDAR point
Technical Approach: We propose LEAR, a dual-task learning framework that jointly estimates edge structures and dense event-depth flow fields to bridge the sensing-modality divide.
技術方法: 本文提出的方法:We propose LEAR, a dual-task learning framework that jointly estimates edge structures and dense event-depth flow fields to bridge the sensing-modality divide.
Key Takeaway: On several popular and challenging datasets, LEAR achieves superior performance over the best prior method.
核心發現: 核心結果:On several popular and challenging datasets, LEAR achieves superior performance over the best prior method.
(hu)Man vs. Machine: In the Future of Motorsport, can Autonomous Vehicles Compete?
Authors: Armand Amaritei, Amber-Lily Blackadder, Sebastian Donnelly et al. | Submitted: 2026-03-02 | arXiv: 2603.01560
Categories: cs.RO
Research Background: Motorsport has historically driven technological innovation in the automotive industry. Autonomous racing provides a proving ground to push the limits of performance of autonomous vehicle (AV) systems.
研究背景: 在機器人學習領域,Motorsport has historically driven technological innovation in the automotive industry. Autonomous racing provides a proving ground to push the limits of performance of autonomous
Technical Approach: This paper evaluates whether the future of motorsport could encompass joint competition between humans and AVs.
技術方法: 本文提出的方法:This paper evaluates whether the future of motorsport could encompass joint competition between humans and AVs.
Key Takeaway: This paper evaluates whether the future of motorsport could encompass joint competition between humans and AVs.
核心發現: 核心結果:This paper evaluates whether the future of motorsport could encompass joint competition between humans and AVs.
RoboGPU: Accelerating GPU Collision Detection for Robotics
Authors: Lufei Liu, Liwei Xue, Youssef Mohammed et al. | Submitted: 2026-03-02 | arXiv: 2603.01517
Categories: cs.AR, cs.RO
Research Background: Autonomous robots are increasingly prevalent in our society, emerging in medical care, transportation vehicles, and home assistance. These robots rely on motion planning and collision detection to identify a sequence of movements allowing them to navigate to an end goal without colliding with the surrounding environment.
研究背景: 在機器人學習領域,Autonomous robots are increasingly prevalent in our society, emerging in medical care, transportation vehicles, and home assistance. These robots rely on motion planning and collis
Technical Approach: These robots rely on motion planning and collision detection to identify a sequence of movements allowing them to navigate to an end goal without colliding with the surrounding environment. While many specialized accelerators have been proposed to meet the real-time requirements of robotics planning tasks, they often lack the flexibility to adapt to the rapidly changing landscape of robotics and support future advancements. However, GPUs are well-positioned for robotics and we find that they can also tackle collision detection algorithms with enhancements to existing ray tracing accelerator (RTA) units.
技術方法: 本文提出的方法:These robots rely on motion planning and collision detection to identify a sequence of movements allowing them to navigate to an end goal without colliding with the surrounding environment. While many
Key Takeaway: RoboCore is also useful for other robotics tasks, achieving 3.6 speedup on a state-of-the-art neural motion planner and 1.1 speedup on Monte Carlo Localization compared to a baseline GPU.
核心發現: 核心結果:RoboCore is also useful for other robotics tasks, achieving 3.6 speedup on a state-of-the-art neural motion planner and 1.1 speedup on Monte Carlo Localization compared to a baseline G
D-GVIO: A Buffer-Driven and Efficient Decentralized GNSS-Visual-Inertial State Estimator for Multi-Agent Systems
Authors: Yarong Luo, Wentao Lu, Chi Guo et al. | Submitted: 2026-03-02 | arXiv: 2603.01404
Categories: cs.RO
Research Background: Cooperative localization is essential for swarm applications like collaborative exploration and search-and-rescue missions. However, maintaining real-time capability, robustness, and computational efficiency on resource-constrained platforms presents significant challenges.
研究背景: 在機器人學習領域,Cooperative localization is essential for swarm applications like collaborative exploration and search-and-rescue missions. However, maintaining real-time capability, robustness, a
Technical Approach: To address these challenges, we propose D-GVIO, a buffer-driven and fully decentralized GNSS-Visual-Inertial Odometry (GVIO) framework that leverages a novel buffering strategy to support efficient and robust distributed state estimation.
技術方法: 本文提出的方法:To address these challenges, we propose D-GVIO, a buffer-driven and fully decentralized GNSS-Visual-Inertial Odometry (GVIO) framework that leverages a novel buffering strategy to support efficient an
Key Takeaway: Finally, an adaptive buffer-driven outlier detection method is proposed to dynamically cull GNSS outliers, enhancing robustness in GNSS-challenged environments.
核心發現: 核心結果:Finally, an adaptive buffer-driven outlier detection method is proposed to dynamically cull GNSS outliers, enhancing robustness in GNSS-challenged environments.
Temporal Representations for Exploration: Learning Complex Exploratory Behavior without Extrinsic Rewards
Authors: Faisal Mohamed, Catherine Ji, Benjamin Eysenbach et al. | Submitted: 2026-03-02 | arXiv: 2603.02008
Categories: cs.LG, cs.AI
Research Background: Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To learn powerful representations, an agent should actively explore states that contribute to its knowledge of the environment.
研究背景: 在機器人學習領域,Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To lear
Technical Approach: In this paper, we propose an exploration method that leverages temporal contrastive representations to guide exploration, prioritizing states with unpredictable future outcomes. Unlike approaches that rely on explicit distance learning or episodic memory mechanisms (e.g., quasimetric-based methods), our method builds directly on temporal similarities, yielding a simpler yet effective strategy for exploration.
技術方法: 本文提出的方法:In this paper, we propose an exploration method that leverages temporal contrastive representations to guide exploration, prioritizing states with unpredictable future outcomes. Unlike approaches that
Key Takeaway: We demonstrate that such representations can enable the learning of complex exploratory x in locomotion, manipulation, and embodied-AI tasks, revealing capabilities and behaviors that traditionally require extrinsic rewards.
核心發現: 核心結果:We demonstrate that such representations can enable the learning of complex exploratory x in locomotion, manipulation, and embodied-AI tasks, revealing capabilities and behaviors that traditionally re
MVR: Multi-view Video Reward Shaping for Reinforcement Learning
Authors: Lirui Luo, Guoxi Zhang, Hongming Xu et al. | Submitted: 2026-03-02 | arXiv: 2603.01694
Categories: cs.CV, cs.AI, cs.LG
Research Background: Reward design is of great importance for solving complex tasks with reinforcement learning. Recent studies have explored using image-text similarity produced by vision-language models (VLMs) to augment rewards of a task with visual feedback.
研究背景: 在機器人學習領域,Reward design is of great importance for solving complex tasks with reinforcement learning. Recent studies have explored using image-text similarity produced by vision-language mod
Technical Approach: To address these issues, this paper presents Multi-View Video Reward Shaping (MVR), a framework that models the relevance of states regarding the target task using videos captured from multiple viewpoints. Additionally, we introduce a state-dependent reward shaping formulation that integrates task-specific rewards and VLM-based guidance, automatically reducing the influence of VLM guidance once the desired motion pattern is achieved.
技術方法: 本文提出的方法:To address these issues, this paper presents Multi-View Video Reward Shaping (MVR), a framework that models the relevance of states regarding the target task using videos captured from multiple viewpo
Key Takeaway: We confirm the efficacy of the proposed framework with extensive experiments on challenging humanoid locomotion tasks from HumanoidBench and manipulation tasks from MetaWorld, verifying the design choices through ablation studies.
核心發現: 核心結果:We confirm the efficacy of the proposed framework with extensive experiments on challenging humanoid locomotion tasks from HumanoidBench and manipulation tasks from MetaWorld, verifying the design cho
Real-time tightly coupled GNSS and IMU integration via Factor Graph Optimization
Authors: Radu-Andrei Cioaca, Paul Irofti, Cristian Rusu et al. | Submitted: 2026-03-03 | arXiv: 2603.03556
Categories: cs.RO, cs.LG, eess.SY
Research Background: Reliable positioning in dense urban environments remains challenging due to frequent GNSS signal blockage, multipath, and rapidly varying satellite geometry. While factor graph optimization (FGO)-based GNSS-IMU fusion has demonstrated strong robustness and accuracy, most formulations remain offline.
研究背景: 在機器人學習領域,Reliable positioning in dense urban environments remains challenging due to frequent GNSS signal blockage, multipath, and rapidly varying satellite geometry. While factor graph opt
Technical Approach: In this work, we present a real-time tightly coupled GNSS-IMU FGO method that enables causal state estimation via incremental optimization with fixed-lag marginalization, and we evaluate its performance in a highly urbanized GNSS-degraded environment using the UrbanNav dataset.
技術方法: 本文提出的方法:In this work, we present a real-time tightly coupled GNSS-IMU FGO method that enables causal state estimation via incremental optimization with fixed-lag marginalization, and we evaluate its performan
Key Takeaway: In this work, we present a real-time tightly coupled GNSS-IMU FGO method that enables causal state estimation via incremental optimization with fixed-lag marginalization, and we evaluate its performance in a highly urbanized GNSS-degraded environment using the UrbanNav dataset.
核心發現: 核心結果:In this work, we present a real-time tightly coupled GNSS-IMU FGO method that enables causal state estimation via incremental optimization with fixed-lag marginalization, and we evaluate its performan
Sampling-Based Motion Planning with Scene Graphs Under Perception Constraints
Authors: Qingxi Meng, Emiliano Flores, Thai Duong et al. | Submitted: 2026-03-03 | arXiv: 2603.03514
Categories: cs.RO
Research Background: It will be increasingly common for robots to operate in cluttered human-centered environments such as homes, workplaces, and hospitals, where the robot is often tasked to maintain perception constraints, such as monitoring people or multiple objects, for safety and reliability while executing its task. However, existing perception-aware approaches typically focus on low-degree-of-freedom (DoF) systems or only consider a single object in the context of high-DoF robots.
研究背景: 在機器人學習領域,It will be increasingly common for robots to operate in cluttered human-centered environments such as homes, workplaces, and hospitals, where the robot is often tasked to maintain
Technical Approach: To address these challenges, we propose MOPS-PRM, a roadmap-based motion planner, that integrates the perception cost of observing multiple objects or humans directly into motion planning for high-DoF robots. Our method is extensively validated in both simulated and real-world experiments, achieving more than ~36% improvement in the average number of detected objects and ~17% better track rate against other perception-constrained baselines, with comparable planning times and path lengths.
技術方法: 本文提出的方法:To address these challenges, we propose MOPS-PRM, a roadmap-based motion planner, that integrates the perception cost of observing multiple objects or humans directly into motion planning for high-DoF
Key Takeaway: Our method is extensively validated in both simulated and real-world experiments, achieving more than ~36% improvement in the average number of detected objects and ~17% better track rate against other perception-constrained baselines, with comparable planning times and path lengths.
核心發現: 核心結果:Our method is extensively validated in both simulated and real-world experiments, achieving more than ~36% improvement in the average number of detected objects and ~17% better track rate against othe
Overlapping Domain Decomposition for Distributed Pose Graph Optimization
Authors: Aneesa Sonawalla, Yulun Tian, Jonathan P. How | Submitted: 2026-03-03 | arXiv: 2603.03499
Categories: cs.RO
Research Background: We present ROBO (Riemannian Overlapping Block Optimization), a distributed and parallel approach to multi-robot pose graph optimization (PGO) based on the idea of overlapping domain decomposition. ROBO offers a middle ground between centralized and fully distributed solvers, where the amount of pose information shared between robots at each optimization iteration can be set according to the available communication resources.
研究背景: 在機器人學習領域,We present ROBO (Riemannian Overlapping Block Optimization), a distributed and parallel approach to multi-robot pose graph optimization (PGO) based on the idea of overlapping domai
Technical Approach: We present ROBO (Riemannian Overlapping Block Optimization), a distributed and parallel approach to multi-robot pose graph optimization (PGO) based on the idea of overlapping domain decomposition. Furthermore, we develop an asynchronous variant of ROBO that is robust to network delays and suitable for real-world robotic applications.
技術方法: 本文提出的方法:We present ROBO (Riemannian Overlapping Block Optimization), a distributed and parallel approach to multi-robot pose graph optimization (PGO) based on the idea of overlapping domain decomposition. Fur
Key Takeaway: We show that overlaps with an average inter-robot data cost of only 36 Kb per iteration can converge 3.1 faster in terms of iterations than state-of-the-art distributed PGO approaches.
核心發現: 核心結果:We show that overlaps with an average inter-robot data cost of only 36 Kb per iteration can converge 3.1 faster in terms of iterations than state-of-the-art distributed PGO approaches.
Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
Authors: Haoran Lu, Shang Wu, Jianshu Zhang et al. | Submitted: 2026-03-03 | arXiv: 2603.03485
Categories: cs.CV, cs.AI, cs.RO
Research Background: Recent video diffusion models have achieved impressive capabilities as large-scale generative world models. However, these models often struggle with fine-grained physical consistency, exhibiting physically implausible dynamics over time.
研究背景: 在機器人學習領域,Recent video diffusion models have achieved impressive capabilities as large-scale generative world models. However, these models often struggle with fine-grained physical consiste
Technical Approach: In this work, we present \textbf{Phys4D}, a pipeline for learning physics-consistent 4D world representations from video diffusion models. To evaluate fine-grained physical consistency beyond appearance-based metrics, we introduce a set of \textbf{4D world consistency evaluation} that probe geometric coherence, motion stability, and long-horizon physical plausibility.
技術方法: 本文提出的方法:In this work, we present \textbf{Phys4D}, a pipeline for learning physics-consistent 4D world representations from video diffusion models. To evaluate fine-grained physical consistency beyond appearan
Key Takeaway: Experimental results demonstrate that Phys4D substantially improves fine-grained spatiotemporal and physical consistency compared to appearance-driven baselines, while maintaining strong generative performance.
核心發現: 核心結果:Experimental results demonstrate that Phys4D substantially improves fine-grained spatiotemporal and physical consistency compared to appearance-driven baselines, while maintaining strong generative pe
Radar-based Pose Optimization for HD Map Generation from Noisy Multi-Drive Vehicle Fleet Data
Authors: Alexander Blumberg, Jonas Merkert, Christoph Stiller | Submitted: 2026-03-03 | arXiv: 2603.03453
Categories: cs.RO
Research Background: High-definition (HD) maps are important for autonomous driving, but their manual generation and maintenance is very expensive. This motivates the usage of an automated map generation pipeline.
研究背景: 在機器人學習領域,High-definition (HD) maps are important for autonomous driving, but their manual generation and maintenance is very expensive. This motivates the usage of an automated map generati
Technical Approach: This motivates the usage of an automated map generation pipeline. Fleet vehicles provide sufficient sensors for map generation, but their measurements are less precise, introducing noise into the mapping pipeline. This work focuses on mitigating the localization noise component through aligning radar measurements in terms of raw radar point clouds of vehicle poses of different drives and performing pose graph optimization to produce a globally optimized solution between all drives present in the dataset.
技術方法: 本文提出的方法:This motivates the usage of an automated map generation pipeline. Fleet vehicles provide sufficient sensors for map generation, but their measurements are less precise, introducing noise into the mapp
Key Takeaway: Through qualitative analysis we show contrast-rich feature clarity, focusing on omnipresent guardrail posts as the main feature type observable in the map.
核心發現: 核心結果:Through qualitative analysis we show contrast-rich feature clarity, focusing on omnipresent guardrail posts as the main feature type observable in the map.
Impact of Localization Errors on Label Quality for Online HD Map Construction
Authors: Alexander Blumberg, Jonas Merkert, Richard Fehler et al. | Submitted: 2026-03-03 | arXiv: 2603.03452
Categories: cs.RO, cs.CV
Research Background: High-definition (HD) maps are crucial for autonomous vehicles, but their creation and maintenance is very costly. This motivates the idea of online HD map construction.
研究背景: 在機器人學習領域,High-definition (HD) maps are crucial for autonomous vehicles, but their creation and maintenance is very costly. This motivates the idea of online HD map construction.
Technical Approach: We introduce three kinds of localization errors, Ramp, Gaussian, and Perlin noise, to examine their influence on generated map labels. Since localization errors affect distant labels more severely, but are also less significant to driving performance, we introduce a distance-based map construction metric.
技術方法: 本文提出的方法:We introduce three kinds of localization errors, Ramp, Gaussian, and Perlin noise, to examine their influence on generated map labels. Since localization errors affect distant labels more severely, bu
Key Takeaway: Our study additionally provides a qualitative evaluation of the extent to which localization errors influence the construction of HD maps.
核心發現: 核心結果:Our study additionally provides a qualitative evaluation of the extent to which localization errors influence the construction of HD maps.
GAIDE: Graph-based Attention Masking for Spatial- and Embodiment-aware Motion Planning
Authors: Davood Soleymanzadeh, Xiao Liang, Minghui Zheng | Submitted: 2026-03-03 | arXiv: 2603.04463
Categories: cs.RO
Research Background: Sampling-based motion planning algorithms are widely used for motion planning of robotic manipulators, but they often struggle with sample inefficiency in high-dimensional configuration spaces due to their reliance on uniform or hand-crafted informed sampling primitives. Neural informed samplers address this limitation by learning the sampling distribution from prior planning experience to guide the motion planner towards planning goal.
研究背景: 在機器人學習領域,Sampling-based motion planning algorithms are widely used for motion planning of robotic manipulators, but they often struggle with sample inefficiency in high-dimensional configur
Technical Approach: To address this limitation, we introduce Graph-based Attention Masking for Spatial- and Embodiment-aware Motion Planning (GAIDE), a neural informed sampler that leverages both the spatial structure of the planning problem and the robotic manipulator’s embodiment to guide the planning algorithm.
技術方法: 本文提出的方法:To address this limitation, we introduce Graph-based Attention Masking for Spatial- and Embodiment-aware Motion Planning (GAIDE), a neural informed sampler that leverages both the spatial structure of
Key Takeaway: Evaluation results demonstrate that GAIDE improves planning efficiency and success rate.
核心發現: 核心結果:Evaluation results demonstrate that GAIDE improves planning efficiency and success rate.
Architectural HRI: Towards a Robotic Paradigm Shift in Human-Building Interaction
Authors: Alex Binh Vinh Duc Nguyen | Submitted: 2026-03-03 | arXiv: 2603.03052
Categories: cs.RO, cs.HC
Research Background: Recent advances in sensing, communication, interfaces, control, and robotics are expanding Human-Building Interaction (HBI) beyond adaptive building services and facades toward the physical actuation of architectural space. In parallel, research in robotic furniture, swarm robotics, and shape-changing spaces shows that architectural elements can now be robotically augmented to move, reconfigure, and adapt space.
研究背景: 在機器人學習領域,Recent advances in sensing, communication, interfaces, control, and robotics are expanding Human-Building Interaction (HBI) beyond adaptive building services and facades toward the
Technical Approach: We propose that these advances promise a paradigm shift in HBI, in which multiple building layers physically adapt in synchrony to support occupant needs and sustainability goals more holistically.
技術方法: 本文提出的方法:We propose that these advances promise a paradigm shift in HBI, in which multiple building layers physically adapt in synchrony to support occupant needs and sustainability goals more holistically.
Key Takeaway: We therefore call for interdisciplinary research that unifies the why, what, and how of robotic actuation in architectural forms.
核心發現: 核心結果:We therefore call for interdisciplinary research that unifies the why, what, and how of robotic actuation in architectural forms.
Self-supervised Domain Adaptation for Visual 3D Pose Estimation of Nano-drone Racing Gates by Enforcing Geometric Consistency
Authors: Nicholas Carlotti, Michele Antonazzi, Elia Cereda et al. | Submitted: 2026-03-03 | arXiv: 2603.02936
Categories: cs.RO
Research Background: We consider the task of visually estimating the relative pose of a drone racing gate in front of a nano-quadrotor, using a convolutional neural network pre-trained on simulated data to regress the gate’s pose. Due to the sim-to-real gap, the pre-trained model underperforms in the real world and must be adapted to the target domain.
研究背景: 在機器人學習領域,We consider the task of visually estimating the relative pose of a drone racing gate in front of a nano-quadrotor, using a convolutional neural network pre-trained on simulated dat
Technical Approach: We propose an unsupervised domain adaptation (UDA) approach using only real image sequences collected by the drone flying an arbitrary trajectory in front of a gate; sequences are annotated in a self-supervised fashion with the drone’s odometry as measured by its onboard sensors. Results indicate that our approach outperforms other SoA UDA approaches, has a low mean absolute error in position (x=26, y=28, z=10 cm) and orientation (=13), an improvement of 40% in position and 37% in orientation over a baseline.
技術方法: 本文提出的方法:We propose an unsupervised domain adaptation (UDA) approach using only real image sequences collected by the drone flying an arbitrary trajectory in front of a gate; sequences are annotated in a self-
Key Takeaway: Results indicate that our approach outperforms other SoA UDA approaches, has a low mean absolute error in position (x=26, y=28, z=10 cm) and orientation (=13), an improvement of 40% in position and 37% in orientation over a baseline.
核心發現: 核心結果:Results indicate that our approach outperforms other SoA UDA approaches, has a low mean absolute error in position (x=26, y=28, z=10 cm) and orientation (=13), an improvement of 40% in
CoFL: Continuous Flow Fields for Language-Conditioned Navigation
Authors: Haokun Liu, Zhaoqi Ma, Yicheng Chen et al. | Submitted: 2026-03-03 | arXiv: 2603.02854
Categories: cs.RO, cs.AI
Research Background: Existing language-conditioned navigation systems typically rely on modular pipelines or trajectory generators, but the latter use each scene—instruction annotation mainly to supervise one start-conditioned rollout. To address these limitations, we present CoFL, an end-to-end policy that maps a bird’s-eye view (BEV) observation and a language instruction to a continuous flow field for navigation.
研究背景: 在機器人學習領域,Existing language-conditioned navigation systems typically rely on modular pipelines or trajectory generators, but the latter use each scene—instruction annotation mainly to super
Technical Approach: To address these limitations, we present CoFL, an end-to-end policy that maps a bird’s-eye view (BEV) observation and a language instruction to a continuous flow field for navigation. To enable large-scale training and evaluation, we build a dataset of over 500k BEV image—instruction pairs, each procedurally annotated with a flow field and a trajectory derived from semantic maps built on Matterport3D and ScanNet.
技術方法: 本文提出的方法:To address these limitations, we present CoFL, an end-to-end policy that maps a bird’s-eye view (BEV) observation and a language instruction to a continuous flow field for navigation. To enable large-
Key Takeaway: Finally, we deploy CoFL zero-shot in real-world experiments with BEV observations across multiple layouts, maintaining feasible closed-loop control and a high success rate.
核心發現: 核心結果:Finally, we deploy CoFL zero-shot in real-world experiments with BEV observations across multiple layouts, maintaining feasible closed-loop control and a high success rate.
SPARC: Spatial-Aware Path Planning via Attentive Agent Communication
Authors: Sayang Mu, Xiangyu Wu, Bo An | Submitted: 2026-03-03 | arXiv: 2603.02845
Categories: cs.RO, cs.AI
Research Background: Efficient communication is critical for decentralized Multi-Robot Path Planning (MRPP), yet existing learned communication methods treat all neighboring robots equally regardless of their spatial proximity, leading to diluted attention in congested regions where coordination matters most. We propose Relation enhanced Multi Head Attention (RMHA), a communication mechanism that explicitly embeds pairwise Manhattan distances into the attention weight computation, enabling each robot to dynamically prioritize messages from spatially relevant neighbors.
研究背景: 在機器人學習領域,Efficient communication is critical for decentralized Multi-Robot Path Planning (MRPP), yet existing learned communication methods treat all neighboring robots equally regardless o
Technical Approach: We propose Relation enhanced Multi Head Attention (RMHA), a communication mechanism that explicitly embeds pairwise Manhattan distances into the attention weight computation, enabling each robot to dynamically prioritize messages from spatially relevant neighbors.
技術方法: 本文提出的方法:We propose Relation enhanced Multi Head Attention (RMHA), a communication mechanism that explicitly embeds pairwise Manhattan distances into the attention weight computation, enabling each robot to dy
Key Takeaway: Ablation studies confirm that distance-relation encoding is the key contributor to success rate improvement in high-density environments.
核心發現: 核心結果:Ablation studies confirm that distance-relation encoding is the key contributor to success rate improvement in high-density environments.
Multi-Agent-Based Simulation of Archaeological Mobility in Uneven Landscapes
Authors: Chairi Kiourt, Vassilis Evangelidis, Dimitris Grigoropoulos | Submitted: 2026-03-03 | arXiv: 2603.03390
Categories: cs.RO, cs.AI
Research Background: Understanding mobility, movement, and interaction in archaeological landscapes is essential for interpreting past human behavior, transport strategies, and spatial organization, yet such processes are difficult to reconstruct from static archaeological evidence alone. This paper presents a multi-agent-based modeling framework for simulating archaeological mobility in uneven landscapes, integrating realistic terrain reconstruction, heterogeneous agent modeling, and adaptive navigation strategies.
研究背景: 在機器人學習領域,Understanding mobility, movement, and interaction in archaeological landscapes is essential for interpreting past human behavior, transport strategies, and spatial organization, ye
Technical Approach: This paper presents a multi-agent-based modeling framework for simulating archaeological mobility in uneven landscapes, integrating realistic terrain reconstruction, heterogeneous agent modeling, and adaptive navigation strategies.
技術方法: 本文提出的方法:This paper presents a multi-agent-based modeling framework for simulating archaeological mobility in uneven landscapes, integrating realistic terrain reconstruction, heterogeneous agent modeling, and
Key Takeaway: The results highlight the impact of terrain morphology, visibility, and agent heterogeneity on movement outcomes, while the proposed hybrid navigation strategy provides a computationally efficient and interpretable solution for large-scale, dynamic archaeological simulations.
核心發現: 核心結果:The results highlight the impact of terrain morphology, visibility, and agent heterogeneity on movement outcomes, while the proposed hybrid navigation strategy provides a computationally efficient and
Robust Tightly-Coupled Filter-Based Monocular Visual-Inertial State Estimation and Graph-Based Evaluation for Autonomous Drone Racing
Authors: Maulana Bisyir Azhari, Donghun Han, SungJun Park et al. | Submitted: 2026-03-03 | arXiv: 2603.02742
Categories: cs.RO
Research Background: Autonomous drone racing (ADR) demands state estimation that is simultaneously computationally efficient and resilient to the perceptual degradation experienced during extreme velocity and maneuvers. Traditional frameworks typically rely on conventional visual-inertial pipelines with loosely-coupled gate-based Perspective-n-Points (PnP) corrections that suffer from a rigid requirement for four visible features and information loss in intermediate steps.
研究背景: 在機器人學習領域,Autonomous drone racing (ADR) demands state estimation that is simultaneously computationally efficient and resilient to the perceptual degradation experienced during extreme veloc
Technical Approach: To address these limitations, we propose ADR-VINS, a robust, monocular visual-inertial state estimation framework based on an Error-State Kalman Filter (ESKF) tailored for autonomous drone racing. Our approach integrates direct pixel reprojection errors from gate corners features as innovation terms within the filter. Furthermore, we introduce ADR-FGO, an offline Factor-Graph Optimization framework to generate high-fidelity reference trajectories that facilitate post-flight performance evaluation and analysis on uninstrumented, GNSS-denied environments.
技術方法: 本文提出的方法:To address these limitations, we propose ADR-VINS, a robust, monocular visual-inertial state estimation framework based on an Error-State Kalman Filter (ESKF) tailored for autonomous drone racing. Our
Key Takeaway: We further utilize ADR-FGO for post-flight evaluation in uninstrumented racing environments.
核心發現: 核心結果:We further utilize ADR-FGO for post-flight evaluation in uninstrumented racing environments.
MMH-Planner: Multi-Mode Hybrid Trajectory Planning Method for UAV Efficient Flight Based on Real-Time Spatial Awareness
Authors: Yinghao Zhao, Chenguang Dai, Liang Lyu et al. | Submitted: 2026-03-03 | arXiv: 2603.02683
Categories: cs.RO
Research Background: Motion planning is a critical component of intelligent unmanned systems, enabling their complex autonomous operations. However, current planning algorithms still face limitations in planning efficiency due to inflexible strategies and weak adaptability.
研究背景: 在機器人學習領域,Motion planning is a critical component of intelligent unmanned systems, enabling their complex autonomous operations. However, current planning algorithms still face limitations i
Technical Approach: To address this, this paper proposes a multi-mode hybrid trajectory planning method for UAVs based on real-time environmental awareness, which dynamically selects the optimal planning model for high-quality trajectory generation in response to environmental changes. First, we introduce a goal-oriented spatial awareness method that rapidly assesses flight safety in the upcoming environments. Finally, we design a lazy replanning strategy that triggers replanning only when necessary to reduce computational resource consumption while maintaining flight quality.
技術方法: 本文提出的方法:To address this, this paper proposes a multi-mode hybrid trajectory planning method for UAVs based on real-time environmental awareness, which dynamically selects the optimal planning model for high-q
Key Takeaway: Furthermore, the effectiveness of our approach is further verified through real-world flight experiments integrated with a self-developed intelligent UAV platform.
核心發現: 核心結果:Furthermore, the effectiveness of our approach is further verified through real-world flight experiments integrated with a self-developed intelligent UAV platform.
IMR-LLM: Industrial Multi-Robot Task Planning and Program Generation using Large Language Models
Authors: Xiangyu Su, Juzhan Xu, Oliver van Kaick et al. | Submitted: 2026-03-03 | arXiv: 2603.02669
Categories: cs.RO
Research Background: In modern industrial production, multiple robots often collaborate to complete complex manufacturing tasks. Large language models (LLMs), with their strong reasoning capabilities, have shown potential in coordinating robots for simple household and manipulation tasks.
研究背景: 在機器人學習領域,In modern industrial production, multiple robots often collaborate to complete complex manufacturing tasks. Large language models (LLMs), with their strong reasoning capabilities,
Technical Approach: To address this, we propose IMR-LLM, a novel LLM-driven Industrial Multi-Robot task planning and program generation framework. Experimental results indicate that our method significantly surpasses existing methods across all evaluation metrics.
技術方法: 本文提出的方法:To address this, we propose IMR-LLM, a novel LLM-driven Industrial Multi-Robot task planning and program generation framework. Experimental results indicate that our method significantly surpasses exi
Key Takeaway: Experimental results indicate that our method significantly surpasses existing methods across all evaluation metrics.
核心發現: 核心結果:Experimental results indicate that our method significantly surpasses existing methods across all evaluation metrics.
Watch Your Step: Learning Semantically-Guided Locomotion in Cluttered Environment
Authors: Denan Liang, Yuan Zhu, Ruimeng Liu et al. | Submitted: 2026-03-03 | arXiv: 2603.02657
Categories: cs.RO
Research Background: Although legged robots demonstrate impressive mobility on rough terrain, using them safely in cluttered environments remains a challenge. A key issue is their inability to avoid stepping on low-lying objects, such as high-cost small devices or cables on flat ground.
研究背景: 在機器人學習領域,Although legged robots demonstrate impressive mobility on rough terrain, using them safely in cluttered environments remains a challenge. A key issue is their inability to avoid st
Technical Approach: To address this, we introduce SemLoco, a Reinforcement Learning (RL) framework designed to avoid obstacles precisely in densely cluttered environments.
技術方法: 本文提出的方法:To address this, we introduce SemLoco, a Reinforcement Learning (RL) framework designed to avoid obstacles precisely in densely cluttered environments.
Key Takeaway: Experimental results further show that SemLoco can be effectively applied to more complex, unstructured real-world environments.
核心發現: 核心結果:Experimental results further show that SemLoco can be effectively applied to more complex, unstructured real-world environments.
Improving Diffusion Planners by Self-Supervised Action Gating with Energies
Authors: Yuan Lu, Dongqi Han, Yansen Wang et al. | Submitted: 2026-03-03 | arXiv: 2603.02650
Categories: cs.LG, cs.AI, cs.RO
Research Background: Diffusion planners are a strong approach for offline reinforcement learning, but they can fail when value-guided selection favours trajectories that score well yet are locally inconsistent with the environment dynamics, resulting in brittle execution. We propose Self-supervised Action Gating with Energies (SAGE), an inference-time re-ranking method that penalises dynamically inconsistent plans using a latent consistency signal.
研究背景: 在機器人學習領域,Diffusion planners are a strong approach for offline reinforcement learning, but they can fail when value-guided selection favours trajectories that score well yet are locally inco
Technical Approach: We propose Self-supervised Action Gating with Energies (SAGE), an inference-time re-ranking method that penalises dynamically inconsistent plans using a latent consistency signal.
技術方法: 本文提出的方法:We propose Self-supervised Action Gating with Energies (SAGE), an inference-time re-ranking method that penalises dynamically inconsistent plans using a latent consistency signal.
Key Takeaway: Across locomotion, navigation, and manipulation benchmarks, SAGE improves the performance and robustness of diffusion planners.
核心發現: 核心結果:Across locomotion, navigation, and manipulation benchmarks, SAGE improves the performance and robustness of diffusion planners.
cuNRTO: GPU-Accelerated Nonlinear Robust Trajectory Optimization
Authors: Jiawei Wang, Arshiya Taj Abdul, Evangelos A. Theodorou | Submitted: 2026-03-03 | arXiv: 2603.02642
Categories: cs.RO, cs.DC, eess.SY
Research Background: Robust trajectory optimization enables autonomous systems to operate safely under uncertainty by computing control policies that satisfy the constraints for all bounded disturbances. However, these problems often lead to large Second Order Conic Programming (SOCP) constraints, which are computationally expensive.
研究背景: 在機器人學習領域,Robust trajectory optimization enables autonomous systems to operate safely under uncertainty by computing control policies that satisfy the constraints for all bounded disturbance
Technical Approach: In this work, we propose the CUDA Nonlinear Robust Trajectory Optimization (cuNRTO) framework by introducing two dynamic optimization architectures that have direct application to robust decision-making and are implemented on CUDA.
技術方法: 本文提出的方法:In this work, we propose the CUDA Nonlinear Robust Trajectory Optimization (cuNRTO) framework by introducing two dynamic optimization architectures that have direct application to robust decision-maki
Key Takeaway: We validate the performance of cuNRTO through simulated experiments on unicycle, quadcopter, and Franka manipulator models, demonstrating speedups of up to 139.6.
核心發現: 核心結果:We validate the performance of cuNRTO through simulated experiments on unicycle, quadcopter, and Franka manipulator models, demonstrating speedups of up to 139.6.
Real-Time Generative Policy via Langevin-Guided Flow Matching for Autonomous Driving
Authors: Tianze Zhu, Yinuo Wang, Wenjun Zou et al. | Submitted: 2026-03-03 | arXiv: 2603.02613
Categories: cs.LG, cs.RO
Research Background: Reinforcement learning (RL) is a fundamental methodology in autonomous driving systems, where generative policies exhibit considerable potential by leveraging their ability to model complex distributions to enhance exploration. However, their inherent high inference latency severely impedes their deployment in real-time decision-making and control.
研究背景: 在機器人學習領域,Reinforcement learning (RL) is a fundamental methodology in autonomous driving systems, where generative policies exhibit considerable potential by leveraging their ability to mode
Technical Approach: To address this issue, we propose diffusion actor-critic with entropy regulator via flow matching (DACER-F) by introducing flow matching into online RL, enabling the generation of competitive actions in a single inference step.
技術方法: 本文提出的方法:To address this issue, we propose diffusion actor-critic with entropy regulator via flow matching (DACER-F) by introducing flow matching into online RL, enabling the generation of competitive actions
Key Takeaway: Collectively, these results establish DACER-F as a high-performance and computationally efficient RL algorithm.
核心發現: 核心結果:Collectively, these results establish DACER-F as a high-performance and computationally efficient RL algorithm.
VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction
Authors: A. Enes Doruk, Hasan F. Ates | Submitted: 2026-03-03 | arXiv: 2603.02609
Categories: cs.CV, cs.RO
Research Background: This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. Current voxel-based occupancy models often struggle with semantic ambiguity in sparse geometric grids and performance degradation under adverse weather conditions.
研究背景: 在機器人學習領域,This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. Current voxel-based occupancy models often str
Technical Approach: This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. To address these challenges, we leverage the rich linguistic priors of Vision-Language Models (VLMs) to anchor ambiguous voxel features to stable semantic concepts. Our framework initiates with a dual-branch feature extraction pipeline that projects multi-view images and LiDAR point clouds into a unified voxel space.
技術方法: 本文提出的方法:This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. To address these challenges, we leverage the rich linguistic prior
Key Takeaway: Notably, our approach achieves significant improvements in challenging weather scenarios, offering a scalable and robust solution for complex urban navigation.
核心發現: 核心結果:Notably, our approach achieves significant improvements in challenging weather scenarios, offering a scalable and robust solution for complex urban navigation.
Tensegrity Robot Endcap-Ground Contact Estimation with Symmetry-aware Heterogeneous Graph Neural Network
Authors: Wenzhe Tong, Yicheng Jiang, Chi Zhang et al. | Submitted: 2026-03-03 | arXiv: 2603.02596
Categories: cs.RO
Research Background: Tensegrity robots possess lightweight and resilient structures but present significant challenges for state estimation due to compliant and distributed ground contacts. This paper introduces a symmetry-aware heterogeneous graph neural network (Sym-HGNN) that infers contact states directly from proprioceptive measurements, including IMU and cable-length histories, without dedicated contact sensors.
研究背景: 在機器人學習領域,Tensegrity robots possess lightweight and resilient structures but present significant challenges for state estimation due to compliant and distributed ground contacts. This paper
Technical Approach: This paper introduces a symmetry-aware heterogeneous graph neural network (Sym-HGNN) that infers contact states directly from proprioceptive measurements, including IMU and cable-length histories, without dedicated contact sensors.
技術方法: 本文提出的方法:This paper introduces a symmetry-aware heterogeneous graph neural network (Sym-HGNN) that infers contact states directly from proprioceptive measurements, including IMU and cable-length histories, wit
Key Takeaway: Simulation results demonstrate that the proposed method achieves up to 15% higher accuracy and 5% higher F1-score using only 20% of the training data compared to the CNN and MI-HGNN baselines, while maintaining low-drift and physically consistent state estimation results comparable to ground truth contacts.
核心發現: 核心結果:Simulation results demonstrate that the proposed method achieves up to 15% higher accuracy and 5% higher F1-score using only 20% of the training data compared to the CNN and MI-HGNN baselines, while m
PathSpace: Rapid continuous map approximation for efficient SLAM using B-Splines in constrained environments
Authors: Aduen Benjumea, Andrew Bradley, Alexander Rast et al. | Submitted: 2026-03-03 | arXiv: 2603.02538
Categories: cs.RO
Research Background: Simultaneous Localization and Mapping (SLAM) plays a crucial role in enabling autonomous vehicles to navigate previously unknown environments. Semantic SLAM mostly extends visual SLAM, leveraging the higher density information available to reason about the environment in a more human-like manner.
研究背景: 在機器人學習領域,Simultaneous Localization and Mapping (SLAM) plays a crucial role in enabling autonomous vehicles to navigate previously unknown environments. Semantic SLAM mostly extends visual S
Technical Approach: We propose PathSpace, a novel semantic SLAM framework that uses continuous B-splines to represent the environment in a compact manner, while also maintaining and reasoning through the continuous probability density functions required for probabilistic reasoning.
技術方法: 本文提出的方法:We propose PathSpace, a novel semantic SLAM framework that uses continuous B-splines to represent the environment in a compact manner, while also maintaining and reasoning through the continuous proba
Key Takeaway: We test this framework in the context of autonomous racing, where we exploit pre-specified track characteristics to produce significantly reduced representations at comparable levels of accuracy to traditional landmark based methods and demonstrate its potential in limiting the resources used by a system with minimal accuracy loss.
核心發現: 核心結果:We test this framework in the context of autonomous racing, where we exploit pre-specified track characteristics to produce significantly reduced representations at comparable levels of accuracy to tr
LLM-MLFFN: Multi-Level Autonomous Driving Behavior Feature Fusion via Large Language Model
Authors: Xiangyu Li, Tianyi Wang, Xi Cheng et al. | Submitted: 2026-03-03 | arXiv: 2603.02528
Categories: cs.AI, cs.RO
Research Background: Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing approaches primarily rely on numerical time-series modeling and often lack semantic abstraction, limiting interpretability and robustness in complex traffic environments.
研究背景: 在機器人學習領域,Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing a
Technical Approach: This paper presents LLM-MLFFN, a novel large language model (LLM)-enhanced multi-level feature fusion network designed to address the complexities of multi-dimensional driving data.
技術方法: 本文提出的方法:This paper presents LLM-MLFFN, a novel large language model (LLM)-enhanced multi-level feature fusion network designed to address the complexities of multi-dimensional driving data.
Key Takeaway: These results suggest that integrating structured feature modeling with language-driven semantic abstraction provides a principled and interpretable pathway for robust autonomous driving behavior classification.
核心發現: 核心結果:These results suggest that integrating structured feature modeling with language-driven semantic abstraction provides a principled and interpretable pathway for robust autonomous driving behavior clas
What Capable Agents Must Know: Selection Theorems for Robust Decision-Making under Uncertainty
Authors: Aran Nayebi | Submitted: 2026-03-03 | arXiv: 2603.02491
Categories: cs.LG, cs.AI, cs.RO, q-bio.NC, stat.ML
Research Background: As artificial agents become increasingly capable, what internal structure is necessary for an agent to act competently under uncertainty? Classical results show that optimal control can be implemented using belief states or world models, but not that such representations are required.
研究背景: 在機器人學習領域,As artificial agents become increasingly capable, what internal structure is necessary for an agent to act competently under uncertainty? Classical results show that optimal cont
Technical Approach: Classical results show that optimal control can be implemented using belief states or world models, but not that such representations are required. We prove quantitative “selection theorems” showing that strong task performance (low average-case regret) forces world models, belief-like memory and — under task mixtures — persistent variables resembling core primitives associated with emotion, along with informational modularity under block-structured tasks. Our results cover stochastic policies, partial observability, and evaluation under task distributions, without assuming optimality, determinism, or access to an explicit model.
技術方法: 本文提出的方法:Classical results show that optimal control can be implemented using belief states or world models, but not that such representations are required. We prove quantitative “selection theorems” showing
Key Takeaway: Our results cover stochastic policies, partial observability, and evaluation under task distributions, without assuming optimality, determinism, or access to an explicit model.
核心發現: 核心結果:Our results cover stochastic policies, partial observability, and evaluation under task distributions, without assuming optimality, determinism, or access to an explicit model.
COLREGs Compliant Collision Avoidance and Grounding Prevention for Autonomous Marine Navigation
Authors: Mayur S. Patil, Nataraj Sudharsan, Veneela Ammula et al. | Submitted: 2026-03-03 | arXiv: 2603.02484
Categories: cs.RO, math.OC
Research Background: Maritime Autonomous Surface Ships (MASS) are increasingly regarded as a promising solution to address crew shortages, improve navigational safety, and improve operational efficiency in the maritime industry. Nevertheless, the reliable deployment of MASS in real-world environments remains a significant challenge, particularly in congested waters where the majority of maritime accidents occur.
研究背景: 在機器人學習領域,Maritime Autonomous Surface Ships (MASS) are increasingly regarded as a promising solution to address crew shortages, improve navigational safety, and improve operational efficienc
Technical Approach: This paper presents a unified motion planning method for MASS that achieves real time collision avoidance, compliance with International Regulations for Preventing Collisions at Sea (COLREGs), and grounding prevention.
技術方法: 本文提出的方法:This paper presents a unified motion planning method for MASS that achieves real time collision avoidance, compliance with International Regulations for Preventing Collisions at Sea (COLREGs), and gro
Key Takeaway: Simulation results involving multi-vessel encounters demonstrate the effectiveness of the proposed method in producing safe and regulation-compliant maneuvers, highlighting the suitability of the proposed approach for real time autonomous maritime navigation.
核心發現: 核心結果:Simulation results involving multi-vessel encounters demonstrate the effectiveness of the proposed method in producing safe and regulation-compliant maneuvers, highlighting the suitability of the prop
CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration
Authors: Huichun Liu, Xiaosong Li, Zhuangfan Huang et al. | Submitted: 2026-03-03 | arXiv: 2603.02560
Categories: cs.CV
Research Background: Multimodal Image Fusion (MMIF) integrates complementary information from various modalities to produce clearer and more informative fused images. MMIF under adverse weather is particularly crucial in autonomous driving and UAV monitoring applications.
研究背景: 在機器人學習領域,Multimodal Image Fusion (MMIF) integrates complementary information from various modalities to produce clearer and more informative fused images. MMIF under adverse weather is part
Technical Approach: To address this challenge, we propose Compound Adverse Weather Mamba (CAWM-Mamba), the first end-to-end framework that jointly performs image fusion and compound weather restoration with unified shared weights.
技術方法: 本文提出的方法:To address this challenge, we propose Compound Adverse Weather Mamba (CAWM-Mamba), the first end-to-end framework that jointly performs image fusion and compound weather restoration with unified share
Key Takeaway: In addition, our fusion results excel in downstream tasks covering semantic segmentation and object detection, confirming the practical value in real-world adverse weather perception.
核心發現: 核心結果:In addition, our fusion results excel in downstream tasks covering semantic segmentation and object detection, confirming the practical value in real-world adverse weather perception.
Python Bindings for a Large C++ Robotics Library: The Case of OMPL
Authors: Weihang Guo, Theodoros Tyrovouzis, Lydia E. Kavraki | Submitted: 2026-03-04 | arXiv: 2603.04668
Categories: cs.RO
Research Background: Python bindings are a critical bridge between high-performance C++ libraries and the flexibility of Python, enabling rapid prototyping, reproducible experiments, and integration with simulation and learning frameworks in robotics research. Yet, generating bindings for large codebases is a tedious process that creates a heavy burden for a small group of maintainers.
研究背景: 在機器人學習領域,Python bindings are a critical bridge between high-performance C++ libraries and the flexibility of Python, enabling rapid prototyping, reproducible experiments, and integration wi
Technical Approach: Yet, generating bindings for large codebases is a tedious process that creates a heavy burden for a small group of maintainers. In this work, we investigate the use of Large Language Models (LLMs) to assist in generating nanobind wrappers, with human experts kept in the loop. Our workflow mirrors the structure of the C++ codebase, scaffolds empty wrapper files, and employs LLMs to fill in binding definitions.
技術方法: 本文提出的方法:Yet, generating bindings for large codebases is a tedious process that creates a heavy burden for a small group of maintainers. In this work, we investigate the use of Large Language Models (LLMs) to
Key Takeaway: Beyond this case study, our results provide general lessons for applying LLMs to binding generation in large-scale C++ projects.
核心發現: 核心結果:Beyond this case study, our results provide general lessons for applying LLMs to binding generation in large-scale C++ projects.
Risk-Aware Rulebooks for Multi-Objective Trajectory Evaluation under Uncertainty
Authors: Tichakorn Wongpiromsarn | Submitted: 2026-03-04 | arXiv: 2603.04603
Categories: eess.SY, cs.RO
Research Background: We present a risk-aware formalism for evaluating system trajectories in the presence of uncertain interactions between the system and its environment. The proposed formalism supports reasoning under uncertainty and systematically handles complex relationships among requirements and objectives, including hierarchical priorities and non-comparability.
研究背景: 在機器人學習領域,We present a risk-aware formalism for evaluating system trajectories in the presence of uncertain interactions between the system and its environment. The proposed formalism suppor
Technical Approach: We present a risk-aware formalism for evaluating system trajectories in the presence of uncertain interactions between the system and its environment.
技術方法: 本文提出的方法:We present a risk-aware formalism for evaluating system trajectories in the presence of uncertain interactions between the system and its environment.
Key Takeaway: Finally, we illustrate the approach with an autonomous driving example that demonstrates how the formalism enhances explainability by clarifying the rationale behind trajectory selection.
核心發現: 核心結果:Finally, we illustrate the approach with an autonomous driving example that demonstrates how the formalism enhances explainability by clarifying the rationale behind trajectory selection.
Distributed State Estimation for Vision-Based Cooperative Slung Load Transportation in GPS-Denied Environments
Authors: Jack R. Pence, Jackson Fezell, Jack W. Langelaan et al. | Submitted: 2026-03-04 | arXiv: 2603.04571
Categories: cs.RO
Research Background: Transporting heavy or oversized slung loads using rotorcraft has traditionally relied on single-aircraft systems, which limits both payload capacity and control authority. Cooperative multilift using teams of rotorcraft offers a scalable and efficient alternative, especially for infrequent but challenging “long-tail” payloads without the need of building larger and larger rotorcraft.
研究背景: 在機器人學習領域,Transporting heavy or oversized slung loads using rotorcraft has traditionally relied on single-aircraft systems, which limits both payload capacity and control authority. Cooperat
Technical Approach: This paper addresses this limitation by presenting a distributed and decentralized payload state estimation framework for vision-based multilift operations.
技術方法: 本文提出的方法:This paper addresses this limitation by presenting a distributed and decentralized payload state estimation framework for vision-based multilift operations.
Key Takeaway: Monte Carlo simulation results in Gazebo show the effectiveness of the proposed approach, including the effect of communication loss during flight.
核心發現: 核心結果:Monte Carlo simulation results in Gazebo show the effectiveness of the proposed approach, including the effect of communication loss during flight.
Tendon Force Modeling for Sim2Real Transfer of Reinforcement Learning Policies for Tendon-Driven Robots
Authors: Valentin Yuryev, Josie Hughes | Submitted: 2026-03-04 | arXiv: 2603.04351
Categories: cs.RO
Research Background: Robots which make use of soft or compliant inter- actions often leverage tendon-driven actuation which enables actuators to be placed more flexibly, and compliance to be maintained. However, controlling complex tendon systems is challenging.
研究背景: 在機器人學習領域,Robots which make use of soft or compliant inter- actions often leverage tendon-driven actuation which enables actuators to be placed more flexibly, and compliance to be maintained
Technical Approach: To address this, we propose a method to model the tendon forces produced by typical servo motors, focusing specifically on the transfer of RL policies for a tendon driven finger. Our approach extends existing data- driven techniques by leveraging contextual history and a novel data collection test-bench.
技術方法: 本文提出的方法:To address this, we propose a method to model the tendon forces produced by typical servo motors, focusing specifically on the transfer of RL policies for a tendon driven finger. Our approach extends
Key Takeaway: RL-based controller trained with our model achieves a 50% improvement in fingertip pose tracking tasks on real tendon-driven robotic fingers.
核心發現: 核心結果:RL-based controller trained with our model achieves a 50% improvement in fingertip pose tracking tasks on real tendon-driven robotic fingers.
Perception-Aware Time-Optimal Planning for Quadrotor Waypoint Flight
Authors: Chao Qin, Jiaxu Xing, Rudolf Reiter et al. | Submitted: 2026-03-04 | arXiv: 2603.04305
Categories: cs.RO
Research Background: Agile quadrotor flight pushes the limits of control, actuation, and onboard perception. While time-optimal trajectory planning has been extensively studied, existing approaches typically neglect the tight coupling between vehicle dynamics, environmental geometry, and the visual requirements of onboard state estimation.
研究背景: 在機器人學習領域,Agile quadrotor flight pushes the limits of control, actuation, and onboard perception. While time-optimal trajectory planning has been extensively studied, existing approaches typ
Technical Approach: This paper introduces a unified time-optimal trajectory optimization framework for vision-based quadrotors that explicitly incorporates perception constraints alongside full nonlinear dynamics, rotor actuation limits, aerodynamic effects, camera field-of-view constraints, and convex geometric gate representations. To accurately track the resulting perception-aware trajectories, we develop a model predictive contouring tracking controller that separates lateral and progress errors.
技術方法: 本文提出的方法:This paper introduces a unified time-optimal trajectory optimization framework for vision-based quadrotors that explicitly incorporates perception constraints alongside full nonlinear dynamics, rotor
Key Takeaway: Experiments demonstrate real-world flight speeds up to 9.8 m/s with 0.07 m average tracking error, and closed-loop success rates improved from 55% to 100% on a challenging Split-S course.
核心發現: 核心結果:Experiments demonstrate real-world flight speeds up to 9.8 m/s with 0.07 m average tracking error, and closed-loop success rates improved from 55% to 100% on a challenging Split-S course.
OmniPlanner: Universal Exploration and Inspection Path Planning across Robot Morphologies
Authors: Angelos Zacharia, Mihir Dharmadhikari, Mohit Singh et al. | Submitted: 2026-03-04 | arXiv: 2603.04284
Categories: cs.RO
Research Background: Autonomous robotic systems are increasingly deployed for mapping, monitoring, and inspection in complex and unstructured environments. However, most existing path planning approaches remain domain-specific (i.e., either on air, land, or sea), limiting their scalability and cross-platform applicability.
研究背景: 在機器人學習領域,Autonomous robotic systems are increasingly deployed for mapping, monitoring, and inspection in complex and unstructured environments. However, most existing path planning approach
Technical Approach: However, most existing path planning approaches remain domain-specific (i.e., either on air, land, or sea), limiting their scalability and cross-platform applicability. This article presents OmniPlanner, a unified planning framework for autonomous exploration and inspection across aerial, ground, and underwater robots. The method integrates volumetric exploration and viewpoint-based inspection, alongside target reach behaviors within a single modular architecture, complemented by a platform abstraction layer that captures morphology-specific sensing, traversability and motion constraints.
技術方法: 本文提出的方法:However, most existing path planning approaches remain domain-specific (i.e., either on air, land, or sea), limiting their scalability and cross-platform applicability. This article presents OmniPlann
Key Takeaway: Across these diverse scenarios, OmniPlanner demonstrates robust performance, consistent cross-domain generalization, and improved exploration and inspection efficiency compared to representative state-of-the-art baselines.
核心發現: 核心結果:Across these diverse scenarios, OmniPlanner demonstrates robust performance, consistent cross-domain generalization, and improved exploration and inspection efficiency compared to representative state
VANGUARD: Vehicle-Anchored Ground Sample Distance Estimation for UAVs in GPS-Denied Environments
Authors: Yifei Chen, Xupeng Chen, Feng Wang et al. | Submitted: 2026-03-04 | arXiv: 2603.04277
Categories: cs.RO, cs.AI
Research Background: Autonomous aerial robots operating in GPS-denied or communication-degraded environments frequently lose access to camera metadata and telemetry, leaving onboard perception systems unable to recover the absolute metric scale of the scene. As LLM/VLM-based planners are increasingly adopted as high-level agents for embodied systems, their ability to reason about physical dimensions becomes safety-critical — yet our experiments show that five state-of-the-art VLMs suffer from spatial scale hallucinations, with median area estimation errors exceeding 50%.
研究背景: 在機器人學習領域,Autonomous aerial robots operating in GPS-denied or communication-degraded environments frequently lose access to camera metadata and telemetry, leaving onboard perception systems
Technical Approach: We propose VANGUARD, a lightweight, deterministic Geometric Perception Skill designed as a callable tool that any LLM-based agent can invoke to recover Ground Sample Distance (GSD) from ubiquitous environmental anchors: small vehicles detected via oriented bounding boxes, whose modal pixel length is robustly estimated through kernel density estimation and converted to GSD using a pre-calibrated reference length.
技術方法: 本文提出的方法:We propose VANGUARD, a lightweight, deterministic Geometric Perception Skill designed as a callable tool that any LLM-based agent can invoke to recover Ground Sample Distance (GSD) from ubiquitous env
Key Takeaway: On the DOTAv1.5 benchmark, VANGUARD achieves 6.87% median GSD error on 306images.
核心發現: 核心結果:On the DOTAv1.5 benchmark, VANGUARD achieves 6.87% median GSD error on 306images.
AMP2026: A Multi-Platform Marine Robotics Dataset for Tracking and Mapping
Authors: Edwin Meriaux, Shuo Wen, David Widhalm et al. | Submitted: 2026-03-04 | arXiv: 2603.04225
Categories: cs.RO
Research Background: Marine environments present significant challenges for perception and autonomy due to dynamic surfaces, limited visibility, and complex interactions between aerial, surface, and submerged sensing modalities. This paper introduces the Aerial Marine Perception Dataset (AMP2026), a multi-platform marine robotics dataset collected across multiple field deployments designed to support research in two primary areas: multi-view tracking and marine environment mapping.
研究背景: 在機器人學習領域,Marine environments present significant challenges for perception and autonomy due to dynamic surfaces, limited visibility, and complex interactions between aerial, surface, and su
Technical Approach: This paper introduces the Aerial Marine Perception Dataset (AMP2026), a multi-platform marine robotics dataset collected across multiple field deployments designed to support research in two primary areas: multi-view tracking and marine environment mapping. This paper describes the data collection methodology, sensor configurations, dataset organization, and intended research tasks supported by the dataset.
技術方法: 本文提出的方法:This paper introduces the Aerial Marine Perception Dataset (AMP2026), a multi-platform marine robotics dataset collected across multiple field deployments designed to support research in two primary a
Key Takeaway: This paper describes the data collection methodology, sensor configurations, dataset organization, and intended research tasks supported by the dataset.
核心發現: 核心結果:This paper describes the data collection methodology, sensor configurations, dataset organization, and intended research tasks supported by the dataset.
PRAM-R: A Perception-Reasoning-Action-Memory Framework with LLM-Guided Modality Routing for Adaptive Autonomous Driving
Authors: Yi Zhang, Xian Zhang, Saisi Zhao et al. | Submitted: 2026-03-04 | arXiv: 2603.04222
Categories: cs.RO, cs.AI
Research Background: Multimodal perception enables robust autonomous driving but incurs unnecessary computational cost when all sensors remain active. This paper presents PRAM-R, a unified Perception-Reasoning-Action-Memory framework with LLM-Guided Modality Routing for adaptive autonomous driving.
研究背景: 在機器人學習領域,Multimodal perception enables robust autonomous driving but incurs unnecessary computational cost when all sensors remain active. This paper presents PRAM-R, a unified Perception-R
Technical Approach: This paper presents PRAM-R, a unified Perception-Reasoning-Action-Memory framework with LLM-Guided Modality Routing for adaptive autonomous driving.
技術方法: 本文提出的方法:This paper presents PRAM-R, a unified Perception-Reasoning-Action-Memory framework with LLM-Guided Modality Routing for adaptive autonomous driving.
Key Takeaway: Our work demonstrates that LLM-augmented architectures with hierarchical memory achieve efficient, adaptive multimodal perception in autonomous driving.
核心發現: 核心結果:Our work demonstrates that LLM-augmented architectures with hierarchical memory achieve efficient, adaptive multimodal perception in autonomous driving.
GSeg3D: A High-Precision Grid-Based Algorithm for Safety-Critical Ground Segmentation in LiDAR Point Clouds
Authors: Muhammad Haider Khan Lodhi, Christoph Hertzberg | Submitted: 2026-03-04 | arXiv: 2603.04208
Categories: cs.RO
Research Background: Ground segmentation in point cloud data is the process of separating ground points from non-ground points. This task is fundamental for perception in autonomous driving and robotics, where safety and reliable operation depend on the precise detection of obstacles and navigable surfaces.
研究背景: 在機器人學習領域,Ground segmentation in point cloud data is the process of separating ground points from non-ground points. This task is fundamental for perception in autonomous driving and robotic
Technical Approach: In this work, we present a ground segmentation approach designed to deliver consistently high precision, supporting the stringent requirements of autonomous vehicles and robotic systems operating in real-world, safety-critical scenarios.
技術方法: 本文提出的方法:In this work, we present a ground segmentation approach designed to deliver consistently high precision, supporting the stringent requirements of autonomous vehicles and robotic systems operating in r
Key Takeaway: In this work, we present a ground segmentation approach designed to deliver consistently high precision, supporting the stringent requirements of autonomous vehicles and robotic systems operating in real-world, safety-critical scenarios.
核心發現: 核心結果:In this work, we present a ground segmentation approach designed to deliver consistently high precision, supporting the stringent requirements of autonomous vehicles and robotic systems operating in r
Learning Hip Exoskeleton Control Policy via Predictive Neuromusculoskeletal Simulation
Authors: Ilseung Park, Changseob Song, Inseung Kang | Submitted: 2026-03-04 | arXiv: 2603.04166
Categories: cs.RO, cs.LG
Research Background: Developing exoskeleton controllers that generalize across diverse locomotor conditions typically requires extensive motion-capture data and biomechanical labeling, limiting scalability beyond instrumented laboratory settings. Here, we present a physics-based neuromusculoskeletal learning framework that trains a hip-exoskeleton control policy entirely in simulation, without motion-capture demonstrations, and deploys it on hardware via policy distillation.
研究背景: 在機器人學習領域,Developing exoskeleton controllers that generalize across diverse locomotor conditions typically requires extensive motion-capture data and biomechanical labeling, limiting scalabi
Technical Approach: Here, we present a physics-based neuromusculoskeletal learning framework that trains a hip-exoskeleton control policy entirely in simulation, without motion-capture demonstrations, and deploys it on hardware via policy distillation.
技術方法: 本文提出的方法:Here, we present a physics-based neuromusculoskeletal learning framework that trains a hip-exoskeleton control policy entirely in simulation, without motion-capture demonstrations, and deploys it on h
Key Takeaway: These results demonstrate that physics-based neuromusculoskeletal simulation can serve as a practical and scalable foundation for exoskeleton controller development, substantially reducing experimental burden during the design phase.
核心發現: 核心結果:These results demonstrate that physics-based neuromusculoskeletal simulation can serve as a practical and scalable foundation for exoskeleton controller development, substantially reducing experimenta
HBRB-BoW: A Retrained Bag-of-Words Vocabulary for ORB-SLAM via Hierarchical BRB-KMeans
Authors: Minjae Lee, Sang-Min Choi, Gun-Woo Kim et al. | Submitted: 2026-03-04 | arXiv: 2603.04144
Categories: cs.RO, cs.CV
Research Background: In visual simultaneous localization and mapping (SLAM), the quality of the visual vocabulary is fundamental to the system’s ability to represent environments and recognize locations. While ORB-SLAM is a widely used framework, its binary vocabulary, trained through the k-majority-based bag-of-words (BoW) approach, suffers from inherent precision loss.
研究背景: 在機器人學習領域,In visual simultaneous localization and mapping (SLAM), the quality of the visual vocabulary is fundamental to the system’s ability to represent environments and recognize location
Technical Approach: To address these structural deficiencies, this paper proposes hierarchical binary-to-real-and-back (HBRB)-BoW, a refined hierarchical binary vocabulary training algorithm. By integrating a global real-valued flow within the hierarchical clustering process, our method preserves high-fidelity descriptor information until the final binarization at the leaf nodes.
技術方法: 本文提出的方法:To address these structural deficiencies, this paper proposes hierarchical binary-to-real-and-back (HBRB)-BoW, a refined hierarchical binary vocabulary training algorithm. By integrating a global real
Key Takeaway: Experimental results demonstrate that the proposed approach yields a more discriminative and well-structured vocabulary than traditional methods, significantly enhancing the representational integrity of the visual dictionary in complex environments.
核心發現: 核心結果:Experimental results demonstrate that the proposed approach yields a more discriminative and well-structured vocabulary than traditional methods, significantly enhancing the representational integrity
SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resampling
Authors: Jinlong Cui, Fenghua Liang, Guo Yang et al. | Submitted: 2026-03-04 | arXiv: 2603.04071
Categories: cs.RO, cs.AI
Research Background: Safety-critical scenario generation is crucial for evaluating autonomous driving systems. However, existing approaches often struggle to balance three conflicting objectives: adversarial criticality, physical feasibility, and behavioral realism.
研究背景: 在機器人學習領域,Safety-critical scenario generation is crucial for evaluating autonomous driving systems. However, existing approaches often struggle to balance three conflicting objectives: adver
Technical Approach: To bridge this gap, we propose SaFeR: safety-critical scenario generation for autonomous driving test via feasibility-constrained token resampling. To capture complex interactions while effectively mitigating attention noise, we propose a novel differential attention mechanism within the realism prior.
技術方法: 本文提出的方法:To bridge this gap, we propose SaFeR: safety-critical scenario generation for autonomous driving test via feasibility-constrained token resampling. To capture complex interactions while effectively mi
Key Takeaway: Closed-loop experiments on the Waymo Open Motion Dataset and nuPlan demonstrate that SaFeR significantly outperforms state-of-the-art baselines, achieving a higher solution rate and superior kinematic realism while maintaining strong adversarial effectiveness.
核心發現: 核心結果:Closed-loop experiments on the Waymo Open Motion Dataset and nuPlan demonstrate that SaFeR significantly outperforms state-of-the-art baselines, achieving a higher solution rate and superior kinematic
Sim2Sea: Sim-to-Real Policy Transfer for Maritime Vessel Navigation in Congested Waters
Authors: Xinyu Cui, Xuanfa Jin, Xue Yan et al. | Submitted: 2026-03-04 | arXiv: 2603.04057
Categories: cs.RO, cs.AI
Research Background: Autonomous navigation in congested maritime environments is a critical capability for a wide range of real-world applications. However, it remains an unresolved challenge due to complex vessel interactions and significant environmental uncertainties.
研究背景: 在機器人學習領域,Autonomous navigation in congested maritime environments is a critical capability for a wide range of real-world applications. However, it remains an unresolved challenge due to co
Technical Approach: To address these, we propose \textbf{Sim2Sea}, a comprehensive framework designed to bridge simulation and real-world execution. First, we develop a GPU-accelerated parallel simulator for scalable and accurate maritime scenario simulation. Second, we design a dual-stream spatiotemporal policy that handles complex dynamics and multi-modal perception, augmented with a velocity-obstacle-guided action masking mechanism to ensure safe and efficient exploration.
技術方法: 本文提出的方法:To address these, we propose \textbf{Sim2Sea}, a comprehensive framework designed to bridge simulation and real-world execution. First, we develop a GPU-accelerated parallel simulator for scalable and
Key Takeaway: These results validate the effectiveness of Sim2Sea in achieving reliable sim-to-real transfer for practical autonomous maritime navigation.
核心發現: 核心結果:These results validate the effectiveness of Sim2Sea in achieving reliable sim-to-real transfer for practical autonomous maritime navigation.
Lambdas at the Far Edge: a Tale of Flying Lambdas and Lambdas on Wheels
Authors: Giorgio Audrito, Daniele Bortoluzzi, Ferruccio Damiani et al. | Submitted: 2026-03-04 | arXiv: 2603.04008
Categories: cs.DC, cs.PL, cs.RO
Research Background: Aggregate Programming (AP) is a paradigm for programming the collective behaviour of sets of distributed devices, possibly situated at the network far edge, by relying on asynchronous proximity-based interactions. The eXchange Calculus (XC), a recently proposed foundational model for AP, is essentially a typed lambda calculus extended with an operator (the exchange operator) providing an implicit communication mechanism between neighbour devices.
研究背景: 在機器人學習領域,Aggregate Programming (AP) is a paradigm for programming the collective behaviour of sets of distributed devices, possibly situated at the network far edge, by relying on asynchron
Technical Approach: This paper provides a gentle introduction to XC and to its implementation as a C++ library, called FCPP.
技術方法: 本文提出的方法:This paper provides a gentle introduction to XC and to its implementation as a C++ library, called FCPP.
Key Takeaway: An FCCP program is essentially a typed lambda term, and FCPP has been used to write code that has been deployed on devices at the far edge of the network, including rovers and (soon) Uncrewed Aerial Vehicles (UAVs); hence the title of the paper.
核心發現: 核心結果:An FCCP program is essentially a typed lambda term, and FCPP has been used to write code that has been deployed on devices at the far edge of the network, including rovers and (soon) Uncrewed Aerial V
Map-Agnostic And Interactive Safety-Critical Scenario Generation via Multi-Objective Tree Search
Authors: Wenyun Li, Zejian Deng, Chen Sun | Submitted: 2026-03-04 | arXiv: 2603.03978
Categories: cs.RO, cs.GR
Research Background: Generating safety-critical scenarios is essential for validating the robustness of autonomous driving systems, yet existing methods often struggle to produce collisions that are both realistic and diverse while ensuring explicit interaction logic among traffic participants. This paper presents a novel framework for traffic-flow level safety-critical scenario generation via multi-objective Monte Carlo Tree Search (MCTS).
研究背景: 在機器人學習領域,Generating safety-critical scenarios is essential for validating the robustness of autonomous driving systems, yet existing methods often struggle to produce collisions that are bo
Technical Approach: This paper presents a novel framework for traffic-flow level safety-critical scenario generation via multi-objective Monte Carlo Tree Search (MCTS). Furthermore, our method is map-agnostic and supports interactive scenario generation with each vehicle individually powered by SUMO’s microscopic traffic models, enabling realistic agent behaviors in arbitrary geographic locations imported from OpenStreetMap. We validate our approach across four high-risk accident zones in Hong Kong’s complex urban environments.
技術方法: 本文提出的方法:This paper presents a novel framework for traffic-flow level safety-critical scenario generation via multi-objective Monte Carlo Tree Search (MCTS). Furthermore, our method is map-agnostic and support
Key Takeaway: Experimental results demonstrate that our framework achieves an 85% collision failure rate while generating trajectories with superior feasibility and comfort metrics.
核心發現: 核心結果:Experimental results demonstrate that our framework achieves an 85% collision failure rate while generating trajectories with superior feasibility and comfort metrics.
Right in Time: Reactive Reasoning in Regulated Traffic Spaces
Authors: Simon Kohaut, Benedict Flade, Julian Eggert et al. | Submitted: 2026-03-04 | arXiv: 2603.03977
Categories: cs.RO, cs.AI
Research Background: Exact inference in probabilistic First-Order Logic offers a promising yet computationally costly approach for regulating the behavior of autonomous agents in shared traffic spaces. While prior methods have combined logical and probabilistic data into decision-making frameworks, their application is often limited to pre-flight checks due to the complexity of reasoning across vast numbers of possible universes.
研究背景: 在機器人學習領域,Exact inference in probabilistic First-Order Logic offers a promising yet computationally costly approach for regulating the behavior of autonomous agents in shared traffic spaces.
Technical Approach: In this work, we propose a reactive mission design framework that jointly considers uncertain environmental data and declarative, logical traffic regulations. Our approach leverages the Frequency of Change inherent in heterogeneous data streams to subdivide inference formulas into memoized, isolated tasks, ensuring that only the specific components affected by new sensor data are re-evaluated. In experiments involving both real-world vessel data and simulated drone traffic in dense urban scenarios, we demonstrate that our approach provides orders of magnitude in speedup over ProMis without reactive paradigms.
技術方法: 本文提出的方法:In this work, we propose a reactive mission design framework that jointly considers uncertain environmental data and declarative, logical traffic regulations. Our approach leverages the Frequency of C
Key Takeaway: In experiments involving both real-world vessel data and simulated drone traffic in dense urban scenarios, we demonstrate that our approach provides orders of magnitude in speedup over ProMis without reactive paradigms.
核心發現: 核心結果:In experiments involving both real-world vessel data and simulated drone traffic in dense urban scenarios, we demonstrate that our approach provides orders of magnitude in speedup over ProMis without
RVN-Bench: A Benchmark for Reactive Visual Navigation
Authors: Jaewon Lee, Jaeseok Heo, Gunmin Lee et al. | Submitted: 2026-03-04 | arXiv: 2603.03953
Categories: cs.RO, cs.AI, cs.CV
Research Background: Safe visual navigation is critical for indoor mobile robots operating in cluttered environments. Existing benchmarks, however, often neglect collisions or are designed for outdoor scenarios, making them unsuitable for indoor visual navigation.
研究背景: 在機器人學習領域,Safe visual navigation is critical for indoor mobile robots operating in cluttered environments. Existing benchmarks, however, often neglect collisions or are designed for outdoor
Technical Approach: To address this limitation, we introduce the reactive visual navigation benchmark (RVN-Bench), a collision-aware benchmark for indoor mobile robots.
技術方法: 本文提出的方法:To address this limitation, we introduce the reactive visual navigation benchmark (RVN-Bench), a collision-aware benchmark for indoor mobile robots.
Key Takeaway: Experiments show that policies trained on RVN-Bench generalize effectively to unseen environments, demonstrating its value as a standardized benchmark for safe and robust visual navigation.
核心發現: 核心結果:Experiments show that policies trained on RVN-Bench generalize effectively to unseen environments, demonstrating its value as a standardized benchmark for safe and robust visual navigation.
Dual-Interaction-Aware Cooperative Control Strategy for Alleviating Mixed Traffic Congestion
Authors: Zhengxuan Liu, Yuxin Cai, Yijing Wang et al. | Submitted: 2026-03-04 | arXiv: 2603.03848
Categories: eess.SY, cs.MA, cs.RO
Research Background: As Intelligent Transportation System (ITS) develops, Connected and Automated Vehicles (CAVs) are expected to significantly reduce traffic congestion through cooperative strategies, such as in bottleneck areas. However, the uncertainty and diversity in the behaviors of Human-Driven Vehicles (HDVs) in mixed traffic environments present major challenges for CAV cooperation.
研究背景: 在機器人學習領域,As Intelligent Transportation System (ITS) develops, Connected and Automated Vehicles (CAVs) are expected to significantly reduce traffic congestion through cooperative strategies,
Technical Approach: This paper proposes a Dual-Interaction-Aware Cooperative Control (DIACC) strategy that enhances both local and global interaction perception within the Multi-Agent Reinforcement Learning (MARL) framework for Connected and Automated Vehicles (CAVs) in mixed traffic bottleneck scenarios.
技術方法: 本文提出的方法:This paper proposes a Dual-Interaction-Aware Cooperative Control (DIACC) strategy that enhances both local and global interaction perception within the Multi-Agent Reinforcement Learning (MARL) framew
Key Takeaway: Experimental results demonstrate that DIACC significantly improves traffic efficiency and adaptability compared to rule-based and benchmark MARL models.
核心發現: 核心結果:Experimental results demonstrate that DIACC significantly improves traffic efficiency and adaptability compared to rule-based and benchmark MARL models.
Large-Language-Model-Guided State Estimation for Partially Observable Task and Motion Planning
Authors: Yoonwoo Kim, Raghav Arora, Roberto Martín-Martín et al. | Submitted: 2026-03-04 | arXiv: 2603.03704
Categories: cs.RO, cs.AI
Research Background: Robot planning in partially observable environments, where not all objects are known or visible, is a challenging problem, as it requires reasoning under uncertainty through partially observable Markov decision processes. During the execution of a computed plan, a robot may unexpectedly observe task-irrelevant objects, which are typically ignored by naive planners.
研究背景: 在機器人學習領域,Robot planning in partially observable environments, where not all objects are known or visible, is a challenging problem, as it requires reasoning under uncertainty through partia
Technical Approach: In this work, we propose incorporating two types of common-sense knowledge: (1) certain objects are more likely to be found in specific locations; and (2) similar objects are likely to be co-located, while dissimilar objects are less likely to be found together.
技術方法: 本文提出的方法:In this work, we propose incorporating two types of common-sense knowledge: (1) certain objects are more likely to be found in specific locations; and (2) similar objects are likely to be co-located,
Key Takeaway: In experiments, CoCo-TAMP achieves an average reduction of 62.7% in planning and execution time in simulation, and 72.6% in real-world demonstrations, compared to a baseline that does not incorporate either type of common-sense knowledge.
核心發現: 核心結果:In experiments, CoCo-TAMP achieves an average reduction of 62.7% in planning and execution time in simulation, and 72.6% in real-world demonstrations, compared to a baseline that does not incorporate
TreeLoc++: Robust 6-DoF LiDAR Localization in Forests with a Compact Digital Forest Inventory
Authors: Minwoo Jung, Dongjae Lee, Nived Chebrolu et al. | Submitted: 2026-03-04 | arXiv: 2603.03695
Categories: cs.RO
Research Background: Reliable localization is essential for sustainable forest management, as it allows robots or sensor systems to revisit and monitor the status of individual trees over long periods. In modern forestry, this management is structured around Digital Forest Inventories (DFIs), which encode stems using compact geometric attributes rather than raw data.
研究背景: 在機器人學習領域,Reliable localization is essential for sustainable forest management, as it allows robots or sensor systems to revisit and monitor the status of individual trees over long periods.
Technical Approach: To improve upon this, we propose TreeLoc++, a global localization framework that operates directly on DFIs as a discriminative representation, eliminating the need to use the raw point clouds.
技術方法: 本文提出的方法:To improve upon this, we propose TreeLoc++, a global localization framework that operates directly on DFIs as a discriminative representation, eliminating the need to use the raw point clouds.
Key Takeaway: This demonstrates the scalability of TreeLoc++ for long-term deployment.
核心發現: 核心結果:This demonstrates the scalability of TreeLoc++ for long-term deployment.
SCP: Spatial Causal Prediction in Video
Authors: Yanguang Zhao, Jie Yang, Shengqiong Wu et al. | Submitted: 2026-03-04 | arXiv: 2603.03944
Categories: cs.CV
Research Background: Spatial reasoning, the ability to understand spatial relations, causality, and dynamic evolution, is central to human intelligence and essential for real-world applications such as autonomous driving and robotics. Existing studies, however, primarily assess models on visible spatio-temporal understanding, overlooking their ability to infer unseen past or future spatial states.
研究背景: 在機器人學習領域,Spatial reasoning, the ability to understand spatial relations, causality, and dynamic evolution, is central to human intelligence and essential for real-world applications such as
Technical Approach: In this work, we introduce Spatial Causal Prediction (SCP), a new task paradigm that challenges models to reason beyond observation and predict spatial causal outcomes.
技術方法: 本文提出的方法:In this work, we introduce Spatial Causal Prediction (SCP), a new task paradigm that challenges models to reason beyond observation and predict spatial causal outcomes.
Key Takeaway: Through comprehensive experiments on {23} state-of-the-art models, we reveal substantial gaps between human and model performance, limited temporal extrapolation, and weak causal grounding.
核心發現: 核心結果:Through comprehensive experiments on {23} state-of-the-art models, we reveal substantial gaps between human and model performance, limited temporal extrapolation, and weak causal grounding.
Environment-Aware Path Generation for Robotic Additive Manufacturing of Structures
Authors: Mahsa Rabiei, Reza Moini | Submitted: 2026-03-05 | arXiv: 2603.05748
Categories: cs.RO
Research Background: Robotic Additive Manufacturing (AM) has emerged as a scalable and customizable construction method in the last decade. However, current AM design methods rely on pre-conceived (A priori) toolpath of the structure, often developed via offline slicing software.
研究背景: 在機器人學習領域,Robotic Additive Manufacturing (AM) has emerged as a scalable and customizable construction method in the last decade. However, current AM design methods rely on pre-conceived (A p
Technical Approach: However, current AM design methods rely on pre-conceived (A priori) toolpath of the structure, often developed via offline slicing software. Moreover, considering the dynamic construction environments involving obstacles on terrestrial and extraterrestrial environments, there is a need for online path generation methods. Here, an environment-aware path generation framework (PGF) is proposed for the first time in which structures are designed in an online fashion by utilizing four path planning (PP) algorithms (two search-based and two sampling-based).
技術方法: 本文提出的方法:However, current AM design methods rely on pre-conceived (A priori) toolpath of the structure, often developed via offline slicing software. Moreover, considering the dynamic construction environments
Key Takeaway: Finally, the effectiveness of the proposed structural performance metrics is evaluated individually and comparatively, and most essential metrics necessary for evaluation of toolpath of the resulting structures are prescribed.
核心發現: 核心結果:Finally, the effectiveness of the proposed structural performance metrics is evaluated individually and comparatively, and most essential metrics necessary for evaluation of toolpath of the resulting
Introducing the transitional autonomous vehicle lane-changing dataset: Empirical Experiments
Authors: Abhinav Sharma, Zijun He, Danjue Chen | Submitted: 2026-03-05 | arXiv: 2603.05716
Categories: cs.RO, eess.SY
Research Background: Transitional autonomous vehicles (tAVs), which operate beyond SAE Level 1-2 automation but short of full autonomy, are increasingly sharing the road with human-driven vehicles (HDVs). As these systems interact during complex maneuvers such as lane changes, new patterns may emerge with implications for traffic stability and safety.
研究背景: 在機器人學習領域,Transitional autonomous vehicles (tAVs), which operate beyond SAE Level 1-2 automation but short of full autonomy, are increasingly sharing the road with human-driven vehicles (HDV
Technical Approach: As these systems interact during complex maneuvers such as lane changes, new patterns may emerge with implications for traffic stability and safety. Assessing these dynamics, particularly during mandatory lane changes, requires high-resolution trajectory data, yet datasets capturing tAV lane-changing behavior are scarce. This study introduces the North Carolina Transitional Autonomous Vehicle Lane-Changing (NC-tALC) Dataset, a high-fidelity trajectory dataset designed to characterize tAV interactions during lane-changing maneuvers.
技術方法: 本文提出的方法:As these systems interact during complex maneuvers such as lane changes, new patterns may emerge with implications for traffic stability and safety. Assessing these dynamics, particularly during manda
Key Takeaway: The NC-tALC dataset provides a rigorous empirical foundation for evaluating tAV decision-making and interaction dynamics in controlled mandatory lane-changing scenarios.
核心發現: 核心結果:The NC-tALC dataset provides a rigorous empirical foundation for evaluating tAV decision-making and interaction dynamics in controlled mandatory lane-changing scenarios.
Safe-SAGE: Social-Semantic Adaptive Guidance for Safe Engagement through Laplace-Modulated Poisson Safety Functions
Authors: Lizhi Yang, Ryan M. Bena, Meg Wilkinson et al. | Submitted: 2026-03-05 | arXiv: 2603.05497
Categories: cs.RO
Research Background: Traditional safety-critical control methods, such as control barrier functions, suffer from semantic blindness, exhibiting the same behavior around obstacles regardless of contextual significance. This limitation leads to the uniform treatment of all obstacles, despite their differing semantic meanings.
研究背景: 在機器人學習領域,Traditional safety-critical control methods, such as control barrier functions, suffer from semantic blindness, exhibiting the same behavior around obstacles regardless of contextu
Technical Approach: We present Safe-SAGE (Social-Semantic Adaptive Guidance for Safe Engagement), a unified framework that bridges the gap between high-level semantic understanding and low-level safety-critical control through a Poisson safety function (PSF) modulated using a Laplace guidance field. Our approach perceives the environment by fusing multi-sensor point clouds with vision-based instance segmentation and persistent object tracking to maintain up-to-date semantics beyond the camera’s field of view. Our framework enables legged robots to safely navigate semantically rich, dynamic environments with context-dependent safety margins.
技術方法: 本文提出的方法:We present Safe-SAGE (Social-Semantic Adaptive Guidance for Safe Engagement), a unified framework that bridges the gap between high-level semantic understanding and low-level safety-critical control t
Key Takeaway: A multi-layer safety filter is then used to modulate system inputs to achieve safe navigation using this semantic understanding of the environment.
核心發現: 核心結果:A multi-layer safety filter is then used to modulate system inputs to achieve safe navigation using this semantic understanding of the environment.
cuRoboV2: Dynamics-Aware Motion Generation with Depth-Fused Distance Fields for High-DoF Robots
Authors: Balakumar Sundaralingam, Adithyavairavan Murali, Stan Birchfield | Submitted: 2026-03-05 | arXiv: 2603.05493
Categories: cs.RO
Research Background: Effective robot autonomy requires motion generation that is safe, feasible, and reactive. Current methods are fragmented: fast planners output physically unexecutable trajectories, reactive controllers struggle with high-fidelity perception, and existing solvers fail on high-DoF systems.
研究背景: 在機器人學習領域,Effective robot autonomy requires motion generation that is safe, feasible, and reactive. Current methods are fragmented: fast planners output physically unexecutable trajectories,
Technical Approach: We present cuRoboV2, a unified framework with three key innovations: (1) B-spline trajectory optimization that enforces smoothness and torque limits; (2) a GPU-native TSDF/ESDF perception pipeline that generates dense signed distance fields covering the full workspace, unlike existing methods that only provide distances within sparsely allocated blocks, up to 10x faster and in 8x less memory than the state-of-the-art at manipulation scale, with up to 99% collision recall; and (3) scalable GPU-native whole-body computation, namely topology-aware kinematics, differentiable inverse dynamics, and map-reduce self-collision, that achieves up to 61x speedup while also extending to high-DoF humanoids (where previous GPU implementations fail).
技術方法: 本文提出的方法:We present cuRoboV2, a unified framework with three key innovations: (1) B-spline trajectory optimization that enforces smoothness and torque limits; (2) a GPU-native TSDF/ESDF perception pipeline tha
Key Takeaway: On benchmarks, cuRoboV2 achieves 99.7% success under 3kg payload (where baselines achieve only 72—77%), 99.6% collision-free IK on a 48-DoF humanoid (where prior methods fail entirely), and 89.5% retargeting constraint satisfaction (vs. 61% for PyRoki); these collision-free motions yield locomotion policies with 21% lower tracking error than PyRoki and 12x lower cross-seed variance than GMR.
核心發現: 核心結果:On benchmarks, cuRoboV2 achieves 99.7% success under 3kg payload (where baselines achieve only 72—77%), 99.6% collision-free IK on a 48-DoF humanoid (where prior methods fail entirely), and 89.5% ret
Planning in 8 Tokens: A Compact Discrete Tokenizer for Latent World Model
Authors: Dongwon Kim, Gawon Seo, Jinsung Lee et al. | Submitted: 2026-03-05 | arXiv: 2603.05438
Categories: cs.CV, cs.AI, cs.RO
Research Background: World models provide a powerful framework for simulating environment dynamics conditioned on actions or instructions, enabling downstream tasks such as action planning or policy learning. Recent approaches leverage world models as learned simulators, but its application to decision-time planning remains computationally prohibitive for real-time control.
研究背景: 在機器人學習領域,World models provide a powerful framework for simulating environment dynamics conditioned on actions or instructions, enabling downstream tasks such as action planning or policy le
Technical Approach: To address this, we propose CompACT, a discrete tokenizer that compresses each observation into as few as 8 tokens, drastically reducing computational cost while preserving essential information for planning.
技術方法: 本文提出的方法:To address this, we propose CompACT, a discrete tokenizer that compresses each observation into as few as 8 tokens, drastically reducing computational cost while preserving essential information for p
Key Takeaway: An action-conditioned world model that occupies CompACT tokenizer achieves competitive planning performance with orders-of-magnitude faster planning, offering a practical step toward real-world deployment of world models.
核心發現: 核心結果:An action-conditioned world model that occupies CompACT tokenizer achieves competitive planning performance with orders-of-magnitude faster planning, offering a practical step toward real-world deploy
Loop Closure via Maximal Cliques in 3D LiDAR-Based SLAM
Authors: Javier Laserna, Saurabh Gupta, Oscar Martinez Mozos et al. | Submitted: 2026-03-05 | arXiv: 2603.05397
Categories: cs.RO, cs.CV
Research Background: Reliable loop closure detection remains a critical challenge in 3D LiDAR-based SLAM, especially under sensor noise, environmental ambiguity, and viewpoint variation conditions. RANSAC is often used in the context of loop closures for geometric model fitting in the presence of outliers.
研究背景: 在機器人學習領域,Reliable loop closure detection remains a critical challenge in 3D LiDAR-based SLAM, especially under sensor noise, environmental ambiguity, and viewpoint variation conditions. RAN
Technical Approach: We introduce a novel deterministic algorithm, CliReg, for loop closure validation that replaces RANSAC verification with a maximal clique search over a compatibility graph of feature correspondences. We integrated our approach into a real- time pipeline employing binary 3D descriptors and a Hamming distance embedding binary search tree-based matching. Additional experiments on 2D projection-based maps confirm its generality across spatial domains, making our approach a robust and efficient alternative for loop closure detection.
技術方法: 本文提出的方法:We introduce a novel deterministic algorithm, CliReg, for loop closure validation that replaces RANSAC verification with a maximal clique search over a compatibility graph of feature correspondences.
Key Takeaway: Additional experiments on 2D projection-based maps confirm its generality across spatial domains, making our approach a robust and efficient alternative for loop closure detection.
核心發現: 核心結果:Additional experiments on 2D projection-based maps confirm its generality across spatial domains, making our approach a robust and efficient alternative for loop closure detection.
Latent Policy Steering through One-Step Flow Policies
Authors: Hokyun Im, Andrey Kolobov, Jianlong Fu et al. | Submitted: 2026-03-05 | arXiv: 2603.05296
Categories: cs.RO, cs.LG
Research Background: Offline reinforcement learning (RL) allows robots to learn from offline datasets without risky exploration. Yet, offline RL’s performance often hinges on a brittle trade-off between (1) return maximization, which can push policies outside the dataset support, and (2) behavioral constraints, which typically require sensitive hyperparameter tuning.
研究背景: 在機器人學習領域,Offline reinforcement learning (RL) allows robots to learn from offline datasets without risky exploration. Yet, offline RL’s performance often hinges on a brittle trade-off betwee
Technical Approach: We propose Latent Policy Steering (LPS), which enables high-fidelity latent policy improvement by backpropagating original-action-space Q-gradients through a differentiable one-step MeanFlow policy to update a latent-action-space actor.
技術方法: 本文提出的方法:We propose Latent Policy Steering (LPS), which enables high-fidelity latent policy improvement by backpropagating original-action-space Q-gradients through a differentiable one-step MeanFlow policy to
Key Takeaway: Across OGBench and real-world robotic tasks, LPS achieves state-of-the-art performance and consistently outperforms behavioral cloning and strong latent steering baselines.
核心發現: 核心結果:Across OGBench and real-world robotic tasks, LPS achieves state-of-the-art performance and consistently outperforms behavioral cloning and strong latent steering baselines.
From Code to Road: A Vehicle-in-the-Loop and Digital Twin-Based Framework for Central Car Server Testing in Autonomous Driving
Authors: Chengdong Wu, Sven Kirchner, Nils Purschke et al. | Submitted: 2026-03-05 | arXiv: 2603.05279
Categories: cs.RO, eess.SY
Research Background: Simulation is one of the most essential parts in the development stage of automotive software. However, purely virtual simulations often struggle to accurately capture all real-world factors due to limitations in modeling.
研究背景: 在機器人學習領域,Simulation is one of the most essential parts in the development stage of automotive software. However, purely virtual simulations often struggle to accurately capture all real-wor
Technical Approach: Our approach provides a safe, reproducible, realistic, and cost-effective platform for validating autonomous driving algorithms with a centralized architecture.
技術方法: 本文提出的方法:Our approach provides a safe, reproducible, realistic, and cost-effective platform for validating autonomous driving algorithms with a centralized architecture.
Key Takeaway: Experimental case studies demonstrate the effectiveness of the framework in different test scenarios.
核心發現: 核心結果:Experimental case studies demonstrate the effectiveness of the framework in different test scenarios.
Decoupling Task and Behavior: A Two-Stage Reward Curriculum in Reinforcement Learning for Robotics
Authors: Kilian Freitag, Knut Åkesson, Morteza Haghir Chehreghani | Submitted: 2026-03-05 | arXiv: 2603.05113
Categories: cs.LG, cs.RO
Research Background: Deep Reinforcement Learning is a promising tool for robotic control, yet practical application is often hindered by the difficulty of designing effective reward functions. Real-world tasks typically require optimizing multiple objectives simultaneously, necessitating precise tuning of their weights to learn a policy with the desired characteristics.
研究背景: 在機器人學習領域,Deep Reinforcement Learning is a promising tool for robotic control, yet practical application is often hindered by the difficulty of designing effective reward functions. Real-wor
Technical Approach: To address this, we propose a two-stage reward curriculum where we decouple task-specific objectives from behavioral terms. In our method, we first train the agent on a simplified task-only reward function to ensure effective exploration before introducing the full reward that includes auxiliary behavior-related terms such as energy efficiency. We validate our approach on the DeepMind Control Suite, ManiSkill3, and a mobile robot environment, modified to include auxiliary behavioral objectives.
技術方法: 本文提出的方法:To address this, we propose a two-stage reward curriculum where we decouple task-specific objectives from behavioral terms. In our method, we first train the agent on a simplified task-only reward fun
Key Takeaway: Our method proves to be simple yet effective, substantially outperforming baselines trained directly on the full reward while exhibiting higher robustness to specific reward weightings.
核心發現: 核心結果:Our method proves to be simple yet effective, substantially outperforming baselines trained directly on the full reward while exhibiting higher robustness to specific reward weightings.
AIM-SLAM: Dense Monocular SLAM via Adaptive and Informative Multi-View Keyframe Prioritization with Foundation Model
Authors: Jinwoo Jeon, Dong-Uk Seo, Eungchang Mason Lee et al. | Submitted: 2026-03-05 | arXiv: 2603.05097
Categories: cs.RO
Research Background: Recent advances in geometric foundation models have emerged as a promising alternative for addressing the challenge of dense reconstruction in monocular visual simultaneous localization and mapping (SLAM). Although geometric foundation models enable SLAM to leverage variable input views, the previous methods remain confined to two-view pairs or fixed-length inputs without sufficient deliberation of geometric context for view selection.
研究背景: 在機器人學習領域,Recent advances in geometric foundation models have emerged as a promising alternative for addressing the challenge of dense reconstruction in monocular visual simultaneous localiz
Technical Approach: To tackle this problem, we propose AIM-SLAM, a dense monocular SLAM framework that exploits an adaptive and informative multi-view keyframe prioritization with dense pointmap predictions from visual geometry grounded transformer (VGGT). Specifically, we introduce the selective information- and geometric-aware multi-view adaptation (SIGMA) module, which employs voxel overlap and information gain to retrieve a candidate set of keyframes and adaptively determine its size. Furthermore, we formulate a joint multi-view Sim(3) optimization that enforces consistent alignment across selected views, substantially improving pose estimation accuracy.
技術方法: 本文提出的方法:To tackle this problem, we propose AIM-SLAM, a dense monocular SLAM framework that exploits an adaptive and informative multi-view keyframe prioritization with dense pointmap predictions from visual g
Key Takeaway: The effectiveness of AIM-SLAM is demonstrated on real-world datasets, where it achieves state-of-the-art pose estimation performance and accurate dense reconstruction results.
核心發現: 核心結果:The effectiveness of AIM-SLAM is demonstrated on real-world datasets, where it achieves state-of-the-art pose estimation performance and accurate dense reconstruction results.
CoIn3D: Revisiting Configuration-Invariant Multi-Camera 3D Object Detection
Authors: Zhaonian Kuang, Rui Ding, Haotian Wang et al. | Submitted: 2026-03-05 | arXiv: 2603.05042
Categories: cs.CV, cs.RO
Research Background: Multi-camera 3D object detection (MC3D) has attracted increasing attention with the growing deployment of multi-sensor physical agents, such as robots and autonomous vehicles. However, MC3D models still struggle to generalize to unseen platforms with new multi-camera configurations.
研究背景: 在機器人學習領域,Multi-camera 3D object detection (MC3D) has attracted increasing attention with the growing deployment of multi-sensor physical agents, such as robots and autonomous vehicles. Howe
Technical Approach: In this paper, we revisit this issue and identify that the devil lies in spatial prior discrepancies across source and target configurations, including different intrinsics, extrinsics, and array layouts. To address this, we propose CoIn3D, a generalizable MC3D framework that enables strong transferability from source configurations to unseen target ones.
技術方法: 本文提出的方法:In this paper, we revisit this issue and identify that the devil lies in spatial prior discrepancies across source and target configurations, including different intrinsics, extrinsics, and array layo
Key Takeaway: Extensive experiments demonstrate that CoIn3D achieves strong cross-configuration performance on landmark datasets such as NuScenes, Waymo, and Lyft, under three dominant MC3D paradigms represented by BEVDepth, BEVFormer, and PETR.
核心發現: 核心結果:Extensive experiments demonstrate that CoIn3D achieves strong cross-configuration performance on landmark datasets such as NuScenes, Waymo, and Lyft, under three dominant MC3D paradigms represented by
Direct Contact-Tolerant Motion Planning With Vision Language Models
Authors: He Li, Jian Sun, Chengyang Li et al. | Submitted: 2026-03-05 | arXiv: 2603.05017
Categories: cs.RO
Research Background: Navigation in cluttered environments often requires robots to tolerate contact with movable or deformable objects to maintain efficiency. Existing contact-tolerant motion planning (CTMP) methods rely on indirect spatial representations (e.g., prebuilt map, obstacle set), resulting in inaccuracies and a lack of adaptiveness to environmental uncertainties.
研究背景: 在機器人學習領域,Navigation in cluttered environments often requires robots to tolerate contact with movable or deformable objects to maintain efficiency. Existing contact-tolerant motion planning
Technical Approach: To address this issue, we propose a direct contact-tolerant (DCT) planner, which integrates vision-language models (VLMs) into direct point perception and navigation, including two key components.
技術方法: 本文提出的方法:To address this issue, we propose a direct contact-tolerant (DCT) planner, which integrates vision-language models (VLMs) into direct point perception and navigation, including two key components.
Key Takeaway: We implement DCT in Isaac Sim and a real car-like robot, demonstrating that DCT achieves robust and efficient navigation in cluttered environments with movable obstacles, outperforming representative baselines across diverse metrics.
核心發現: 核心結果:We implement DCT in Isaac Sim and a real car-like robot, demonstrating that DCT achieves robust and efficient navigation in cluttered environments with movable obstacles, outperforming representative
Integrated cooperative localization of heterogeneous measurement swarm: A unified data-driven method
Authors: Kunrui Ze, Wei Wang, Guibin Sun et al. | Submitted: 2026-03-05 | arXiv: 2603.04932
Categories: cs.RO
Research Background: The cooperative localization (CL) problem in heterogeneous robotic systems with different measurement capabilities is investigated in this work. In practice, heterogeneous sensors lead to directed and sparse measurement topologies, whereas most existing CL approaches rely on multilateral localization with restrictive multi-neighbor geometric requirements.
研究背景: 在機器人學習領域,The cooperative localization (CL) problem in heterogeneous robotic systems with different measurement capabilities is investigated in this work. In practice, heterogeneous sensors
Technical Approach: In practice, heterogeneous sensors lead to directed and sparse measurement topologies, whereas most existing CL approaches rely on multilateral localization with restrictive multi-neighbor geometric requirements. To overcome this limitation, we enable pairwise relative localization (RL) between neighboring robots using only mutual measurement and odometry information. A unified data-driven adaptive RL estimator is first developed to handle heterogeneous and unidirectional measurements.
技術方法: 本文提出的方法:In practice, heterogeneous sensors lead to directed and sparse measurement topologies, whereas most existing CL approaches rely on multilateral localization with restrictive multi-neighbor geometric r
Key Takeaway: The proposed method is independent of specific control tasks and is validated through a formation control application and real-world experiments.
核心發現: 核心結果:The proposed method is independent of specific control tasks and is validated through a formation control application and real-world experiments.
On the Strengths and Weaknesses of Data for Open-set Embodied Assistance
Authors: Pradyumna Tambwekar, Andrew Silva, Deepak Gopinath et al. | Submitted: 2026-03-05 | arXiv: 2603.04819
Categories: cs.RO, cs.AI, cs.LG
Research Background: Embodied foundation models are increasingly performant in real-world domains such as robotics or autonomous driving. These models are often deployed in interactive or assistive settings, where it is important that these assistive models generalize to new users and new tasks.
研究背景: 在機器人學習領域,Embodied foundation models are increasingly performant in real-world domains such as robotics or autonomous driving. These models are often deployed in interactive or assistive set
Technical Approach: In this paper, we investigate the generalization capabilities of a multimodal foundation model fine-tuned on diverse interactive assistance data in a synthetic domain. Our approach provides key insights into the nature of assistive datasets required to enable open-set assistive intelligence.
技術方法: 本文提出的方法:In this paper, we investigate the generalization capabilities of a multimodal foundation model fine-tuned on diverse interactive assistance data in a synthetic domain. Our approach provides key insigh
Key Takeaway: In particular, we show that performant models benefit from datasets that cover different aspects of assistance, including multimodal grounding, defect inference, and exposure to diverse scenarios.
核心發現: 核心結果:In particular, we show that performant models benefit from datasets that cover different aspects of assistance, including multimodal grounding, defect inference, and exposure to diverse scenarios.
LLM-Guided Decentralized Exploration with Self-Organizing Robot Teams
Authors: Hiroaki Kawashima, Shun Ikejima, Takeshi Takai et al. | Submitted: 2026-03-05 | arXiv: 2603.04762
Categories: cs.RO, cs.MA
Research Background: When individual robots have limited sensing capabilities or insufficient fault tolerance, it becomes necessary for multiple robots to form teams during exploration, thereby increasing the collective observation range and reliability. Traditionally, swarm formation has often been managed by a central controller; however, from the perspectives of robustness and flexibility, it is preferable for the swarm to operate autonomously even in the absence of centralized control.
研究背景: 在機器人學習領域,When individual robots have limited sensing capabilities or insufficient fault tolerance, it becomes necessary for multiple robots to form teams during exploration, thereby increas
Technical Approach: Traditionally, swarm formation has often been managed by a central controller; however, from the perspectives of robustness and flexibility, it is preferable for the swarm to operate autonomously even in the absence of centralized control. In addition, the determination of exploration targets for each team is crucial for efficient exploration in such multi-team exploration scenarios. This study therefore proposes an exploration method that combines (1) an algorithm for self-organization, enabling the autonomous and dynamic formation of multiple teams, and (2) an algorithm that allows each team to autonomously determine its next exploration target (destination).
技術方法: 本文提出的方法:Traditionally, swarm formation has often been managed by a central controller; however, from the perspectives of robustness and flexibility, it is preferable for the swarm to operate autonomously even
Key Takeaway: The effectiveness of the proposed method was validated through simulations involving tens to hundreds of robots.
核心發現: 核心結果:The effectiveness of the proposed method was validated through simulations involving tens to hundreds of robots.
Selecting Spots by Explicitly Predicting Intention from Motion History Improves Performance in Autonomous Parking
Authors: Long Kiu Chung, David Isele, Faizan M. Tariq et al. | Submitted: 2026-03-05 | arXiv: 2603.04695
Categories: cs.RO
Research Background: In many applications of social navigation, existing works have shown that predicting and reasoning about human intentions can help robotic agents make safer and more socially acceptable decisions. In this work, we study this problem for autonomous valet parking (AVP), where an autonomous vehicle ego agent must drop off its passengers, explore the parking lot, find a parking spot, negotiate for the spot with other vehicles, and park in the spot without human supervision.
研究背景: 在機器人學習領域,In many applications of social navigation, existing works have shown that predicting and reasoning about human intentions can help robotic agents make safer and more socially accep
Technical Approach: Specifically, we propose an AVP pipeline that selects parking spots by explicitly predicting where other agents are going to park from their motion history using learned models and probabilistic belief maps. To test this pipeline, we build a simulation environment with reactive agents and realistic modeling assumptions on the ego agent, such as occlusion-aware observations, and imperfect trajectory prediction.
技術方法: 本文提出的方法:Specifically, we propose an AVP pipeline that selects parking spots by explicitly predicting where other agents are going to park from their motion history using learned models and probabilistic belie
Key Takeaway: Simulation experiments show that our proposed method outperforms existing works that infer intentions from future predicted motion or embed them implicitly in end-to-end models, yielding better results in prediction accuracy, social acceptance, and task completion.
核心發現: 核心結果:Simulation experiments show that our proposed method outperforms existing works that infer intentions from future predicted motion or embed them implicitly in end-to-end models, yielding better result
Post Fusion Bird’s Eye View Feature Stabilization for Robust Multimodal 3D Detection
Authors: Trung Tien Dong, Dev Thakkar, Arman Sargolzaei et al. | Submitted: 2026-03-05 | arXiv: 2603.05623
Categories: cs.CV, cs.AI
Research Background: Camera-LiDAR fusion is widely used in autonomous driving to enable accurate 3D object detection. However, bird’s-eye view (BEV) fusion detectors can degrade significantly under domain shift and sensor failures, limiting reliability in real-world deployment.
研究背景: 在機器人學習領域,Camera-LiDAR fusion is widely used in autonomous driving to enable accurate 3D object detection. However, bird’s-eye view (BEV) fusion detectors can degrade significantly under dom
Technical Approach: We propose a Post Fusion Stabilizer (PFS), a lightweight module that operates on intermediate BEV representations of existing detectors and produces a refined feature map for the original detection head.
技術方法: 本文提出的方法:We propose a Post Fusion Stabilizer (PFS), a lightweight module that operates on intermediate BEV representations of existing detectors and produces a refined feature map for the original detection he
Key Takeaway: Evaluations on the nuScenes benchmark demonstrate that PFS achieves state-of-the-art results in several failure modes, notably improving camera dropout robustness by +1.2% and low-light performance by +4.4% mAP while maintaining a lightweight footprint of only 3.3 M parameters.
核心發現: 核心結果:Evaluations on the nuScenes benchmark demonstrate that PFS achieves state-of-the-art results in several failure modes, notably improving camera dropout robustness by +1.2% and low-light performance by
Feasibility Restoration under Conflicting STL Specifications with Pareto-Optimal Refinement
Authors: Tianhao Wu, Yiwei Lyu | Submitted: 2026-03-06 | arXiv: 2603.06947
Categories: cs.RO
Research Background: Signal Temporal Logic (STL) is expressive formal language that specifies spatio-temporal requirements in robotics. Its quantitative robustness semantics can be easily integrated with optimization-based control frameworks.
研究背景: 在機器人學習領域,Signal Temporal Logic (STL) is expressive formal language that specifies spatio-temporal requirements in robotics. Its quantitative robustness semantics can be easily integrated wi
Technical Approach: In this paper, we proposes a unified two-stage framework that first restores feasibility via minimal relaxation, then refine the feasible solution by formulating it as a value-aware multi-objective optimization problem.
技術方法: 本文提出的方法:In this paper, we proposes a unified two-stage framework that first restores feasibility via minimal relaxation, then refine the feasible solution by formulating it as a value-aware multi-objective op
Key Takeaway: We demonstrate that the proposed approach avoids deadlock under conflicting STL specifications and enables interpretable decision-making in safety-critical applications by conducting a case study in autonomous driving.
核心發現: 核心結果:We demonstrate that the proposed approach avoids deadlock under conflicting STL specifications and enables interpretable decision-making in safety-critical applications by conducting a case study in a
LIPP: Load-Aware Informative Path Planning with Physical Sampling
Authors: Hojune Kim, Guangyao Shi, Gaurav S. Sukhatme | Submitted: 2026-03-06 | arXiv: 2603.06924
Categories: cs.RO
Research Background: In classical Informative Path Planning (C-IPP), robots are typically modeled as mobile sensors that acquire digital measurements such as images or radiation levels. In this model - since making a measurement leaves the robot’s physical state unchanged - traversal costs are determined solely by the path taken.
研究背景: 在機器人學習領域,In classical Informative Path Planning (C-IPP), robots are typically modeled as mobile sensors that acquire digital measurements such as images or radiation levels. In this model -
Technical Approach: In this paper, we introduce Load-aware Informative Path Planning (LIPP ), a generalization of C-IPP that explicitly models this coupling and the resulting order-dependent traversal costs. We formulate LIPP as a Mixed-Integer Quadratic Program (MIQP) that jointly optimizes routing, visitation order, and per-location sampling count under an energy budget.
技術方法: 本文提出的方法:In this paper, we introduce Load-aware Informative Path Planning (LIPP ), a generalization of C-IPP that explicitly models this coupling and the resulting order-dependent traversal costs. We formulate
Key Takeaway: Finally, through extensive simulations across 2000 diverse mission scenarios, we demonstrate that LIPP matches the behavior of C-IPP at zero sample mass and progressively achieves higher uncertainty reduction per unit energy as sample mass increases.
核心發現: 核心結果:Finally, through extensive simulations across 2000 diverse mission scenarios, we demonstrate that LIPP matches the behavior of C-IPP at zero sample mass and progressively achieves higher uncertainty r
SurgSync: Time-Synchronized Multi-Modal Data Collection Framework and Dataset for Surgical Robotics
Authors: Haoying Zhou, Chang Liu, Yimeng Wu et al. | Submitted: 2026-03-06 | arXiv: 2603.06919
Categories: cs.RO
Research Background: Most existing robotic surgery systems adopt a human-in-the-loop paradigm, often with the surgeon directly teleoperating the robotic system. Adding intelligence to these robots would enable higher-level control, such as supervised autonomy or even full autonomy.
研究背景: 在機器人學習領域,Most existing robotic surgery systems adopt a human-in-the-loop paradigm, often with the surgeon directly teleoperating the robotic system. Adding intelligence to these robots woul
Technical Approach: Adding intelligence to these robots would enable higher-level control, such as supervised autonomy or even full autonomy. However, artificial intelligence (AI) requires large amounts of training data, which is currently lacking. This work proposes SurgSync, a multi-modal data collection framework with offline and online synchronization to support training and real-time inference, respectively.
技術方法: 本文提出的方法:Adding intelligence to these robots would enable higher-level control, such as supervised autonomy or even full autonomy. However, artificial intelligence (AI) requires large amounts of training data,
Key Takeaway: Through the user study experiments, we obtained a dataset of 214 validated instances across multiple canonical training tasks.
核心發現: 核心結果:Through the user study experiments, we obtained a dataset of 214 validated instances across multiple canonical training tasks.
T2Nav Algebraic Topology Aware Temporal Graph Memory and Loop Detection for ZeroShot Visual Navigation
Authors: Quang-Anh N. D., Duc Pham, Minh-Anh Nguyen et al. | Submitted: 2026-03-06 | arXiv: 2603.06918
Categories: cs.RO
Research Background: Deploying autonomous agents in real world environments is challenging, particularly for navigation, where systems must adapt to situations they have not encountered before. Traditional learning approaches require substantial amounts of data, constant tuning, and, sometimes, starting over for each new task.
研究背景: 在機器人學習領域,Deploying autonomous agents in real world environments is challenging, particularly for navigation, where systems must adapt to situations they have not encountered before. Traditi
Technical Approach: Here, we introduce T2Nav, a zeroshot navigation system that integrates heterogeneous data and employs graph-based reasoning. By directly incorporating visual information into the graph and matching it to the environment, our approach enables the system to strike a good balance between exploration and goal attainment. Experiments demonstrate that our approach is efficient and adapts well to unknown environments, moving toward practical zero-shot instance-image navigation capabilities.
技術方法: 本文提出的方法:Here, we introduce T2Nav, a zeroshot navigation system that integrates heterogeneous data and employs graph-based reasoning. By directly incorporating visual information into the graph and matching it
Key Takeaway: Experiments demonstrate that our approach is efficient and adapts well to unknown environments, moving toward practical zero-shot instance-image navigation capabilities.
核心發現: 核心結果:Experiments demonstrate that our approach is efficient and adapts well to unknown environments, moving toward practical zero-shot instance-image navigation capabilities.
VertiAdaptor: Online Kinodynamics Adaptation for Vertically Challenging Terrain
Authors: Tong Xu, Chenhui Pan, Aniket Datar et al. | Submitted: 2026-03-06 | arXiv: 2603.06887
Categories: cs.RO
Research Background: Autonomous driving in off-road environments presents significant challenges due to the dynamic and unpredictable nature of unstructured terrain. Traditional kinodynamic models often struggle to generalize across diverse geometric and semantic terrain types, underscoring the need for real-time adaptation to ensure safe and reliable navigation.
研究背景: 在機器人學習領域,Autonomous driving in off-road environments presents significant challenges due to the dynamic and unpredictable nature of unstructured terrain. Traditional kinodynamic models ofte
Technical Approach: We propose VertiAdaptor (VA), a novel online adaptation framework that efficiently integrates elevation with semantic embeddings to enable terrain-aware kinodynamic modeling and planning via function encoders.
技術方法: 本文提出的方法:We propose VertiAdaptor (VA), a novel online adaptation framework that efficiently integrates elevation with semantic embeddings to enable terrain-aware kinodynamic modeling and planning via function
Key Takeaway: Our results demonstrate that VA improves prediction accuracy by up to 23.9% and achieves a 5X faster adaptation time, advancing the robustness and reliability of autonomous robots in complex and evolving off-road environments.
核心發現: 核心結果:Our results demonstrate that VA improves prediction accuracy by up to 23.9% and achieves a 5X faster adaptation time, advancing the robustness and reliability of autonomous robots in complex and evolv
Receding-Horizon Nullspace Optimization for Actuation-Aware Control Allocation in Omnidirectional UAVs
Authors: Riccardo Pretto, Mahmoud Hamandi, Abdullah Mohamed Ali et al. | Submitted: 2026-03-06 | arXiv: 2603.06832
Categories: cs.RO
Research Background: Fully actuated omnidirectional UAVs enable independent control of forces and torques along all six degrees of freedom, broadening the operational envelope for agile flight and aerial interaction tasks. However, conventional control allocation methods neglect the asymmetric dynamics of the onboard actuators, which can induce oscillatory motor commands and degrade trajectory tracking during dynamic maneuvers.
研究背景: 在機器人學習領域,Fully actuated omnidirectional UAVs enable independent control of forces and torques along all six degrees of freedom, broadening the operational envelope for agile flight and aeri
Technical Approach: However, conventional control allocation methods neglect the asymmetric dynamics of the onboard actuators, which can induce oscillatory motor commands and degrade trajectory tracking during dynamic maneuvers. This work proposes a receding-horizon, actuation-aware allocation strategy that explicitly incorporates asymmetric motor dynamics and exploits the redundancy of over-actuated platforms through nullspace optimization. By forward-simulating the closed-loop system over a prediction horizon, the method anticipates actuator-induced oscillations and suppresses them through smooth redistribution of motor commands, while preserving the desired body wrench exactly.
技術方法: 本文提出的方法:However, conventional control allocation methods neglect the asymmetric dynamics of the onboard actuators, which can induce oscillatory motor commands and degrade trajectory tracking during dynamic ma
Key Takeaway: Simulation results on the OmniOcta platform demonstrate that the proposed method significantly reduces motor command oscillations compared to a conventional single-step quadratic programming allocator, yielding improved trajectory tracking in both position and orientation.
核心發現: 核心結果:Simulation results on the OmniOcta platform demonstrate that the proposed method significantly reduces motor command oscillations compared to a conventional single-step quadratic programming allocator
Learning-Based Robust Control: Unifying Exploration and Distributional Robustness for Reliable Robotics via Free Energy
Authors: Hozefa Jesawada, Giovanni Russo, Abdalla Swikir et al. | Submitted: 2026-03-06 | arXiv: 2603.06831
Categories: cs.RO, math.OC
Research Background: A key challenge towards reliable robotic control is devising computational models that can both learn policies and guarantee robustness when deployed in the field. Inspired by the free energy principle in computational neuroscience, to address these challenges, we propose a model for policy computation that jointly learns environment dynamics and rewards, while ensuring robustness to epistemic uncertainties.
研究背景: 在機器人學習領域,A key challenge towards reliable robotic control is devising computational models that can both learn policies and guarantee robustness when deployed in the field. Inspired by the
Technical Approach: Inspired by the free energy principle in computational neuroscience, to address these challenges, we propose a model for policy computation that jointly learns environment dynamics and rewards, while ensuring robustness to epistemic uncertainties. Expounding a distributionally robust free energy principle, we propose a modification to the maximum diffusion learning framework. Across simulation and zero-shot deployment, our approach narrows the sim-to-real gap, and enables repeatable tabletop manipulation without task-specific fine-tuning.
技術方法: 本文提出的方法:Inspired by the free energy principle in computational neuroscience, to address these challenges, we propose a model for policy computation that jointly learns environment dynamics and rewards, while
Key Takeaway: After explicitly characterizing robustness of our policies to epistemic uncertainties in both environment and reward, we validate their effectiveness on continuous-control benchmarks, via both simulations and real-world experiments involving manipulation with a Franka Research~3 arm.
核心發現: 核心結果:After explicitly characterizing robustness of our policies to epistemic uncertainties in both environment and reward, we validate their effectiveness on continuous-control benchmarks, via both simulat
BEVLM: Distilling Semantic Knowledge from LLMs into Bird’s-Eye View Representations
Authors: Thomas Monninger, Shaoyuan Xie, Qi Alfred Chen et al. | Submitted: 2026-03-06 | arXiv: 2603.06576
Categories: cs.CV, cs.AI, cs.LG, cs.RO
Research Background: The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are essential for handling complex decision-making and long-tail scenarios. However, existing methods typically feed LLMs with tokens from multi-view and multi-frame images independently, leading to redundant computation and limited spatial consistency.
研究背景: 在機器人學習領域,The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are es
Technical Approach: To bridge this gap, we propose BEVLM, a framework that connects a spatially consistent and semantically distilled BEV representation with LLMs.
技術方法: 本文提出的方法:To bridge this gap, we propose BEVLM, a framework that connects a spatially consistent and semantically distilled BEV representation with LLMs.
Key Takeaway: Furthermore, by distilling semantic knowledge from LLMs into BEV representations, BEVLM significantly improves closed-loop end-to-end driving performance by 29% in safety-critical scenarios.
核心發現: 核心結果:Furthermore, by distilling semantic knowledge from LLMs into BEV representations, BEVLM significantly improves closed-loop end-to-end driving performance by 29% in safety-critical scenarios.
Fly360: Omnidirectional Obstacle Avoidance within Drone View
Authors: Xiangkai Zhang, Dizhe Zhang, WenZhuo Cao et al. | Submitted: 2026-03-06 | arXiv: 2603.06573
Categories: cs.RO, cs.AI
Research Background: Obstacle avoidance in unmanned aerial vehicles (UAVs), as a fundamental capability, has gained increasing attention with the growing focus on spatial intelligence. However, current obstacle-avoidance methods mainly depend on limited field-of-view sensors and are ill-suited for UAV scenarios which require full-spatial awareness when the movement direction differs from the UAV’s heading.
研究背景: 在機器人學習領域,Obstacle avoidance in unmanned aerial vehicles (UAVs), as a fundamental capability, has gained increasing attention with the growing focus on spatial intelligence. However, current
Technical Approach: Based on such settings, we propose Fly360, a two-stage perception-decision pipeline with a fixed random-yaw training strategy.
技術方法: 本文提出的方法:Based on such settings, we propose Fly360, a two-stage perception-decision pipeline with a fixed random-yaw training strategy.
Key Takeaway: Extensive simulation and real-world experiments demonstrate that Fly360 achieves stable omnidirectional obstacle avoidance and outperforms forward-view baselines across all tasks.
核心發現: 核心結果:Extensive simulation and real-world experiments demonstrate that Fly360 achieves stable omnidirectional obstacle avoidance and outperforms forward-view baselines across all tasks.
SG-DOR: Learning Scene Graphs with Direction-Conditioned Occlusion Reasoning for Pepper Plants
Authors: Rohit Menon, Niklas Mueller-Goldingen, Sicong Pan et al. | Submitted: 2026-03-06 | arXiv: 2603.06512
Categories: cs.RO, cs.CV
Research Background: Robotic harvesting in dense crop canopies requires effective interventions that depend not only on geometry, but also on explicit, direction-conditioned relations identifying which organs obstruct a target fruit. We present SG-DOR (Scene Graphs with Direction-Conditioned Occlusion Reasoning), a relational framework that, given instance-segmented organ point clouds, infers a scene graph encoding physical attachments and direction-conditioned occlusion.
研究背景: 在機器人學習領域,Robotic harvesting in dense crop canopies requires effective interventions that depend not only on geometry, but also on explicit, direction-conditioned relations identifying which
Technical Approach: We present SG-DOR (Scene Graphs with Direction-Conditioned Occlusion Reasoning), a relational framework that, given instance-segmented organ point clouds, infers a scene graph encoding physical attachments and direction-conditioned occlusion. We introduce an occlusion ranking task for retrieving and ranking candidate leaves for a target fruit and approach direction, and propose a direction-aware graph neural architecture with per-fruit leaf-set attention and union-level aggregation.
技術方法: 本文提出的方法:We present SG-DOR (Scene Graphs with Direction-Conditioned Occlusion Reasoning), a relational framework that, given instance-segmented organ point clouds, infers a scene graph encoding physical attach
Key Takeaway: Experiments on a multi-plant synthetic pepper dataset show improved occlusion prediction (F1=0.73, NDCG@3=0.85) and attachment inference (edge F1=0.83) over strong ablations, yielding a structured relational signal for downstream intervention planning.
核心發現: 核心結果:Experiments on a multi-plant synthetic pepper dataset show improved occlusion prediction (F1=0.73, NDCG@3=0.85) and attachment inference (edge F1=0.83) over strong ablations, yielding a structured rel
Control Barrier Corridors: From Safety Functions to Safe Sets
Authors: Ömür Arslan, Nikolay Atanasov | Submitted: 2026-03-06 | arXiv: 2603.06494
Categories: cs.RO, eess.SY
Research Background: Safe autonomy is a critical requirement and a key enabler for robots to operate safely in unstructured complex environments. Control barrier functions and safe motion corridors are two widely used but technically distinct safety methods, functional and geometric, respectively, for safe motion planning and control.
研究背景: 在機器人學習領域,Safe autonomy is a critical requirement and a key enabler for robots to operate safely in unstructured complex environments. Control barrier functions and safe motion corridors are
Technical Approach: This paper introduces a new notion of control barrier corridors, which unifies these two approaches by converting control barrier functions into local safe goal regions for reference goal selection in feedback control systems.
技術方法: 本文提出的方法:This paper introduces a new notion of control barrier corridors, which unifies these two approaches by converting control barrier functions into local safe goal regions for reference goal selection in
Key Takeaway: Such safe control barrier corridors enable safely reachable persistent goal selection over continuously changing barrier corridors during system motion, which we demonstrate for verifiably safe and persistent path following in autonomous exploration of unknown environments.
核心發現: 核心結果:Such safe control barrier corridors enable safely reachable persistent goal selection over continuously changing barrier corridors during system motion, which we demonstrate for verifiably safe and pe
Gradient-based Nested Co-Design of Aerodynamic Shape and Control for Winged Robots
Authors: Daniele Affinita, Mingda Xu, Benoît Valentin Gherardi et al. | Submitted: 2026-03-06 | arXiv: 2603.06760
Categories: cs.RO, cs.AI
Research Background: Designing aerial robots for specialized tasks, from perching to payload delivery, requires tailoring their aerodynamic shape to specific mission requirements. For tasks involving wide flight envelopes, the usual sequential process of first determining the shape and then the motion planner is likely to be suboptimal due to the inherent nonlinear interactions between them.
研究背景: 在機器人學習領域,Designing aerial robots for specialized tasks, from perching to payload delivery, requires tailoring their aerodynamic shape to specific mission requirements. For tasks involving w
Technical Approach: In this paper, we present a general-purpose, gradient-based, nested co-design framework where the motion planner solves an optimal control problem and the aerodynamic forces used in the dynamics model are determined by a neural surrogate model. We validate our method on two complex dynamic tasks for fixed-wing gliders: perching and a short landing.
技術方法: 本文提出的方法:In this paper, we present a general-purpose, gradient-based, nested co-design framework where the motion planner solves an optimal control problem and the aerodynamic forces used in the dynamics model
Key Takeaway: Our optimized designs improve task performance compared to an evolutionary baseline in a fraction of the computation time.
核心發現: 核心結果:Our optimized designs improve task performance compared to an evolutionary baseline in a fraction of the computation time.
Can we Trust Unreliable Voxels? Exploring 3D Semantic Occupancy Prediction under Label Noise
Authors: Wenxin Li, Kunyu Peng, Di Wen et al. | Submitted: 2026-03-06 | arXiv: 2603.06279
Categories: cs.CV, cs.RO, eess.IV
Research Background: 3D semantic occupancy prediction is a cornerstone of robotic perception, yet real-world voxel annotations are inherently corrupted by structural artifacts and dynamic trailing effects. This raises a critical but underexplored question: can autonomous systems safely rely on such unreliable occupancy supervision?
研究背景: 在機器人學習領域,3D semantic occupancy prediction is a cornerstone of robotic perception, yet real-world voxel annotations are inherently corrupted by structural artifacts and dynamic trailing effe
Technical Approach: To address this challenge, we propose DPR-Occ, a principled label noise-robust framework that constructs reliable supervision through dual-source partial label reasoning. Notably, even at 90% label noise, our method achieves significant performance gains (up to 2.57% mIoU and 13.91% IoU) over existing label noise learning baselines adapted to the 3D occupancy prediction task.
技術方法: 本文提出的方法:To address this challenge, we propose DPR-Occ, a principled label noise-robust framework that constructs reliable supervision through dual-source partial label reasoning. Notably, even at 90% label no
Key Takeaway: Notably, even at 90% label noise, our method achieves significant performance gains (up to 2.57% mIoU and 13.91% IoU) over existing label noise learning baselines adapted to the 3D occupancy prediction task.
核心發現: 核心結果:Notably, even at 90% label noise, our method achieves significant performance gains (up to 2.57% mIoU and 13.91% IoU) over existing label noise learning baselines adapted to the 3D occupancy predictio
NOVA: Next-step Open-Vocabulary Autoregression for 3D Multi-Object Tracking in Autonomous Driving
Authors: Kai Luo, Xu Wang, Rui Fan et al. | Submitted: 2026-03-06 | arXiv: 2603.06254
Categories: cs.CV, cs.RO, eess.IV
Research Background: Generalizing across unknown targets is critical for open-world perception, yet existing 3D Multi-Object Tracking (3D MOT) pipelines remain limited by closed-set assumptions and semantic-blind'' heuristics. To address this, we propose Next-step Open-Vocabulary Autoregression (NOVA), an innovative paradigm that shifts 3D tracking from traditional fragmented distance-based matching toward generative spatio-temporal semantic modeling. **研究背景:** 在機器人學習領域,Generalizing across unknown targets is critical for open-world perception, yet existing 3D Multi-Object Tracking (3D MOT) pipelines remain limited by closed-set assumptions and s
Technical Approach: To address this, we propose Next-step Open-Vocabulary Autoregression (NOVA), an innovative paradigm that shifts 3D tracking from traditional fragmented distance-based matching toward generative spatio-temporal semantic modeling.
技術方法: 本文提出的方法:To address this, we propose Next-step Open-Vocabulary Autoregression (NOVA), an innovative paradigm that shifts 3D tracking from traditional fragmented distance-based matching toward generative spatio
Key Takeaway: Notably, on the nuScenes dataset, NOVA achieves an AMOTA of 22.41% for Novel categories, yielding a significant 20.21% absolute improvement over the baseline.
核心發現: 核心結果:Notably, on the nuScenes dataset, NOVA achieves an AMOTA of 22.41% for Novel categories, yielding a significant 20.21% absolute improvement over the baseline.
TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Driving
Authors: Mingyu Fan, Yi Liu, Hao Zhou et al. | Submitted: 2026-03-06 | arXiv: 2603.06231
Categories: cs.CV, cs.AI, cs.RO
Research Background: Trajectory prediction is essential for autonomous driving, enabling vehicles to anticipate the motion of surrounding agents to support safe planning. However, most existing predictors assume fixed-length histories and suffer substantial performance degradation when observations are variable or extremely short in real-world settings (e.g., due to occlusion or a limited sensing range).
研究背景: 在機器人學習領域,Trajectory prediction is essential for autonomous driving, enabling vehicles to anticipate the motion of surrounding agents to support safe planning. However, most existing predict
Technical Approach: We propose TaPD (Temporal-adaptive Progressive Distillation), a unified plug-and-play framework for observation-adaptive trajectory forecasting under variable history lengths.
技術方法: 本文提出的方法:We propose TaPD (Temporal-adaptive Progressive Distillation), a unified plug-and-play framework for observation-adaptive trajectory forecasting under variable history lengths.
Key Takeaway: Extensive experiments on Argoverse 1 and Argoverse 2 show that TaPD consistently outperforms strong baselines across all observation lengths, delivers especially large gains under very short inputs, and improves other predictors (e.g., HiVT) in a plug-and-play manner.
核心發現: 核心結果:Extensive experiments on Argoverse 1 and Argoverse 2 show that TaPD consistently outperforms strong baselines across all observation lengths, delivers especially large gains under very short inputs, a
VG3S: Visual Geometry Grounded Gaussian Splatting for Semantic Occupancy Prediction
Authors: Xiaoyang Yan, Muleilan Pei, Shaojie Shen | Submitted: 2026-03-06 | arXiv: 2603.06210
Categories: cs.CV, cs.RO
Research Background: 3D semantic occupancy prediction has become a crucial perception task for comprehensive scene understanding in autonomous driving. While recent advances have explored 3D Gaussian splatting for occupancy modeling to substantially reduce computational overhead, the generation of high-quality 3D Gaussians relies heavily on accurate geometric cues, which are often insufficient in purely vision-centric paradigms.
研究背景: 在機器人學習領域,3D semantic occupancy prediction has become a crucial perception task for comprehensive scene understanding in autonomous driving. While recent advances have explored 3D Gaussian s
Technical Approach: In this regard, we introduce Visual Geometry Grounded Gaussian Splatting (VG3S), a novel framework that empowers Gaussian-based occupancy prediction with cross-view 3D geometric grounding. Specifically, to fully exploit the rich 3D geometric priors from a frozen VFM, we propose a plug-and-play hierarchical geometric feature adapter, which can effectively transform generic VFM tokens via feature aggregation, task-specific alignment, and multi-scale restructuring.
技術方法: 本文提出的方法:In this regard, we introduce Visual Geometry Grounded Gaussian Splatting (VG3S), a novel framework that empowers Gaussian-based occupancy prediction with cross-view 3D geometric grounding. Specificall
Key Takeaway: Furthermore, we show that VG3S generalizes seamlessly across diverse VFMs, consistently enhancing occupancy prediction accuracy and firmly underscoring the immense value of integrating priors derived from powerful, pre-trained geometry-grounded VFMs.
核心發現: 核心結果:Furthermore, we show that VG3S generalizes seamlessly across diverse VFMs, consistently enhancing occupancy prediction accuracy and firmly underscoring the immense value of integrating priors derived
Transforming Omnidirectional RGB-LiDAR data into 3D Gaussian Splatting
Authors: Semin Bae, Hansol Lim, Jongseong Brad Choi | Submitted: 2026-03-06 | arXiv: 2603.06061
Categories: cs.CV, cs.RO
Research Background: The demand for large-scale digital twins is rapidly growing in robotics and autonomous driving. However, constructing these environments with 3D Gaussian Splatting (3DGS) usually requires expensive, purpose-built data collection.
研究背景: 在機器人學習領域,The demand for large-scale digital twins is rapidly growing in robotics and autonomous driving. However, constructing these environments with 3D Gaussian Splatting (3DGS) usually r
Technical Approach: In this paper, we present an omnidirectional RGB-LiDAR reuse pipeline that transforms these archived logs into robust initialization assets for 3DGS.
技術方法: 本文提出的方法:In this paper, we present an omnidirectional RGB-LiDAR reuse pipeline that transforms these archived logs into robust initialization assets for 3DGS.
Key Takeaway: Meanwhile, deployed platforms routinely collect extensive omnidirectional RGB and LiDAR logs, but a significant portion of these sensor data is directly discarded or strictly underutilized due to transmission constraints and the lack of scalable reuse pipeline.
核心發現: 核心結果:Meanwhile, deployed platforms routinely collect extensive omnidirectional RGB and LiDAR logs, but a significant portion of these sensor data is directly discarded or strictly underutilized due to tran
Improved Constrained Generation by Bridging Pretrained Generative Models
Authors: Xiaoxuan Liang, Saeid Naderiparizi, Yunpeng Liu et al. | Submitted: 2026-03-06 | arXiv: 2603.06742
Categories: cs.LG, cs.AI, cs.RO
Research Background: Constrained generative modeling is fundamental to applications such as robotic control and autonomous driving, where models must respect physical laws and safety-critical constraints. In real-world settings, these constraints rarely take the form of simple linear inequalities, but instead complex feasible regions that resemble road maps or other structured spatial domains.
研究背景: 在機器人學習領域,Constrained generative modeling is fundamental to applications such as robotic control and autonomous driving, where models must respect physical laws and safety-critical constrain
Technical Approach: We propose a constrained generation framework that generates samples directly within such feasible regions while preserving realism. Our method fine-tunes a pretrained generative model to enforce constraints while maintaining generative fidelity. Experimentally, our method exhibits characteristics distinct from existing fine-tuning and training-free constrained baselines, revealing a new compromise between constraint satisfaction and sampling quality.
技術方法: 本文提出的方法:We propose a constrained generation framework that generates samples directly within such feasible regions while preserving realism. Our method fine-tunes a pretrained generative model to enforce cons
Key Takeaway: Experimentally, our method exhibits characteristics distinct from existing fine-tuning and training-free constrained baselines, revealing a new compromise between constraint satisfaction and sampling quality.
核心發現: 核心結果:Experimentally, our method exhibits characteristics distinct from existing fine-tuning and training-free constrained baselines, revealing a new compromise between constraint satisfaction and sampling
TADPO: Reinforcement Learning Goes Off-road
Authors: Zhouchonghao Wu, Raymond Song, Vedant Mundheda et al. | Submitted: 2026-03-06 | arXiv: 2603.05995
Categories: cs.RO, cs.AI, cs.LG
Research Background: Off-road autonomous driving poses significant challenges such as navigating unmapped, variable terrain with uncertain and diverse dynamics. Addressing these challenges requires effective long-horizon planning and adaptable control.
研究背景: 在機器人學習領域,Off-road autonomous driving poses significant challenges such as navigating unmapped, variable terrain with uncertain and diverse dynamics. Addressing these challenges requires eff
Technical Approach: We introduce TADPO, a novel policy gradient formulation that extends Proximal Policy Optimization (PPO), leveraging off-policy trajectories for teacher guidance and on-policy trajectories for student exploration. Building on this, we develop a vision-based, end-to-end RL system for high-speed off-road driving, capable of navigating extreme slopes and obstacle-rich terrain.
技術方法: 本文提出的方法:We introduce TADPO, a novel policy gradient formulation that extends Proximal Policy Optimization (PPO), leveraging off-policy trajectories for teacher guidance and on-policy trajectories for student
Key Takeaway: We demonstrate our performance in simulation and, importantly, zero-shot sim-to-real transfer on a full-scale off-road vehicle.
核心發現: 核心結果:We demonstrate our performance in simulation and, importantly, zero-shot sim-to-real transfer on a full-scale off-road vehicle.
How to Model Your Crazyflie Brushless
Authors: Alexander Gräfe, Christoph Scherer, Wolfgang Hönig et al. | Submitted: 2026-03-06 | arXiv: 2603.05944
Categories: cs.RO
Research Background: The Crazyflie quadcopter is widely recognized as a leading platform for nano-quadcopter research. In early 2025, the Crazyflie Brushless was introduced, featuring brushless motors that provide around 50% more thrust compared to the brushed motors of its predecessor, the Crazyflie 2.1.
研究背景: 在機器人學習領域,The Crazyflie quadcopter is widely recognized as a leading platform for nano-quadcopter research. In early 2025, the Crazyflie Brushless was introduced, featuring brushless motors
Technical Approach: In early 2025, the Crazyflie Brushless was introduced, featuring brushless motors that provide around 50% more thrust compared to the brushed motors of its predecessor, the Crazyflie 2.1. This advancement has opened new opportunities for research in agile nano-quadcopter control. To support researchers utilizing this new platform, this work presents a dynamics model of the Crazyflie Brushless and identifies its key parameters.
技術方法: 本文提出的方法:In early 2025, the Crazyflie Brushless was introduced, featuring brushless motors that provide around 50% more thrust compared to the brushed motors of its predecessor, the Crazyflie 2.1. This advance
Key Takeaway: We furthermore demonstrate its suitability for reinforcement learning applications by training an end-to-end neural network position controller and learning a backflip controller capable of executing two complete rotations with a vertical movement of just 1.8 meters.
核心發現: 核心結果:We furthermore demonstrate its suitability for reinforcement learning applications by training an end-to-end neural network position controller and learning a backflip controller capable of executing
Swooper: Learning High-Speed Aerial Grasping With a Simple Gripper
Authors: Ziken Huang, Xinze Niu, Bowen Chai et al. | Submitted: 2026-03-06 | arXiv: 2603.05935
Categories: cs.RO
Research Background: High-speed aerial grasping presents significant challenges due to the high demands on precise, responsive flight control and coordinated gripper manipulation. In this work, we propose Swooper, a deep reinforcement learning (DRL) based approach that achieves both precise flight control and active gripper control using a single lightweight neural network policy.
研究背景: 在機器人學習領域,High-speed aerial grasping presents significant challenges due to the high demands on precise, responsive flight control and coordinated gripper manipulation. In this work, we prop
Technical Approach: In this work, we propose Swooper, a deep reinforcement learning (DRL) based approach that achieves both precise flight control and active gripper control using a single lightweight neural network policy. To validate the trained policy in the real world, we develop a lightweight quadrotor grasping platform equipped with a simple off-the-shelf gripper, and deploy the policy in a zero-shot manner on the onboard Raspberry Pi 4B computer, where each inference takes only about 1.0 ms.
技術方法: 本文提出的方法:In this work, we propose Swooper, a deep reinforcement learning (DRL) based approach that achieves both precise flight control and active gripper control using a single lightweight neural network poli
Key Takeaway: The supplementary video is available for more results.
核心發現: 核心結果:The supplementary video is available for more results.
FTSplat: Feed-forward Triangle Splatting Network
Authors: Xiong Jinlin, Li Can, Shen Jiawei et al. | Submitted: 2026-03-06 | arXiv: 2603.05932
Categories: cs.CV, cs.RO
Research Background: High-fidelity three-dimensional (3D) reconstruction is essential for robotics and simulation. While Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) achieve impressive rendering quality, their reliance on time-consuming per-scene optimization limits real-time deployment.
研究背景: 在機器人學習領域,High-fidelity three-dimensional (3D) reconstruction is essential for robotics and simulation. While Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) achieve impressiv
Technical Approach: To address these limitations, we propose a feed-forward framework for triangle primitive generation that directly predicts continuous triangle surfaces from calibrated multi-view images. Our method produces simulation-ready models in a single forward pass, obviating the need for per-scene optimization or post-processing. We introduce a pixel-aligned triangle generation module and incorporate relative 3D point cloud supervision to enhance geometric learning stability and consistency.
技術方法: 本文提出的方法:To address these limitations, we propose a feed-forward framework for triangle primitive generation that directly predicts continuous triangle surfaces from calibrated multi-view images. Our method pr
Key Takeaway: Experiments demonstrate that our method achieves efficient reconstruction while maintaining seamless compatibility with standard graphics and robotic simulators.
核心發現: 核心結果:Experiments demonstrate that our method achieves efficient reconstruction while maintaining seamless compatibility with standard graphics and robotic simulators.
Iterative Convex Optimization with Control Barrier Functions for Obstacle Avoidance among Polytopes
Authors: Shuo Liu, Zhe Huang, Calin A. Belta | Submitted: 2026-03-06 | arXiv: 2603.05916
Categories: cs.RO
Research Background: Obstacle avoidance of polytopic obstacles by polytopic robots is a challenging problem in optimization-based control and trajectory planning. Many existing methods rely on smooth geometric approximations, such as hyperspheres or ellipsoids, which allow differentiable distance expressions but distort the true geometry and restrict the feasible set.
研究背景: 在機器人學習領域,Obstacle avoidance of polytopic obstacles by polytopic robots is a challenging problem in optimization-based control and trajectory planning. Many existing methods rely on smooth g
Technical Approach: In this paper, we construct linear discrete-time control barrier function (DCBF) constraints by deriving supporting hyperplanes from exact closest-point computations between convex polytopes.
技術方法: 本文提出的方法:In this paper, we construct linear discrete-time control barrier function (DCBF) constraints by deriving supporting hyperplanes from exact closest-point computations between convex polytopes.
Key Takeaway: Numerical experiments demonstrate collision-free navigation in cluttered maze scenarios with millisecond-level solve times.
核心發現: 核心結果:Numerical experiments demonstrate collision-free navigation in cluttered maze scenarios with millisecond-level solve times.
Beyond Scalar Rewards: Distributional Reinforcement Learning with Preordered Objectives for Safe and Reliable Autonomous Driving
Authors: Ahmed Abouelazm, Jonas Michel, Daniel Bogdoll et al. | Submitted: 2026-03-06 | arXiv: 2603.20230
Categories: cs.RO, cs.AI, cs.LG
Research Background: Autonomous driving involves multiple, often conflicting objectives such as safety, efficiency, and comfort. In reinforcement learning (RL), these objectives are typically combined through weighted summation, which collapses their relative priorities and often yields policies that violate safety-critical constraints.
研究背景: 在機器人學習領域,Autonomous driving involves multiple, often conflicting objectives such as safety, efficiency, and comfort. In reinforcement learning (RL), these objectives are typically combined
Technical Approach: To overcome this limitation, we introduce the Preordered Multi-Objective MDP (Pr-MOMDP), which augments standard MOMDPs with a preorder over reward components. Building on QD, we propose an algorithm for extracting optimal subsets, the subset of actions that remain non-dominated under each objective, which allows precedence information to shape both decision-making and training targets. Our framework is instantiated with Implicit Quantile Networks (IQN), establishing a concrete implementation while preserving compatibility with a broad class of distributional RL methods.
技術方法: 本文提出的方法:To overcome this limitation, we introduce the Preordered Multi-Objective MDP (Pr-MOMDP), which augments standard MOMDPs with a preorder over reward components. Building on QD, we propose an algorithm
Key Takeaway: Experiments in Carla show improved success rates, fewer collisions and off-road events, and deliver statistically more robust policies than IQN and ensemble-IQN baselines.
核心發現: 核心結果:Experiments in Carla show improved success rates, fewer collisions and off-road events, and deliver statistically more robust policies than IQN and ensemble-IQN baselines.
Don’t Freeze, Don’t Crash: Extending the Safe Operating Range of Neural Navigation in Dense Crowds
Authors: Jiefu Zhang, Yang Xu, Vaneet Aggarwal | Submitted: 2026-03-06 | arXiv: 2603.06729
Categories: cs.LG, cs.AI, cs.RO
Research Background: Navigating safely through dense crowds requires collision avoidance that generalizes beyond the densities seen during training. Learning-based crowd navigation can break under out-of-distribution crowd sizes due to density-sensitive observation normalization and social-cost scaling, while analytical solvers often remain safe but freeze in tight interactions.
研究背景: 在機器人學習領域,Navigating safely through dense crowds requires collision avoidance that generalizes beyond the densities seen during training. Learning-based crowd navigation can break under out-
Technical Approach: We propose a reinforcement learning approach for dense, variable-density navigation that attains zero-shot density generalization using a density-invariant observation encoding with density-randomized training and physics-informed proxemic reward shaping with density-adaptive scaling.
技術方法: 本文提出的方法:We propose a reinforcement learning approach for dense, variable-density navigation that attains zero-shot density generalization using a density-invariant observation encoding with density-randomized
Key Takeaway: Trained with pedestrians in a arena and evaluated up to pedestrians ( denser), our policy reaches the goal in of episodes and achieves collision-free success in random crowds, with markedly less freezing than analytical methods and a -point collision-free margin over learning-based benchmark methods.
核心發現: 核心結果:Trained with pedestrians in a arena and evaluated up to pedestrians ( denser), our policy reaches the goal in of episodes
Expert Knowledge-driven Reinforcement Learning for Autonomous Racing via Trajectory Guidance and Dynamics Constraints
Authors: Bo Leng, Weiqi Zhang, Zhuoren Li et al. | Submitted: 2026-03-06 | arXiv: 2603.05842
Categories: cs.RO
Research Background: Reinforcement learning has demonstrated significant potential in the field of autonomous driving. However, it suffers from defects such as training instability and unsafe action outputs when faced with autonomous racing environments characterized by high dynamics and strong nonlinearities.
研究背景: 在機器人學習領域,Reinforcement learning has demonstrated significant potential in the field of autonomous driving. However, it suffers from defects such as training instability and unsafe action ou
Technical Approach: To this end, this paper proposes a trajectory guidance and dynamics constraints Reinforcement Learning (TraD-RL) method for autonomous racing.
技術方法: 本文提出的方法:To this end, this paper proposes a trajectory guidance and dynamics constraints Reinforcement Learning (TraD-RL) method for autonomous racing.
Key Takeaway: Experimental results demonstrate that TraD-RL effectively improves both lap speed and driving stability of the autonomous racing vehicle, achieving a synergistic optimization of racing performance and safety.
核心發現: 核心結果:Experimental results demonstrate that TraD-RL effectively improves both lap speed and driving stability of the autonomous racing vehicle, achieving a synergistic optimization of racing performance and
OpenHEART: Opening Heterogeneous Articulated Objects with a Legged Manipulator
Authors: Seonghyeon Lim, Hyeonwoo Lee, Seunghyun Lee et al. | Submitted: 2026-03-06 | arXiv: 2603.05830
Categories: cs.RO
Research Background: Legged manipulators offer high mobility and versatile manipulation. However, robust interaction with heterogeneous articulated objects, such as doors, drawers, and cabinets, remains challenging because of the diverse articulation types of the objects and the complex dynamics of the legged robot.
研究背景: 在機器人學習領域,Legged manipulators offer high mobility and versatile manipulation. However, robust interaction with heterogeneous articulated objects, such as doors, drawers, and cabinets, remain
Technical Approach: In this paper, we propose a robust and sample-efficient framework for opening heterogeneous articulated objects with a legged manipulator. In particular, we propose Sampling-based Abstracted Feature Extraction (SAFE), which encodes handle and panel geometry into a compact low-dimensional representation, improving cross-domain generalization.
技術方法: 本文提出的方法:In this paper, we propose a robust and sample-efficient framework for opening heterogeneous articulated objects with a legged manipulator. In particular, we propose Sampling-based Abstracted Feature E
Key Takeaway: Videos can be found on the project website: https://openheart-icra.github.io/OpenHEART/
核心發現: 核心結果:Videos can be found on the project website: https://openheart-icra.github.io/OpenHEART/
Hierarchical Latent Action Model
Authors: Hanjung Kim, Lerrel Pinto, Seon Joo Kim | Submitted: 2026-03-06 | arXiv: 2603.05815
Categories: cs.RO
Research Background: Latent Action Models (LAMs) enable learning from actionless data for applications ranging from robotic control to interactive world models. However, existing LAMs typically focus on short-horizon frame transitions and capture low-level motion while overlooking longer-term temporal structure.
研究背景: 在機器人學習領域,Latent Action Models (LAMs) enable learning from actionless data for applications ranging from robotic control to interactive world models. However, existing LAMs typically focus o
Technical Approach: We present HiLAM, a hierarchical latent action model that discovers latent skills by modeling long-term temporal information.
技術方法: 本文提出的方法:We present HiLAM, a hierarchical latent action model that discovers latent skills by modeling long-term temporal information.
Key Takeaway: Our experiments demonstrate that HiLAM improves over the baseline and exhibits robust dynamic skill discovery.
核心發現: 核心結果:Our experiments demonstrate that HiLAM improves over the baseline and exhibits robust dynamic skill discovery.
STL-SVPIO: Signal Temporal Logic guided Stein Variational Path Integral Optimization
Authors: Hongrui Zheng, Zirui Zang, Ahmad Amine et al. | Submitted: 2026-03-06 | arXiv: 2603.13333
Categories: cs.RO
Research Background: Signal Temporal Logic (STL) enables formal specification of complex spatiotemporal constraints for robotic task planning. However, synthesizing long-horizon continuous control trajectories from complex STL specifications is fundamentally challenging due to the nested structure of STL robustness objectives.
研究背景: 在機器人學習領域,Signal Temporal Logic (STL) enables formal specification of complex spatiotemporal constraints for robotic task planning. However, synthesizing long-horizon continuous control traj
Technical Approach: We introduce Signal Temporal Logic guided Stein Variational Path Integral Optimization (STL-SVPIO), which reframes STL as a globally informative, differentiable reward-shaping mechanism. Our method transforms sparse logical satisfaction into tractable variational inference, mitigating the severe local minima traps of standard gradient-based methods.
技術方法: 本文提出的方法:We introduce Signal Temporal Logic guided Stein Variational Path Integral Optimization (STL-SVPIO), which reframes STL as a globally informative, differentiable reward-shaping mechanism. Our method tr
Key Takeaway: We demonstrate that STL-SVPIO significantly outperforms existing methods in both robustness and efficiency for traditional STL tasks.
核心發現: 核心結果:We demonstrate that STL-SVPIO significantly outperforms existing methods in both robustness and efficiency for traditional STL tasks.
Multi-Robot Trajectory Planning via Constrained Bayesian Optimization and Local Cost Map Learning with STL-Based Conflict Resolution
Authors: Sourav Raxit, Abdullah Al Redwan Newaz, Jose Fuentes et al. | Submitted: 2026-03-06 | arXiv: 2603.05767
Categories: cs.RO
Research Background: We address multi-robot motion planning under Signal Temporal Logic (STL) specifications with kinodynamic constraints. Exact approaches face scalability bottlenecks and limited adaptability, while conventional sampling-based methods require excessive samples to construct optimal trajectories.
研究背景: 在機器人學習領域,We address multi-robot motion planning under Signal Temporal Logic (STL) specifications with kinodynamic constraints. Exact approaches face scalability bottlenecks and limited adap
Technical Approach: We propose a two-stage framework integrating sampling-based online learning with formal STL reasoning.
技術方法: 本文提出的方法:We propose a two-stage framework integrating sampling-based online learning with formal STL reasoning.
Key Takeaway: The STLcBOT Planner will be released as an open-source package, and videos of real-world and simulated experiments are available at https://stlbot.github.io/.
核心發現: 核心結果:The STLcBOT Planner will be released as an open-source package, and videos of real-world and simulated experiments are available at https://stlbot.github.io/.
Modeling and Measuring Redundancy in Multisource Multimodal Data for Autonomous Driving
Authors: Yuhan Zhou, Mehri Sattari, Haihua Chen et al. | Submitted: 2026-03-06 | arXiv: 2603.06544
Categories: cs.CV
Research Background: Next-generation autonomous vehicles (AVs) rely on large volumes of multisource and multimodal () data to support real-time decision-making. In practice, data quality (DQ) varies across sources and modalities due to environmental conditions and sensor limitations, yet AV research has largely prioritized algorithm design over DQ analysis.
研究背景: 在機器人學習領域,Next-generation autonomous vehicles (AVs) rely on large volumes of multisource and multimodal () data to support real-time decision-making. In practice, data quality (DQ) vari
Technical Approach: In practice, data quality (DQ) varies across sources and modalities due to environmental conditions and sensor limitations, yet AV research has largely prioritized algorithm design over DQ analysis. This work focuses on redundancy as a fundamental but underexplored DQ issue in AV datasets. Using the nuScenes and Argoverse 2 (AV2) datasets, we model and measure redundancy in multisource camera data and multimodal image-LiDAR data, and evaluate how removing redundant labels affects the YOLOv8 object detection task.
技術方法: 本文提出的方法:In practice, data quality (DQ) varies across sources and modalities due to environmental conditions and sensor limitations, yet AV research has largely prioritized algorithm design over DQ analysis. T
Key Takeaway: This work highlights the role of redundancy as a data quality factor in AV perception and motivates a data-centric perspective for evaluating and improving AV datasets.
核心發現: 核心結果:This work highlights the role of redundancy as a data quality factor in AV perception and motivates a data-centric perspective for evaluating and improving AV datasets.
EventGeM: Global-to-Local Feature Matching for Event-Based Visual Place Recognition
Authors: Adam D. Hines, Gokul B. Nair, Nicolás Marticorena et al. | Submitted: 2026-03-06 | arXiv: 2603.05807
Categories: cs.CV
Research Background: Dynamic vision sensors, also known as event cameras, are rapidly rising in popularity for robotic and computer vision tasks due to their sparse activation and high-temporal resolution. Event cameras have been used in robotic navigation and localization tasks where accurate positioning needs to occur on small and frequent time scales, or when energy concerns are paramount.
研究背景: 在機器人學習領域,Dynamic vision sensors, also known as event cameras, are rapidly rising in popularity for robotic and computer vision tasks due to their sparse activation and high-temporal resolut
Technical Approach: In this work, we present EventGeM, a state-of-the-art global to local feature fusion pipeline for event-based Visual Place Recognition.
技術方法: 本文提出的方法:In this work, we present EventGeM, a state-of-the-art global to local feature fusion pipeline for event-based Visual Place Recognition.
Key Takeaway: We demonstrate the capability of EventGeM in a real-world deployment on a robotic platform for online localization using event streams directly from an event camera.
核心發現: 核心結果:We demonstrate the capability of EventGeM in a real-world deployment on a robotic platform for online localization using event streams directly from an event camera.
Faster-HEAL: An Efficient and Privacy-Preserving Collaborative Perception Framework for Heterogeneous Autonomous Vehicles
Authors: Armin Maleki, Hayder Radha | Submitted: 2026-03-07 | arXiv: 2603.07314
Categories: cs.CV, cs.RO
Research Background: Collaborative perception (CP) is a promising paradigm for improving situational awareness in autonomous vehicles by overcoming the limitations of single-agent perception. However, most existing approaches assume homogeneous agents, which restricts their applicability in real-world scenarios where vehicles use diverse sensors and perception models.
研究背景: 在機器人學習領域,Collaborative perception (CP) is a promising paradigm for improving situational awareness in autonomous vehicles by overcoming the limitations of single-agent perception. However,
Technical Approach: We propose Faster-HEAL, a lightweight and privacy-preserving CP framework that fine-tunes a low-rank visual prompt to align heterogeneous features with a unified feature space while leveraging pyramid fusion for robust feature aggregation.
技術方法: 本文提出的方法:We propose Faster-HEAL, a lightweight and privacy-preserving CP framework that fine-tunes a low-rank visual prompt to align heterogeneous features with a unified feature space while leveraging pyramid
Key Takeaway: Experiments on the OPV2V-H dataset show that Faster-HEAL improves detection performance by 2% over state-of-the-art methods with significantly lower computational overhead, offering a practical solution for scalable heterogeneous CP.
核心發現: 核心結果:Experiments on the OPV2V-H dataset show that Faster-HEAL improves detection performance by 2% over state-of-the-art methods with significantly lower computational overhead, offering a practical soluti
Kinematics-Aware Latent World Models for Data-Efficient Autonomous Driving
Authors: Jiazhuo Li, Linjiang Cao, Qi Liu et al. | Submitted: 2026-03-07 | arXiv: 2603.07264
Categories: cs.RO, cs.AI
Research Background: Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through latent imagination, existing approaches often lack explicit mechanisms to encode spatial and kinematic structure essential for driving tasks.
研究背景: 在機器人學習領域,Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based re
Technical Approach: In this work, we build upon the Recurrent State-Space Model (RSSM) and propose a kinematics-aware latent world model framework for autonomous driving.
技術方法: 本文提出的方法:In this work, we build upon the Recurrent State-Space Model (RSSM) and propose a kinematics-aware latent world model framework for autonomous driving.
Key Takeaway: These results suggest that integrating kinematic grounding into RSSM-based world models provides a scalable and physically grounded paradigm for autonomous driving policy learning.
核心發現: 核心結果:These results suggest that integrating kinematic grounding into RSSM-based world models provides a scalable and physically grounded paradigm for autonomous driving policy learning.
Fusing Driver Perceived and Physical Risk for Safety Critical Scenario Screening in Autonomous Driving
Authors: Chen Xiong, Ziwen Wang, Deqi Wang et al. | Submitted: 2026-03-07 | arXiv: 2603.20232
Categories: cs.RO, cs.AI, cs.LG
Research Background: Autonomous driving testing increasingly relies on mining safety critical scenarios from large scale naturalistic driving data, yet existing screening pipelines still depend on manual risk annotation and expensive frame by frame risk evaluation, resulting in low efficiency and weakly grounded risk quantification. To address this issue, we propose a driver risk fusion based hazardous scenario screening method for autonomous driving.
研究背景: 在機器人學習領域,Autonomous driving testing increasingly relies on mining safety critical scenarios from large scale naturalistic driving data, yet existing screening pipelines still depend on manu
Technical Approach: To address this issue, we propose a driver risk fusion based hazardous scenario screening method for autonomous driving.
技術方法: 本文提出的方法:To address this issue, we propose a driver risk fusion based hazardous scenario screening method for autonomous driving.
Key Takeaway: On FLUID, it achieves an AUC of 0.792 and an AP of 0.825, outperforming PODAR by 9.1 percent and 5.1 percent, respectively, demonstrating its effectiveness for scalable risk labeling and hazardous scenario screening.
核心發現: 核心結果:On FLUID, it achieves an AUC of 0.792 and an AP of 0.825, outperforming PODAR by 9.1 percent and 5.1 percent, respectively, demonstrating its effectiveness for scalable risk labeling and hazardous sce
Vision-Guided MPPI for Agile Drone Racing: Navigating Arbitrary Gate Poses via Neural Signed Distance Fields
Authors: Fangguo Zhao, Hanbing Zhang, Zhouheng Li et al. | Submitted: 2026-03-07 | arXiv: 2603.07199
Categories: cs.RO
Research Background: Autonomous drone racing requires the tight coupling of perception, planning, and control under extreme agility. However, recent approaches typically rely on precomputed spatial reference trajectories or explicit 6-DoF gate pose estimation, rendering them brittle to spatial perturbations, unmodeled track changes, and sensor noise.
研究背景: 在機器人學習領域,Autonomous drone racing requires the tight coupling of perception, planning, and control under extreme agility. However, recent approaches typically rely on precomputed spatial ref
Technical Approach: To address these fundamental limitations, we propose a fully onboard, vision guided optimal control framework that enables reference-free agile flight through arbitrarily placed and oriented gates. Central to our approach is Gate-SDF, a novel, implicitly learned neural signed distance field.
技術方法: 本文提出的方法:To address these fundamental limitations, we propose a fully onboard, vision guided optimal control framework that enables reference-free agile flight through arbitrarily placed and oriented gates. Ce
Key Takeaway: Extensive simulations and real-world experiments demonstrate that the proposed system achieves high-speed agile flight and successfully navigates unseen tracks subject to severe unmodeled gate displacements and orientation perturbations.
核心發現: 核心結果:Extensive simulations and real-world experiments demonstrate that the proposed system achieves high-speed agile flight and successfully navigates unseen tracks subject to severe unmodeled gate displac
Efficient Trajectory Optimization for Autonomous Racing via Formula-1 Data-Driven Initialization
Authors: Samir Shehadeh, Lukas Kutsch, Nils Dengler et al. | Submitted: 2026-03-07 | arXiv: 2603.07126
Categories: cs.RO
Research Background: Trajectory optimization is a central component of fast and efficient autonomous racing. However practical optimization pipelines remain highly sensitive to initialization and may converge slowly or to suboptimal local solutions when seeded with heuristic trajectories such as the centerline or minimum-curvature paths.
研究背景: 在機器人學習領域,Trajectory optimization is a central component of fast and efficient autonomous racing. However practical optimization pipelines remain highly sensitive to initialization and may c
Technical Approach: To address this limitation, we leverage expert driving behavior as a initialization prior and propose a learning-informed initialization strategy based on real-world Formula1 telemetry. To this end, we first construct a multi-track Formula1 trajectory dataset by reconstructing and aligning noisy GPS telemetry to a standardized reference-line representation across 17 tracks. Building on this, we present a neural network that predicts an expert-like raceline offset directly from local track geometry, without explicitly modeling vehicle dynamics or forces.
技術方法: 本文提出的方法:To address this limitation, we leverage expert driving behavior as a initialization prior and propose a learning-informed initialization strategy based on real-world Formula~1 telemetry. To this end,
Key Takeaway: Experiments on all 17 tracks demonstrate that the learned initialization accelerates solver convergence and significantly reduces runtime compared to traditional geometric baselines, while preserving the final optimized lap time.
核心發現: 核心結果:Experiments on all 17 tracks demonstrate that the learned initialization accelerates solver convergence and significantly reduces runtime compared to traditional geometric baselines, while preserving
Relating Reinforcement Learning to Dynamic Programming-Based Planning
Authors: Filip V. Georgiev, Kalle G. Timperi, Başak Sakçak et al. | Submitted: 2026-03-08 | arXiv: 2603.07844
Categories: cs.RO
Research Background: This paper bridges some of the gap between optimal planning and reinforcement learning (RL), both of which share roots in dynamic programming applied to sequential decision making or optimal control. Whereas planning typically favors deterministic models, goal termination, and cost minimization, RL tends to favor stochastic models, infinite-horizon discounting, and reward maximization in addition to learning-related parameters such as the learning rate and greediness factor.
研究背景: 在機器人學習領域,This paper bridges some of the gap between optimal planning and reinforcement learning (RL), both of which share roots in dynamic programming applied to sequential decision making
Technical Approach: This paper bridges some of the gap between optimal planning and reinforcement learning (RL), both of which share roots in dynamic programming applied to sequential decision making or optimal control.
技術方法: 本文提出的方法:This paper bridges some of the gap between optimal planning and reinforcement learning (RL), both of which share roots in dynamic programming applied to sequential decision making or optimal control.
Key Takeaway: Next, mathematical analysis shows: 1) conditions under which cost minimization and reward maximization are equivalent, 2) conditions for equivalence of single-shot goal termination and infinite-horizon episodic learning, and 3) conditions under which discounting causes goal achievement to fail.
核心發現: 核心結果:Next, mathematical analysis shows: 1) conditions under which cost minimization and reward maximization are equivalent, 2) conditions for equivalence of single-shot goal termination and infinite-horizo
Physics-infused Learning for Aerial Manipulator in Winds and Near-Wall Environments
Authors: Yiming Zhang, Junyi Geng | Submitted: 2026-03-08 | arXiv: 2603.07826
Categories: cs.RO
Research Background: Aerial manipulation (AM) expands UAV capabilities beyond passive observation to contact-based operations at high altitudes and in otherwise inaccessible environments. Although recent advances show promise, most AM systems are developed in controlled settings that overlook key aerodynamic effects.
研究背景: 在機器人學習領域,Aerial manipulation (AM) expands UAV capabilities beyond passive observation to contact-based operations at high altitudes and in otherwise inaccessible environments. Although rece
Technical Approach: This paper combines both approaches by integrating a physics-based blade-element model with a learning-based residual force estimator, along with a rotor-speed allocation strategy for disturbance compensation, resulting in a unified control framework.
技術方法: 本文提出的方法:This paper combines both approaches by integrating a physics-based blade-element model with a learning-based residual force estimator, along with a rotor-speed allocation strategy for disturbance comp
Key Takeaway: Results demonstrate improved disturbance estimation and trajectory-tracking accuracy over conventional approaches, enabling robust wall-contact execution under challenging aerodynamic conditions.
核心發現: 核心結果:Results demonstrate improved disturbance estimation and trajectory-tracking accuracy over conventional approaches, enabling robust wall-contact execution under challenging aerodynamic conditions.
Reasoning Knowledge-Gap in Drone Planning via LLM-based Active Elicitation
Authors: Zeyu Fang, Beomyeol Yu, Cheng Liu et al. | Submitted: 2026-03-08 | arXiv: 2603.07824
Categories: cs.RO
Research Background: Human-AI joint planning in Unmanned Aerial Vehicles (UAVs) typically relies on control handover when facing environmental uncertainties, which is often inefficient and cognitively demanding for non-expert operators. To address this, we propose a novel framework that shifts the collaboration paradigm from control takeover to active information elicitation.
研究背景: 在機器人學習領域,Human-AI joint planning in Unmanned Aerial Vehicles (UAVs) typically relies on control handover when facing environmental uncertainties, which is often inefficient and cognitively
Technical Approach: To address this, we propose a novel framework that shifts the collaboration paradigm from control takeover to active information elicitation. We introduce the Minimal Information Neuro-Symbolic Tree (MINT), a reasoning mechanism that explicitly structures knowledge gaps regarding obstacles and goals into a queryable format. By leveraging large language models, our system formulates optimal binary queries to resolve specific ambiguities with minimal human interaction.
技術方法: 本文提出的方法:To address this, we propose a novel framework that shifts the collaboration paradigm from control takeover to active information elicitation. We introduce the Minimal Information Neuro-Symbolic Tree (
Key Takeaway: Experimental results show that our method achieves a significant improvement in the success rate for complex search-and-rescue tasks while significantly reducing the frequency of human interaction compared to exhaustive querying baselines.
核心發現: 核心結果:Experimental results show that our method achieves a significant improvement in the success rate for complex search-and-rescue tasks while significantly reducing the frequency of human interaction com
Preference-Conditioned Reinforcement Learning for Space-Time Efficient Online 3D Bin Packing
Authors: Nikita Sarawgi, Omey M. Manyar, Fan Wang et al. | Submitted: 2026-03-08 | arXiv: 2603.07800
Categories: cs.RO
Research Background: Robotic bin packing is widely deployed in warehouse automation, with current systems achieving robust performance through heuristic and learning-based strategies. These systems must balance compact placement with rapid execution, where selecting alternative items or reorienting them can improve space utilization but introduce additional time.
研究背景: 在機器人學習領域,Robotic bin packing is widely deployed in warehouse automation, with current systems achieving robust performance through heuristic and learning-based strategies. These systems mus
Technical Approach: We propose a selection-based formulation that explicitly reasons over this trade-off: at each step, the robot evaluates multiple candidate actions, weighing expected packing benefit against estimated operational time. Our method, STEP (Space-Time Efficient Packing), uses a preference-conditioned, Transformer-based reinforcement learning policy, and allows generalization across candidate set sizes and integration with standard placement modules.
技術方法: 本文提出的方法:We propose a selection-based formulation that explicitly reasons over this trade-off: at each step, the robot evaluates multiple candidate actions, weighing expected packing benefit against estimated
Key Takeaway: It achieves a 44% reduction in operational time without compromising packing density.
核心發現: 核心結果:It achieves a 44% reduction in operational time without compromising packing density.
Toward Global Intent Inference for Human Motion by Inverse Reinforcement Learning
Authors: Sarmad Mehrdad, Maxime Sabbah, Vincent Bonnet et al. | Submitted: 2026-03-08 | arXiv: 2603.07797
Categories: cs.RO, cs.LG
Research Background: This paper investigates whether a single, unified cost function can explain and predict human reaching movements, in contrast with existing approaches that rely on subject- or posture-specific optimization criteria. Using the Minimal Observation Inverse Reinforcement Learning (MO-IRL) algorithm, together with a seven-dimensional set of candidate cost terms, we efficiently estimate time-varying cost weights for a standard planar reaching task.
研究背景: 在機器人學習領域,This paper investigates whether a single, unified cost function can explain and predict human reaching movements, in contrast with existing approaches that rely on subject- or post
Technical Approach: This paper investigates whether a single, unified cost function can explain and predict human reaching movements, in contrast with existing approaches that rely on subject- or posture-specific optimization criteria.
技術方法: 本文提出的方法:This paper investigates whether a single, unified cost function can explain and predict human reaching movements, in contrast with existing approaches that rely on subject- or posture-specific optimiz
Key Takeaway: Three levels of generality are evaluated: Subject-Dependent Posture-Dependent, Subject-Dependent Posture-Independent, and Subject-Independent Posture-Independent.
核心發現: 核心結果:Three levels of generality are evaluated: Subject-Dependent Posture-Dependent, Subject-Dependent Posture-Independent, and Subject-Independent Posture-Independent.
C-Explorer: Contiguity-Driven Task Allocation with Connectivity-Aware Task Representation for Decentralized Multi-UAV Exploration
Authors: Xinlu Yan, Mingjie Zhang, Yuhao Fang et al. | Submitted: 2026-03-08 | arXiv: 2603.07699
Categories: cs.RO
Research Background: Efficient multi-UAV exploration under limited communication is severely bottlenecked by inadequate task representation and allocation. Previous task representations either impose heavy communication requirements for coordination or lack the flexibility to handle complex environments, often leading to inefficient traversal.
研究背景: 在機器人學習領域,Efficient multi-UAV exploration under limited communication is severely bottlenecked by inadequate task representation and allocation. Previous task representations either impose h
Technical Approach: To address this, we propose C-Explorer, a decentralized framework that constructs a connectivity graph to decompose disconnected unknown components into independent task units.
技術方法: 本文提出的方法:To address this, we propose C-Explorer, a decentralized framework that constructs a connectivity graph to decompose disconnected unknown components into independent task units.
Key Takeaway: Real-world flights further demonstrate the system’s feasibility.
核心發現: 核心結果:Real-world flights further demonstrate the system’s feasibility.
Multi-Agent Off-World Exploration for Sparse Evidence Discovery via Gaussian Belief Mapping and Dual-Domain Coverage
Authors: Zhuoran Qiao, Tianxin Hu, Thien-Minh Nguyen et al. | Submitted: 2026-03-08 | arXiv: 2603.07650
Categories: cs.RO
Research Background: Off-world multi-robot exploration is challenged by sparse targets, limited sensing, hazardous terrain, and restricted communication. Many scientifically valuable clues are visually ambiguous and often require close-range observations, making efficient and safe informative path planning essential.
研究背景: 在機器人學習領域,Off-world multi-robot exploration is challenged by sparse targets, limited sensing, hazardous terrain, and restricted communication. Many scientifically valuable clues are visually
Technical Approach: To address these issues, we propose a multi-agent informative path planning framework for sparse evidence discovery based on Gaussian belief mapping and dual-domain coverage.
技術方法: 本文提出的方法:To address these issues, we propose a multi-agent informative path planning framework for sparse evidence discovery based on Gaussian belief mapping and dual-domain coverage.
Key Takeaway: In particular, it achieves lower final uncertainty in risk-aware settings and remains robust under limited communication, demonstrating its effectiveness for cooperative off-world robotic exploration.
核心發現: 核心結果:In particular, it achieves lower final uncertainty in risk-aware settings and remains robust under limited communication, demonstrating its effectiveness for cooperative off-world robotic exploration.
Exoskeleton Control through Learning to Reduce Biological Joint Moments in Simulations
Authors: Zihang You, Xianlian Zhou | Submitted: 2026-03-08 | arXiv: 2603.07629
Categories: cs.RO, cs.LG
Research Background: Data-driven joint-moment predictors offer a scalable alternative to laboratory-based inverse-dynamics pipelines for biomechanics estimation and exoskeleton control. Meanwhile, physics-based reinforcement learning (RL) enables simulation-trained controllers to learn dynamics-aware assistance strategies without extensive human experimentation.
研究背景: 在機器人學習領域,Data-driven joint-moment predictors offer a scalable alternative to laboratory-based inverse-dynamics pipelines for biomechanics estimation and exoskeleton control. Meanwhile, phys
Technical Approach: This paper presents (1) an RL framework to learn exoskeleton assistance policies that reduce biological joint moments, and (2) a validation pipeline that verifies the trained control networks using an open-source gait dataset through inference and comparison with biological joint moments.
技術方法: 本文提出的方法:This paper presents (1) an RL framework to learn exoskeleton assistance policies that reduce biological joint moments, and (2) a validation pipeline that verifies the trained control networks using an
Key Takeaway: Together, these results establish a quantitative validation framework for simulation-trained exoskeleton controllers, demonstrate strong sim-to-data consistency at the torque level, and highlight both the promise and the remaining challenges for sim-to-real transfer.
核心發現: 核心結果:Together, these results establish a quantitative validation framework for simulation-trained exoskeleton controllers, demonstrate strong sim-to-data consistency at the torque level, and highlight both
Emergency Lane-Change Simulation: A Behavioral Guidance Approach for Risky Scenario Generation
Authors: Chen Xiong, Cheng Wang, Yuhang Liu et al. | Submitted: 2026-03-08 | arXiv: 2603.20234
Categories: cs.RO, cs.AI
Research Background: In contemporary autonomous driving testing, virtual simulation has become an important approach due to its efficiency and cost effectiveness. However, existing methods usually rely on reinforcement learning to generate risky scenarios, making it difficult to efficiently learn realistic emergency behaviors.
研究背景: 在機器人學習領域,In contemporary autonomous driving testing, virtual simulation has become an important approach due to its efficiency and cost effectiveness. However, existing methods usually rely
Technical Approach: To address this issue, we propose a behavior guided method for generating high risk lane change scenarios.
技術方法: 本文提出的方法:To address this issue, we propose a behavior guided method for generating high risk lane change scenarios.
Key Takeaway: Experimental results show that the proposed method can effectively learn high risk trajectory behaviors from limited data and generate high risk collision scenarios with better efficiency than traditional methods such as grid search and manual design.
核心發現: 核心結果:Experimental results show that the proposed method can effectively learn high risk trajectory behaviors from limited data and generate high risk collision scenarios with better efficiency than traditi
Beyond Hard Constraints: Budget-Conditioned Reachability For Safe Offline Reinforcement Learning
Authors: Janaka Chathuranga Brahmanage, Akshat Kumar | Submitted: 2026-03-08 | arXiv: 2603.22292
Categories: cs.LG, cs.AI, cs.RO
Research Background: Sequential decision making using Markov Decision Process underpins many realworld applications. Both model-based and model free methods have achieved strong results in these settings.
研究背景: 在機器人學習領域,Sequential decision making using Markov Decision Process underpins many realworld applications. Both model-based and model free methods have achieved strong results in these settin
Technical Approach: Finally, experiments on standard offline safe RL benchmarks, and a real world maritime navigation task demonstrate that our method matches or outperforms state of the art baselines while maintaining safety.
技術方法: 本文提出的方法:Finally, experiments on standard offline safe RL benchmarks, and a real world maritime navigation task demonstrate that our method matches or outperforms state of the art baselines while maintaining s
Key Takeaway: Finally, experiments on standard offline safe RL benchmarks, and a real world maritime navigation task demonstrate that our method matches or outperforms state of the art baselines while maintaining safety.
核心發現: 核心結果:Finally, experiments on standard offline safe RL benchmarks, and a real world maritime navigation task demonstrate that our method matches or outperforms state of the art baselines while maintaining s
ReconDrive: Fast Feed-Forward 4D Gaussian Splatting for Autonomous Driving Scene Reconstruction
Authors: Haibao Yu, Kuntao Xiao, Jiahang Wang et al. | Submitted: 2026-03-08 | arXiv: 2603.07552
Categories: cs.CV, cs.RO
Research Background: High-fidelity visual reconstruction and novel-view synthesis are essential for realistic closed-loop evaluation in autonomous driving. While 4D Gaussian Splatting (4DGS) offers a promising balance of accuracy and efficiency, existing per-scene optimization methods require costly iterative refinement, rendering them unscalable for extensive urban environments.
研究背景: 在機器人學習領域,High-fidelity visual reconstruction and novel-view synthesis are essential for realistic closed-loop evaluation in autonomous driving. While 4D Gaussian Splatting (4DGS) offers a p
Technical Approach: To address these limitations, we propose ReconDrive, a feed-forward framework that leverages and extends the 3D foundation model VGGT for rapid, high-fidelity 4DGS generation.
技術方法: 本文提出的方法:To address these limitations, we propose ReconDrive, a feed-forward framework that leverages and extends the 3D foundation model VGGT for rapid, high-fidelity 4DGS generation.
Key Takeaway: It achieves performance competitive with per-scene optimization while being orders of magnitude faster, providing a scalable and practical solution for realistic driving simulation.
核心發現: 核心結果:It achieves performance competitive with per-scene optimization while being orders of magnitude faster, providing a scalable and practical solution for realistic driving simulation.
SLNet: A Super-Lightweight Geometry-Adaptive Network for 3D Point Cloud Recognition
Authors: Mohammad Saeid, Amir Salarpour, Pedram MohajerAnsari et al. | Submitted: 2026-03-08 | arXiv: 2603.07454
Categories: cs.CV, cs.LG, cs.RO
Research Background: We present SLNet, a lightweight backbone for 3D point cloud recognition designed to achieve strong performance without the computational cost of many recent attention, graph, and deep MLP based models. The model is built on two simple ideas: NAPE (Nonparametric Adaptive Point Embedding), which captures spatial structure using a combination of Gaussian RBF and cosine bases with input adaptive bandwidth and blending, and GMU (Geometric Modulation Unit), a per channel affine modulator that adds only 2D learnable parameters.
研究背景: 在機器人學習領域,We present SLNet, a lightweight backbone for 3D point cloud recognition designed to achieve strong performance without the computational cost of many recent attention, graph, and d
Technical Approach: We present SLNet, a lightweight backbone for 3D point cloud recognition designed to achieve strong performance without the computational cost of many recent attention, graph, and deep MLP based models.
技術方法: 本文提出的方法:We present SLNet, a lightweight backbone for 3D point cloud recognition designed to achieve strong performance without the computational cost of many recent attention, graph, and deep MLP based models
Key Takeaway: We also introduce NetScore+, which extends NetScore by incorporating latency and peak memory so that efficiency can be evaluated in a more deployment oriented way.
核心發現: 核心結果:We also introduce NetScore+, which extends NetScore by incorporating latency and peak memory so that efficiency can be evaluated in a more deployment oriented way.
Perceptive Variable-Timing Footstep Planning for Humanoid Locomotion on Disconnected Footholds
Authors: Zhaoyang Xiang, Upama Pant, Ayonga Hereid | Submitted: 2026-03-08 | arXiv: 2603.07400
Categories: cs.RO
Research Background: Many real-world walking scenarios contain obstacles and unsafe ground patches (e.g., slippery or cluttered areas), leaving a disconnected set of admissible footholds that can be modeled as stepping-stone-like regions. We propose an onboard, perceptive mixed-integer model predictive control framework that jointly plans foot placement and step duration using step-to-step Divergent Component of Motion (DCM) dynamics.
研究背景: 在機器人學習領域,Many real-world walking scenarios contain obstacles and unsafe ground patches (e.g., slippery or cluttered areas), leaving a disconnected set of admissible footholds that can be mo
Technical Approach: We propose an onboard, perceptive mixed-integer model predictive control framework that jointly plans foot placement and step duration using step-to-step Divergent Component of Motion (DCM) dynamics.
技術方法: 本文提出的方法:We propose an onboard, perceptive mixed-integer model predictive control framework that jointly plans foot placement and step duration using step-to-step Divergent Component of Motion (DCM) dynamics.
Key Takeaway: We evaluate the approach in simulation on Digit on randomized stepping-stone fields, including external pushes.
核心發現: 核心結果:We evaluate the approach in simulation on Digit on randomized stepping-stone fields, including external pushes.
4DRC-OCC: Robust Semantic Occupancy Prediction Through Fusion of 4D Radar and Camera
Authors: David Ninfa, Andras Palffy, Holger Caesar | Submitted: 2026-03-08 | arXiv: 2603.07794
Categories: cs.CV
Research Background: Autonomous driving requires robust perception across diverse environmental conditions, yet 3D semantic occupancy prediction remains challenging under adverse weather and lighting. In this work, we present the first study combining 4D radar and camera data for 3D semantic occupancy prediction.
研究背景: 在機器人學習領域,Autonomous driving requires robust perception across diverse environmental conditions, yet 3D semantic occupancy prediction remains challenging under adverse weather and lighting.
Technical Approach: In this work, we present the first study combining 4D radar and camera data for 3D semantic occupancy prediction. Additionally, we introduce a fully automatically labeled dataset for training semantic occupancy models, substantially reducing reliance on costly manual annotation.
技術方法: 本文提出的方法:In this work, we present the first study combining 4D radar and camera data for 3D semantic occupancy prediction. Additionally, we introduce a fully automatically labeled dataset for training semantic
Key Takeaway: Experiments demonstrate the robustness of 4D radar across diverse scenarios, highlighting its potential to advance autonomous vehicle perception.
核心發現: 核心結果:Experiments demonstrate the robustness of 4D radar across diverse scenarios, highlighting its potential to advance autonomous vehicle perception.
RayD3D: Distilling Depth Knowledge Along the Ray for Robust Multi-View 3D Object Detection
Authors: Rui Ding, Zhaonian Kuang, Zongwei Zhou et al. | Submitted: 2026-03-08 | arXiv: 2603.07493
Categories: cs.CV
Research Background: Multi-view 3D detection with bird’s eye view (BEV) is crucial for autonomous driving and robotics, but its robustness in real-world is limited as it struggles to predict accurate depth values. A mainstream solution, cross-modal distillation, transfers depth information from LiDAR to camera models but also unintentionally transfers depth-irrelevant information (e.g.
研究背景: 在機器人學習領域,Multi-view 3D detection with bird’s eye view (BEV) is crucial for autonomous driving and robotics, but its robustness in real-world is limited as it struggles to predict accurate d
Technical Approach: To mitigate this issue, we propose RayD3D, which transfers crucial depth knowledge along the ray: a line projecting from the camera to true location of an object. More specifically, we design two ray-based distillation modules. Our method is trained on clean NuScenes, and tested on both clean NuScenes and RoboBEV with a variety types of data corruptions.
技術方法: 本文提出的方法:To mitigate this issue, we propose RayD3D, which transfers crucial depth knowledge along the ray: a line projecting from the camera to true location of an object. More specifically, we design two ray-
Key Takeaway: Our method significantly improves the robustness of all the three base models in all scenarios without increasing inference costs, and achieves the best when compared to recently released multi-view and distillation models.
核心發現: 核心結果:Our method significantly improves the robustness of all the three base models in all scenarios without increasing inference costs, and achieves the best when compared to recently released multi-view a
A Novel Modular Cable-Driven Soft Robotic Arm with Multi-Segment Reconfigurability
Authors: Moeen Ul Islam, Cheng Ouyang, Xinda Qi et al. | Submitted: 2026-03-02 | arXiv: 2603.02468
Categories: cs.RO
Research Background: This paper presents a novel, modular, cable-driven soft robotic arm featuring multi-segment reconfigurability. The proposed architecture enables a stackable system with independent segment control, allowing scalable adaptation to diverse structural and application requirements.
研究背景: 在機器人學習領域,This paper presents a novel, modular, cable-driven soft robotic arm featuring multi-segment reconfigurability. The proposed architecture enables a stackable system with independent
Technical Approach: This paper presents a novel, modular, cable-driven soft robotic arm featuring multi-segment reconfigurability.
技術方法: 本文提出的方法:This paper presents a novel, modular, cable-driven soft robotic arm featuring multi-segment reconfigurability.
Key Takeaway: These results highlight the potential of stiffness tuning to balance compliance and strength for configuring scalable, reconfigurable soft robotic arms.
核心發現: 核心結果:These results highlight the potential of stiffness tuning to balance compliance and strength for configuring scalable, reconfigurable soft robotic arms.
Learning Therapist Policy from Therapist-Exoskeleton-Patient Interaction
Authors: Grayson Snyder, Lorenzo Vianello, Levi Hargrove et al. | Submitted: 2026-03-02 | arXiv: 2603.02458
Categories: cs.RO
Research Background: Post-stroke rehabilitation is often necessary for patients to regain proper walking gait. However, the typical therapy process can be exhausting and physically demanding for therapists, potentially reducing therapy intensity, duration, and consistency over time.
研究背景: 在機器人學習領域,Post-stroke rehabilitation is often necessary for patients to regain proper walking gait. However, the typical therapy process can be exhausting and physically demanding for therap
Technical Approach: We propose a Patient-Therapist Force Field (PTFF) to visualize therapist responses to patient kinematics and a Synthetic Therapist (ST) machine learning model to support the therapist in dyadic robot-mediated physical interaction therapy.
技術方法: 本文提出的方法:We propose a Patient-Therapist Force Field (PTFF) to visualize therapist responses to patient kinematics and a Synthetic Therapist (ST) machine learning model to support the therapist in dyadic robot-
Key Takeaway: Offline results and preliminary testing indicate the potential of their use as an alternative approach to post-stroke exoskeleton therapy.
核心發現: 核心結果:Offline results and preliminary testing indicate the potential of their use as an alternative approach to post-stroke exoskeleton therapy.
From Transportation to Manipulation: Transforming Magnetic Levitation to Magnetic Robotics
Authors: Lara Bergmann, Noah Greis, Klaus Neumann | Submitted: 2026-03-02 | arXiv: 2603.01982
Categories: cs.RO
Research Background: Magnetic Levitation (MagLev) systems fundamentally increase the flexibility of in-machine material flow in industrial automation. Therefore, these systems enable dynamic throughput optimization, which is especially beneficial for high-mix low-volume manufacturing.
研究背景: 在機器人學習領域,Magnetic Levitation (MagLev) systems fundamentally increase the flexibility of in-machine material flow in industrial automation. Therefore, these systems enable dynamic throughput
Technical Approach: This paper introduces the 6D-Platform MagBot, a low-cost six degrees of freedom parallel kinematic that couples two movers into a composite robotic platform.
技術方法: 本文提出的方法:This paper introduces the 6D-Platform MagBot, a low-cost six degrees of freedom parallel kinematic that couples two movers into a composite robotic platform.
Key Takeaway: Experiments show that the 6D-Platform MagBot achieves sub-millimeter positioning accuracy and supports fully autonomous pick up and drop off via a docking station, allowing rapid and repeatable reconfiguration of the machine.
核心發現: 核心結果:Experiments show that the 6D-Platform MagBot achieves sub-millimeter positioning accuracy and supports fully autonomous pick up and drop off via a docking station, allowing rapid and repeatable reconf
SaferPath: Hierarchical Visual Navigation with Learned Guidance and Safety-Constrained Control
Authors: Lingjie Zhang, Zeyu Jiang, Changhao Chen | Submitted: 2026-03-02 | arXiv: 2603.01898
Categories: cs.RO
Research Background: Visual navigation is a core capability for mobile robots, yet end-to-end learning-based methods often struggle with generalization and safety in unseen, cluttered, or narrow environments. These limitations are especially pronounced in dense indoor settings, where collisions are likely and end-to-end models frequently fail.
研究背景: 在機器人學習領域,Visual navigation is a core capability for mobile robots, yet end-to-end learning-based methods often struggle with generalization and safety in unseen, cluttered, or narrow enviro
Technical Approach: To address this, we propose SaferPath, a hierarchical visual navigation framework that leverages learned guidance from existing end-to-end models and refines it through a safety-constrained optimization-control module.
技術方法: 本文提出的方法:To address this, we propose SaferPath, a hierarchical visual navigation framework that leverages learned guidance from existing end-to-end models and refines it through a safety-constrained optimizati
Key Takeaway: Extensive experiments in scenarios with unseen obstacles, dense unstructured spaces, and narrow corridors demonstrate that SaferPath consistently improves success rates and reduces collisions, outperforming representative baselines such as ViNT and NoMaD, and enabling safe navigation in challenging real-world settings.
核心發現: 核心結果:Extensive experiments in scenarios with unseen obstacles, dense unstructured spaces, and narrow corridors demonstrate that SaferPath consistently improves success rates and reduces collisions, outperf
Shape-Interpretable Visual Self-Modeling Enables Geometry-Aware Continuum Robot Control
Authors: Peng Yu, Xin Wang, Ning Tan | Submitted: 2026-03-02 | arXiv: 2603.01751
Categories: cs.RO, cs.AI, cs.LG, eess.SY
Research Background: Continuum robots possess high flexibility and redundancy, making them well suited for safe interaction in complex environments, yet their continuous deformation and nonlinear dynamics pose fundamental challenges to perception, modeling, and control. Existing vision-based control approaches often rely on end-to-end learning, achieving shape regulation without explicit awareness of robot geometry or its interaction with the environment.
研究背景: 在機器人學習領域,Continuum robots possess high flexibility and redundancy, making them well suited for safe interaction in complex environments, yet their continuous deformation and nonlinear dynam
Technical Approach: Here, we introduce a shape-interpretable visual self-modeling framework for continuum robots that enables geometry-aware control.
技術方法: 本文提出的方法:Here, we introduce a shape-interpretable visual self-modeling framework for continuum robots that enables geometry-aware control.
Key Takeaway: Experiments on a cable-driven continuum robot demonstrate accurate shape-position regulation and tracking, with shape errors within 1.56% of image resolution and end-effector errors within 2% of robot length, as well as robust performance in constrained environments.
核心發現: 核心結果:Experiments on a cable-driven continuum robot demonstrate accurate shape-position regulation and tracking, with shape errors within 1.56% of image resolution and end-effector errors within 2% of robot
SFCo-Nav: Efficient Zero-Shot Visual Language Navigation via Collaboration of Slow LLM and Fast Attributed Graph Alignment
Authors: Chaoran Xiong, Litao Wei, Xinhao Hu et al. | Submitted: 2026-03-02 | arXiv: 2603.01477
Categories: cs.RO
Research Background: Recent advances in large vision-language models (VLMs) and large language models (LLMs) have enabled zero-shot approaches to visual language navigation (VLN), where an agent follows natural language instructions using only ego perception and reasoning. However, existing zero-shot methods typically construct a naive observation graph and perform per-step VLM-LLM inference on it, resulting in high latency and computation costs that limit real-time deployment.
研究背景: 在機器人學習領域,Recent advances in large vision-language models (VLMs) and large language models (LLMs) have enabled zero-shot approaches to visual language navigation (VLN), where an agent follow
Technical Approach: To address this, we present SFCo-Nav, an efficient zero-shot VLN framework inspired by the principle of slow-fast cognitive collaboration.
技術方法: 本文提出的方法:To address this, we present SFCo-Nav, an efficient zero-shot VLN framework inspired by the principle of slow-fast cognitive collaboration.
Key Takeaway: Finally, we demonstrate SFCo-Nav on a legged robot in a hotel suite, showcasing its efficiency and practicality in indoor environments.
核心發現: 核心結果:Finally, we demonstrate SFCo-Nav on a legged robot in a hotel suite, showcasing its efficiency and practicality in indoor environments.
Expanding LLM Agent Boundaries with Strategy-Guided Exploration
Authors: Andrew Szot, Michael Kirchhof, Omar Attia et al. | Submitted: 2026-03-02 | arXiv: 2603.02045
Categories: cs.LG
Research Background: Reinforcement learning (RL) has demonstrated notable success in post-training large language models (LLMs) as agents for tasks such as computer use, tool calling, and coding. However, exploration remains a central challenge in RL for LLM agents, especially as they operate in language-action spaces with complex observations and sparse outcome rewards.
研究背景: 在機器人學習領域,Reinforcement learning (RL) has demonstrated notable success in post-training large language models (LLMs) as agents for tasks such as computer use, tool calling, and coding. Howev
Technical Approach: However, exploration remains a central challenge in RL for LLM agents, especially as they operate in language-action spaces with complex observations and sparse outcome rewards. In this work, we address exploration for LLM agents by leveraging the ability of LLMs to plan and reason in language about the environment to shift exploration from low-level actions to higher-level language strategies. We thus propose Strategy-Guided Exploration (SGE), which first generates a concise natural-language strategy that describes what to do to make progress toward the goal, and then generates environment actions conditioned on that strategy.
技術方法: 本文提出的方法:However, exploration remains a central challenge in RL for LLM agents, especially as they operate in language-action spaces with complex observations and sparse outcome rewards. In this work, we addre
Key Takeaway: We show that SGE enables the agent to learn to solve tasks too difficult for the base model.
核心發現: 核心結果:We show that SGE enables the agent to learn to solve tasks too difficult for the base model.
ATA: Bridging Implicit Reasoning with Attention-Guided and Action-Guided Inference for Vision-Language Action Models
Authors: Cheng Yang, Jianhao Jiao, Lingyi Huang et al. | Submitted: 2026-03-02 | arXiv: 2603.01490
Categories: cs.CV, cs.AI
Research Background: Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate visual perception is crucial for precise action prediction and execution, recent work has attempted to further improve performance by introducing explicit reasoning during inference.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate v
Technical Approach: To address these challenges, we propose ATA, a novel training-free framework that introduces implicit reasoning into VLA inference through complementary attention-guided and action-guided strategies.
技術方法: 本文提出的方法:To address these challenges, we propose ATA, a novel training-free framework that introduces implicit reasoning into VLA inference through complementary attention-guided and action-guided strategies.
Key Takeaway: Extensive experiments show that it consistently improves task success and robustness while preserving, and even enhancing, inference efficiency.
核心發現: 核心結果:Extensive experiments show that it consistently improves task success and robustness while preserving, and even enhancing, inference efficiency.
Passive Phase-Oriented Impedance Shaping for Rapid Acceleration in Soft Robotic Swimmers
Authors: Qimin Feng, Orion A. Roberts, Qiang Zhong | Submitted: 2026-03-03 | arXiv: 2603.03537
Categories: cs.RO
Research Background: Rapid acceleration and burst maneuvers in underwater robots depend less on maintaining precise resonance and more on force—velocity phase alignment during thrust generation. In this work, we investigate constrained-layer damping (CLD) as a passive mechanism for frequency-selective impedance shaping in soft robotic swimmers.
研究背景: 在機器人學習領域,Rapid acceleration and burst maneuvers in underwater robots depend less on maintaining precise resonance and more on force—velocity phase alignment during thrust generation. In th
Technical Approach: In this work, we investigate constrained-layer damping (CLD) as a passive mechanism for frequency-selective impedance shaping in soft robotic swimmers. Unlike conventional stiffness-tuning approaches, CLD selectively amplifies the dissipative component of bending impedance while preserving storage stiffness, passively shifting the impedance composition toward dissipative dominance as actuation frequency increases. We characterize this behavior through dry impedance measurements, demonstrate that CLD enhances thrust and alters force—motion phase relationships across Strouhal numbers in constrained propulsion tests, and validate that passive impedance shaping yields a nearly five-fold increase in peak acceleration and a three-fold increase in terminal velocity in unconstrained swimming trials.
技術方法: 本文提出的方法:In this work, we investigate constrained-layer damping (CLD) as a passive mechanism for frequency-selective impedance shaping in soft robotic swimmers. Unlike conventional stiffness-tuning approaches,
Key Takeaway: These results establish phase-oriented passive impedance modulation as a simple, control-free pathway for improving transient propulsion in soft robotic systems.
核心發現: 核心結果:These results establish phase-oriented passive impedance modulation as a simple, control-free pathway for improving transient propulsion in soft robotic systems.
Tether: Autonomous Functional Play with Correspondence-Driven Trajectory Warping
Authors: William Liang, Sam Wang, Hung-Ju Wang et al. | Submitted: 2026-03-03 | arXiv: 2603.03278
Categories: cs.RO, cs.AI, cs.CV
Research Background: The ability to conduct and learn from interaction and experience is a central challenge in robotics, offering a scalable alternative to labor-intensive human demonstrations. However, realizing such “play” requires (1) a policy robust to diverse, potentially out-of-distribution environment states, and (2) a procedure that continuously produces useful robot experience.
研究背景: 在機器人學習領域,The ability to conduct and learn from interaction and experience is a central challenge in robotics, offering a scalable alternative to labor-intensive human demonstrations. Howeve
Technical Approach: To address these challenges, we introduce Tether, a method for autonomous functional play involving structured, task-directed interactions. First, we design a novel open-loop policy that warps actions from a small set of source demonstrations (<=10) by anchoring them to semantic keypoint correspondences in the target scene. In a household-like multi-object setup, our method is the first to perform many hours of autonomous multi-task play in the real world starting from only a handful of demonstrations.
技術方法: 本文提出的方法:To address these challenges, we introduce Tether, a method for autonomous functional play involving structured, task-directed interactions. First, we design a novel open-loop policy that warps actions
Key Takeaway: This produces a stream of data that consistently improves the performance of closed-loop imitation policies over time, ultimately yielding over 1000 expert-level trajectories and training policies competitive with those learned from human-collected demonstrations.
核心發現: 核心結果:This produces a stream of data that consistently improves the performance of closed-loop imitation policies over time, ultimately yielding over 1000 expert-level trajectories and training policies com
From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?
Authors: Shinas Shaji, Fabian Huppertz, Alex Mitrevski et al. | Submitted: 2026-03-03 | arXiv: 2603.03148
Categories: cs.RO
Research Background: In order to flexibly act in an everyday environment, a robotic agent needs a variety of cognitive capabilities that enable it to reason about plans and perform execution recovery. Large language models (LLMs) have been shown to demonstrate emergent cognitive aspects, such as reasoning and language understanding; however, the ability to control embodied robotic agents requires reliably bridging high-level language to low-level functionalities for perception and control.
研究背景: 在機器人學習領域,In order to flexibly act in an everyday environment, a robotic agent needs a variety of cognitive capabilities that enable it to reason about plans and perform execution recovery.
Technical Approach: In this paper, we investigate the extent to which an LLM can serve as a core component for planning and execution reasoning in a cognitive robot architecture. For this purpose, we propose a cognitive architecture in which an agentic LLM serves as the core component for planning and reasoning, while components for working and episodic memories support learning from experience and adaptation.
技術方法: 本文提出的方法:In this paper, we investigate the extent to which an LLM can serve as a core component for planning and execution reasoning in a cognitive robot architecture. For this purpose, we propose a cognitive
Key Takeaway: The results demonstrate that the LLM-driven agent can complete structured tasks and exhibits emergent adaptation and memory-guided planning, but also reveal significant limitations, such as hallucinations about the task success and poor instruction following by refusing to acknowledge and complete sequential tasks.
核心發現: 核心結果:The results demonstrate that the LLM-driven agent can complete structured tasks and exhibits emergent adaptation and memory-guided planning, but also reveal significant limitations, such as hallucinat
Look Forward to Walk Backward: Efficient Terrain Memory for Backward Locomotion with Forward Vision
Authors: Shixin Luo, Songbo Li, Yuan Hao et al. | Submitted: 2026-03-03 | arXiv: 2603.03138
Categories: cs.RO
Research Background: Legged robots with egocentric forward-facing depth cameras can couple exteroception and proprioception to achieve robust forward agility on complex terrain. When these robots walk backward, the forward-only field of view provides no preview.
研究背景: 在機器人學習領域,Legged robots with egocentric forward-facing depth cameras can couple exteroception and proprioception to achieve robust forward agility on complex terrain. When these robots walk
Technical Approach: We present Look Forward to Walk Backward (LF2WB), an efficient terrain-memory locomotion framework that uses forward egocentric depth and proprioception to write a compact associative memory during forward motion and to retrieve it for collision-free backward locomotion without rearward vision. Experiments in both simulations and real-world scenarios demonstrate the effectiveness of our method, improving backward agility across complex terrains under limited sensing.
技術方法: 本文提出的方法:We present Look Forward to Walk Backward (LF2WB), an efficient terrain-memory locomotion framework that uses forward egocentric depth and proprioception to write a compact associative memory during fo
Key Takeaway: Experiments in both simulations and real-world scenarios demonstrate the effectiveness of our method, improving backward agility across complex terrains under limited sensing.
核心發現: 核心結果:Experiments in both simulations and real-world scenarios demonstrate the effectiveness of our method, improving backward agility across complex terrains under limited sensing.
MA-CoNav: A Master-Slave Multi-Agent Framework with Hierarchical Collaboration and Dual-Level Reflection for Long-Horizon Embodied VLN
Authors: Ling Luo, Qianqian Bai | Submitted: 2026-03-03 | arXiv: 2603.03024
Categories: cs.RO, cs.AI
Research Background: Vision-Language Navigation (VLN) aims to empower robots with the ability to perform long-horizon navigation in unfamiliar environments based on complex linguistic instructions. Its success critically hinges on establishing an efficient “language-understanding — visual-perception — embodied-execution” closed loop.
研究背景: 在機器人學習領域,Vision-Language Navigation (VLN) aims to empower robots with the ability to perform long-horizon navigation in unfamiliar environments based on complex linguistic instructions. Its
Technical Approach: Inspired by distributed cognition theory, this paper proposes MA-CoNav, a Multi-Agent Collaborative Navigation framework.
技術方法: 本文提出的方法:Inspired by distributed cognition theory, this paper proposes MA-CoNav, a Multi-Agent Collaborative Navigation framework.
Key Takeaway: The results demonstrate that MA-CoNav comprehensively outperforms existing mainstream VLN methods across multiple metrics.
核心發現: 核心結果:The results demonstrate that MA-CoNav comprehensively outperforms existing mainstream VLN methods across multiple metrics.
CASSR: Continuous A-Star Search through Reachability for real time footstep planning
Authors: Jiayi Wang, Steve Tonneau | Submitted: 2026-03-03 | arXiv: 2603.02989
Categories: cs.RO
Research Background: Footstep planning involves a challenging combinatorial search. Traditional A* approaches require discretising reachability constraints, while Mixed-Integer Programming (MIP) supports continuous formulations but quickly becomes intractable, especially when rotations are included.
研究背景: 在機器人學習領域,Footstep planning involves a challenging combinatorial search. Traditional A* approaches require discretising reachability constraints, while Mixed-Integer Programming (MIP) suppor
Technical Approach: We present CASSR, a novel framework that recursively propagates convex, continuous formulations of a robot’s kinematic constraints within an A* search.
技術方法: 本文提出的方法:We present CASSR, a novel framework that recursively propagates convex, continuous formulations of a robot’s kinematic constraints within an A* search.
Key Takeaway: These results show that CASSR enables fast, reliable, and real-time footstep planning for biped robots.
核心發現: 核心結果:These results show that CASSR enables fast, reliable, and real-time footstep planning for biped robots.
Emerging trends in Cislunar Space for Lunar Science Exploration and Space Robotics aiding Human Spaceflight Safety
Authors: Arsalan Muhammad, Yue Wang, Hai Huang et al. | Submitted: 2026-03-03 | arXiv: 2603.02878
Categories: cs.RO, astro-ph.EP
Research Background: In recent years, the Moon has emerged as an unparalleled extraterrestrial testbed for advancing cuttingedge technological and scientific research critical to enabling sustained human presence on its surface and supporting future interplanetary exploration. This study identifies and investigates two pivotal research domains with substantial transformative potential for accelerating humanity interplanetary aspirations.
研究背景: 在機器人學習領域,In recent years, the Moon has emerged as an unparalleled extraterrestrial testbed for advancing cuttingedge technological and scientific research critical to enabling sustained hum
Technical Approach: This study identifies and investigates two pivotal research domains with substantial transformative potential for accelerating humanity interplanetary aspirations. First is Lunar Science Exploration with Artificial Intelligence and Space Robotics which focusses on AI and Space Robotics redefining the frontiers of space exploration. Second being Space Robotics aid in manned spaceflight to the Moon serving as critical assets for pre-deployment infrastructure development, In-Situ Resource Utilization, surface operations support, and astronaut safety assurance.
技術方法: 本文提出的方法:This study identifies and investigates two pivotal research domains with substantial transformative potential for accelerating humanity interplanetary aspirations. First is Lunar Science Exploration w
Key Takeaway: By integrating autonomy, machine learning, and realtime sensor fusion, space robotics not only augment human capabilities but also serve as force multipliers in achieving sustainable lunar exploration, paving the way for future crewed missions to Mars and beyond.
核心發現: 核心結果:By integrating autonomy, machine learning, and realtime sensor fusion, space robotics not only augment human capabilities but also serve as force multipliers in achieving sustainable lunar exploration
Design, Modeling and Direction Control of a Wire-Driven Robotic Fish Based on a 2-DoF Crank-Slider Mechanism
Authors: Yita Wang, Chen Chen, Yicheng Chen et al. | Submitted: 2026-03-03 | arXiv: 2603.02851
Categories: cs.RO
Research Background: Robotic fish have attracted growing attention in recent years owing to their biomimetic design and potential applications in environmental monitoring and biological surveys. Among robotic fish employing the Body-Caudal Fin (BCF) locomotion pattern, motor-driven actuation is widely adopted.
研究背景: 在機器人學習領域,Robotic fish have attracted growing attention in recent years owing to their biomimetic design and potential applications in environmental monitoring and biological surveys. Among
Technical Approach: To address this trade-off, we develop a wire-driven robotic fish equipped with a 2-degree-of-freedom (DoF) crank-slider mechanism that decouples propulsion from steering, enabling both high swimming speed and agile maneuvering. In this paper, we first present the design of the robotic fish, including the elastic skeleton, waterproof structure, and the actuation mechanism that realizes the decoupling. Furthermore, we propose a combined feedforward-feedback control strategy to achieve independent regulation of propulsion and steering.
技術方法: 本文提出的方法:To address this trade-off, we develop a wire-driven robotic fish equipped with a 2-degree-of-freedom (DoF) crank-slider mechanism that decouples propulsion from steering, enabling both high swimming s
Key Takeaway: Finally, we validate the feasibility of the design, modeling, and control through a series of prototype experiments, demonstrating swimming, turning, and directional control.
核心發現: 核心結果:Finally, we validate the feasibility of the design, modeling, and control through a series of prototype experiments, demonstrating swimming, turning, and directional control.
Compositional Visual Planning via Inference-Time Diffusion Scaling
Authors: Yixin Zhang, Yunhao Luo, Utkarsh Aashu Mishra et al. | Submitted: 2026-03-03 | arXiv: 2603.02646
Categories: cs.RO
Research Background: Diffusion models excel at short-horizon robot planning, yet scaling them to long-horizon tasks remains challenging due to computational constraints and limited training data. Existing compositional approaches stitch together short segments by separately denoising each component and averaging overlapping regions.
研究背景: 在機器人學習領域,Diffusion models excel at short-horizon robot planning, yet scaling them to long-horizon tasks remains challenging due to computational constraints and limited training data. Exist
Technical Approach: We propose that the key to stable compositional generation lies in enforcing boundary agreement on the estimated clean data (Tweedie estimates) rather than on noisy intermediate states. Our method formulates long-horizon planning as inference over a chain-structured factor graph of overlapping video chunks, where pretrained short-horizon video diffusion models provide local priors.
技術方法: 本文提出的方法:We propose that the key to stable compositional generation lies in enforcing boundary agreement on the estimated clean data (Tweedie estimates) rather than on noisy intermediate states. Our method for
Key Takeaway: Our training-free framework demonstrates significant improvements over existing baselines, effectively generalizing to unseen start-goal combinations that were not present in the original training data.
核心發現: 核心結果:Our training-free framework demonstrates significant improvements over existing baselines, effectively generalizing to unseen start-goal combinations that were not present in the original training dat
Wukong-Omni: Design, Modeling and Control of a Multi-mode Robot for Air, Land, and Underwater Exploration with All-in-One Propulsion Unit
Authors: Yufan Liu, Rixi Yu, Junjie Li et al. | Submitted: 2026-03-03 | arXiv: 2603.02602
Categories: cs.RO
Research Background: In flood disaster rescue scenarios, partially submerged buildings prevent aerial robots from accessing lower levels, limiting mission effectiveness. To address this challenge, this paper presents Wukong-Omni, a novel multimode robot capable of operating across land, air, and underwater using a unified propulsion system.
研究背景: 在機器人學習領域,In flood disaster rescue scenarios, partially submerged buildings prevent aerial robots from accessing lower levels, limiting mission effectiveness. To address this challenge, this
Technical Approach: To address this challenge, this paper presents Wukong-Omni, a novel multimode robot capable of operating across land, air, and underwater using a unified propulsion system.
技術方法: 本文提出的方法:To address this challenge, this paper presents Wukong-Omni, a novel multimode robot capable of operating across land, air, and underwater using a unified propulsion system.
Key Takeaway: Outdoor experiments further demonstrate robustness and adaptability in real-world environments.
核心發現: 核心結果:Outdoor experiments further demonstrate robustness and adaptability in real-world environments.
Instant and Reversible Adhesive-free Bonding Between Silicones and Glossy Papers for Soft Robotics
Authors: Takumi Shibuya, Kazuya Murakami, Akitsu Shigetou et al. | Submitted: 2026-03-03 | arXiv: 2603.02500
Categories: cs.RO
Research Background: Integrating silicone with non-extensible materials is a common strategy used in the fabrication of fluidically-driven soft actuators, yet conventional approaches often rely on irreversible adhesives or embedding processes that are labor-intensive and difficult to modify. This work presents silicone-glossy paper bonding (SGB), a rapid, adhesive-free, and solvent-reversible bonding approach that forms robust silicone-paper interfaces simply through contact.
研究背景: 在機器人學習領域,Integrating silicone with non-extensible materials is a common strategy used in the fabrication of fluidically-driven soft actuators, yet conventional approaches often rely on irre
Technical Approach: This work presents silicone-glossy paper bonding (SGB), a rapid, adhesive-free, and solvent-reversible bonding approach that forms robust silicone-paper interfaces simply through contact. The SGB interface withstands high mechanical loads (shear strength > 61 kPa) and can be fully detached and reassembled via ethanol immersion without loss of performance, enabling component reuse and rapid redesign. Characterization studies indicate that surface functional groups primarily govern adhesion on the glossy paper and the modulus of the silicone, while durability and environmental response clarify the conditions for reversible debonding.
技術方法: 本文提出的方法:This work presents silicone-glossy paper bonding (SGB), a rapid, adhesive-free, and solvent-reversible bonding approach that forms robust silicone-paper interfaces simply through contact. The SGB inte
Key Takeaway: The results further suggest a synergistic interaction of hydrogen bonding and oligomer diffusion, yielding strong yet reconfigurable adhesion.
核心發現: 核心結果:The results further suggest a synergistic interaction of hydrogen bonding and oligomer diffusion, yielding strong yet reconfigurable adhesion.
From Local Corrections to Generalized Skills: Improving Neuro-Symbolic Policies with MEMO
Authors: Benjamin A. Christie, Yinlong Dai, Mohammad Bararjanianbahnamiri et al. | Submitted: 2026-03-04 | arXiv: 2603.04560
Categories: cs.RO
Research Background: Recent works use a neuro-symbolic framework for general manipulation policies. The advantage of this framework is that — by applying off-the-shelf vision and language models — the robot can break complex tasks down into semantic subtasks.
研究背景: 在機器人學習領域,Recent works use a neuro-symbolic framework for general manipulation policies. The advantage of this framework is that — by applying off-the-shelf vision and language models — th
Technical Approach: We propose to address this limitation — and dynamically expand the robot’s skills — by leveraging user feedback. Applying this hypothesis we develop Memory Enhanced Manipulation (MEMO).
技術方法: 本文提出的方法:We propose to address this limitation — and dynamically expand the robot’s skills — by leveraging user feedback. Applying this hypothesis we develop Memory Enhanced Manipulation (MEMO).
Key Takeaway: Our experiments demonstrate that using MEMO to aggregate local feedback into general skill templates enables generalization to novel tasks where existing baselines fall short.
核心發現: 核心結果:Our experiments demonstrate that using MEMO to aggregate local feedback into general skill templates enables generalization to novel tasks where existing baselines fall short.
Many-RRT*: Robust Joint-Space Trajectory Planning for Serial Manipulators
Authors: Theodore M. Belmont, Benjamin A. Christie, Anton Netchaev | Submitted: 2026-03-04 | arXiv: 2603.04547
Categories: cs.RO
Research Background: The rapid advancement of high degree-of-freedom (DoF) serial manipulators necessitates the use of swift, sampling-based motion planners for high-dimensional spaces. While sampling-based planners like the Rapidly-Exploring Random Tree (RRT) are widely used, planning in the manipulator’s joint space presents significant challenges due to non-invertible forward kinematics.
研究背景: 在機器人學習領域,The rapid advancement of high degree-of-freedom (DoF) serial manipulators necessitates the use of swift, sampling-based motion planners for high-dimensional spaces. While sampling-
Technical Approach: To address this planning problem, we propose Many-RRT*: an extension of RRT*-Connect that plans to multiple goals in parallel.
技術方法: 本文提出的方法:To address this planning problem, we propose Many-RRT*: an extension of RRT*-Connect that plans to multiple goals in parallel.
Key Takeaway: Experimental evaluations across robot morphologies and diverse obstacle environments demonstrate that Many-RRT* provides higher quality trajectories (44.5% lower cost in the same runtime) with a significantly higher success rate (100% vs. the next best of 1.6%) than previous RRT iterations without compromising on runtime performance.
核心發現: 核心結果:Experimental evaluations across robot morphologies and diverse obstacle environments demonstrate that Many-RRT* provides higher quality trajectories (44.5% lower cost in the same runtime) with a signi
A Soft Robotic Demonstration in the Stratosphere
Authors: Codrin Tugui, Tirth Thakar, Anatol Gogoj et al. | Submitted: 2026-03-04 | arXiv: 2603.04352
Categories: cs.RO, cond-mat.mtrl-sci
Research Background: Machines designed for operation in Space, as well as other extreme environments, need to be both resilient and adaptable when mission parameters change. Soft robots offer advantages in adaptability, but most lack resilience to the pressure and temperature extremes found as close as the Stratosphere.
研究背景: 在機器人學習領域,Machines designed for operation in Space, as well as other extreme environments, need to be both resilient and adaptable when mission parameters change. Soft robots offer advantage
Technical Approach: Here we present a crosslinking mechanism for silicone elastomers under ultraviolet light using trimethyl(methylcyclopentadienyl)platinum(IV) as a catalyst to react hydrosilane to vinyl groups.
技術方法: 本文提出的方法:Here we present a crosslinking mechanism for silicone elastomers under ultraviolet light using trimethyl(methylcyclopentadienyl)platinum(IV) as a catalyst to react hydrosilane to vinyl groups.
Key Takeaway: Two stratospheric balloon missions were carried out and demonstrated DEAs as a viable soft robotic technology under space-like conditions (as high as 23.6 km elevation, at <0.05 atm and -55° C).
核心發現: 核心結果:Two stratospheric balloon missions were carried out and demonstrated DEAs as a viable soft robotic technology under space-like conditions (as high as 23.6 km elevation, at <0.05 atm and -55° C).
GarmentPile++: Affordance-Driven Cluttered Garments Retrieval with Vision-Language Reasoning
Authors: Mingleyang Li, Yuran Wang, Yue Chen et al. | Submitted: 2026-03-04 | arXiv: 2603.04158
Categories: cs.RO, cs.AI
Research Background: Garment manipulation has attracted increasing attention due to its critical role in home-assistant robotics. However, the majority of existing garment manipulation works assume an initial state consisting of only one garment, while piled garments are far more common in real-world settings.
研究背景: 在機器人學習領域,Garment manipulation has attracted increasing attention due to its critical role in home-assistant robotics. However, the majority of existing garment manipulation works assume an
Technical Approach: To bridge this gap, we propose a novel garment retrieval pipeline that can not only follow language instruction to execute safe and clean retrieval but also guarantee exactly one garment is retrieved per attempt, establishing a robust foundation for the execution of downstream tasks (e.g., folding, hanging, wearing).
技術方法: 本文提出的方法:To bridge this gap, we propose a novel garment retrieval pipeline that can not only follow language instruction to execute safe and clean retrieval but also guarantee exactly one garment is retrieved
Key Takeaway: The effectiveness of our pipeline are consistently demonstrated across diverse tasks and varying scenarios in both real-world and simulation environments.
核心發現: 核心結果:The effectiveness of our pipeline are consistently demonstrated across diverse tasks and varying scenarios in both real-world and simulation environments.
Modeling and Control of a Pneumatic Soft Robotic Catheter Using Neural Koopman Operators
Authors: Yiyao Yue, Noah Barnes, Lingyun Di et al. | Submitted: 2026-03-04 | arXiv: 2603.04118
Categories: cs.RO
Research Background: Catheter-based interventions are widely used for the diagnosis and treatment of cardiac diseases. Recently, robotic catheters have attracted attention for their ability to improve precision and stability over conventional manual approaches.
研究背景: 在機器人學習領域,Catheter-based interventions are widely used for the diagnosis and treatment of cardiac diseases. Recently, robotic catheters have attracted attention for their ability to improve
Technical Approach: To address this, we propose a neural network-enhanced Koopman operator framework that jointly learns the lifted space representation and Koopman operator in an end-to-end manner. Our approach achieves average errors of 2.1 +- 0.4 mm in position and 4.9 +- 0.6 degrees in orientation, outperforming not only model-based baselines but also other Koopman variants in targeting accuracy and efficiency.
技術方法: 本文提出的方法:To address this, we propose a neural network-enhanced Koopman operator framework that jointly learns the lifted space representation and Koopman operator in an end-to-end manner. Our approach achieves
Key Takeaway: These results highlight the potential of the proposed framework for advancing soft robotic catheter systems and improving catheter-based interventions.
核心發現: 核心結果:These results highlight the potential of the proposed framework for advancing soft robotic catheter systems and improving catheter-based interventions.
ArthroCut: Autonomous Policy Learning for Robotic Bone Resection in Knee Arthroplasty
Authors: Xu Lu, Yiling Zhang, Wenquan Cheng et al. | Submitted: 2026-03-04 | arXiv: 2603.03957
Categories: cs.RO
Research Background: Despite rapid commercialization of surgical robots, their autonomy and real-time decision-making remain limited in practice. To address this gap, we propose ArthroCut, an autonomous policy learning framework that upgrades knee arthroplasty robots from assistive execution to context-aware action generation.
研究背景: 在機器人學習領域,Despite rapid commercialization of surgical robots, their autonomy and real-time decision-making remain limited in practice. To address this gap, we propose ArthroCut, an autonomou
Technical Approach: To address this gap, we propose ArthroCut, an autonomous policy learning framework that upgrades knee arthroplasty robots from assistive execution to context-aware action generation.
技術方法: 本文提出的方法:To address this gap, we propose ArthroCut, an autonomous policy learning framework that upgrades knee arthroplasty robots from assistive execution to context-aware action generation.
Key Takeaway: These results indicate that aligning preoperative geometry with time-aligned intraoperative perception and translating that alignment into tokenized, constrained actions is an effective path toward robust, interpretable autonomy in orthopedic robotic surgery.
核心發現: 核心結果:These results indicate that aligning preoperative geometry with time-aligned intraoperative perception and translating that alignment into tokenized, constrained actions is an effective path toward ro
Characterization and Correlation of Robotic Snake Scale Friction and Locomotion Speed
Authors: Umit Sen, Andri Mahegan, Gina Olson | Submitted: 2026-03-04 | arXiv: 2603.03735
Categories: cs.RO
Research Background: Snake robots are inspired by the ability of biological snakes to move over rock, grass, leaves, soil, up trees, along pavement and more. Their ability to move in multiple distinct environments is due to their legless locomotion strategy, which combines distinct gaits with a skin that exhibits frictional anisotropy.
研究背景: 在機器人學習領域,Snake robots are inspired by the ability of biological snakes to move over rock, grass, leaves, soil, up trees, along pavement and more. Their ability to move in multiple distinct
Technical Approach: In this paper, our contributions include: (i) the development of a novel articulated pseudo-skin design that is modular, easy to construct and has removable or replaceable scales; (ii) experimental measurement of the frictional characteristics of otherwise-identical scales at varying angles of attack (15°, 25°, 35°, 45°) on different surfaces of interest (grass, bark, smooth surface, carpet);(iii) separate measurements of locomotion speed for each angle and surface.
技術方法: 本文提出的方法:In this paper, our contributions include: (i) the development of a novel articulated pseudo-skin design that is modular, easy to construct and has removable or replaceable scales; (ii) experimental me
Key Takeaway: We conclude that either frictional ratios alone are not sufficient to predict the observed speed of a snake robot, or that specific measurement approaches are required to accurately capture these ratios.
核心發現: 核心結果:We conclude that either frictional ratios alone are not sufficient to predict the observed speed of a snake robot, or that specific measurement approaches are required to accurately capture these rati
X-Loco: Towards Generalist Humanoid Locomotion Control via Synergetic Policy Distillation
Authors: Dewei Wang, Xinmiao Wang, Chenyun Zhang et al. | Submitted: 2026-03-04 | arXiv: 2603.03733
Categories: cs.RO
Research Background: While recent advances have demonstrated strong performance in individual humanoid skills such as upright locomotion, fall recovery and whole-body coordination, learning a single policy that masters all these skills remains challenging due to the diverse dynamics and conflicting control objectives involved. To address this, we introduce X-Loco, a framework for training a vision-based generalist humanoid locomotion policy.
研究背景: 在機器人學習領域,While recent advances have demonstrated strong performance in individual humanoid skills such as upright locomotion, fall recovery and whole-body coordination, learning a single po
Technical Approach: To address this, we introduce X-Loco, a framework for training a vision-based generalist humanoid locomotion policy. Ablation studies further highlight that our framework effectively leverages specialist expertise and enhances learning efficiency.
技術方法: 本文提出的方法:To address this, we introduce X-Loco, a framework for training a vision-based generalist humanoid locomotion policy. Ablation studies further highlight that our framework effectively leverages special
Key Takeaway: Experimental results show that X-Loco achieves superior performance, demonstrated by tasks such as fall recovery and terrain traversal.
核心發現: 核心結果:Experimental results show that X-Loco achieves superior performance, demonstrated by tasks such as fall recovery and terrain traversal.
PROSPECT: Unified Streaming Vision-Language Navigation via Semantic—Spatial Fusion and Latent Predictive Representation
Authors: Zehua Fan, Wenqi Lyu, Wenxuan Song et al. | Submitted: 2026-03-04 | arXiv: 2603.03739
Categories: cs.CV, cs.AI
Research Background: Multimodal large language models (MLLMs) have advanced zero-shot end-to-end Vision-Language Navigation (VLN), yet robust navigation requires not only semantic understanding but also predictive modeling of environment dynamics and spatial structure. We propose PROSPECT, a unified streaming navigation agent that couples a streaming Vision-Language-Action (VLA) policy with latent predictive representation learning.
研究背景: 在機器人學習領域,Multimodal large language models (MLLMs) have advanced zero-shot end-to-end Vision-Language Navigation (VLN), yet robust navigation requires not only semantic understanding but als
Technical Approach: We propose PROSPECT, a unified streaming navigation agent that couples a streaming Vision-Language-Action (VLA) policy with latent predictive representation learning. During training, we introduce learnable stream query tokens that query the streaming context and predict next-step 2D and 3D latent features (rather than pixels or explicit modalities), supervised in the latent spaces of frozen SigLIP and CUT3R teachers.
技術方法: 本文提出的方法:We propose PROSPECT, a unified streaming navigation agent that couples a streaming Vision-Language-Action (VLA) policy with latent predictive representation learning. During training, we introduce lea
Key Takeaway: Experiments on VLN-CE benchmarks and real-robot deployment demonstrate state-of-the-art performance and improved long-horizon robustness under diverse lighting.
核心發現: 核心結果:Experiments on VLN-CE benchmarks and real-robot deployment demonstrate state-of-the-art performance and improved long-horizon robustness under diverse lighting.
Vision-Language System using Open-Source LLMs for Gestures in Medical Interpreter Robots
Authors: Thanh-Tung Ngo, Emma Murphy, Robert J. Ross | Submitted: 2026-03-05 | arXiv: 2603.05751
Categories: cs.RO, cs.HC
Research Background: Effective communication is vital in healthcare, especially across language barriers, where non-verbal cues and gestures are critical. This paper presents a privacy-preserving vision-language framework for medical interpreter robots that detects specific speech acts (consent and instruction) and generates corresponding robotic gestures.
研究背景: 在機器人學習領域,Effective communication is vital in healthcare, especially across language barriers, where non-verbal cues and gestures are critical. This paper presents a privacy-preserving visio
Technical Approach: This paper presents a privacy-preserving vision-language framework for medical interpreter robots that detects specific speech acts (consent and instruction) and generates corresponding robotic gestures. Our approach significantly improves computational efficiency and, in user studies, outperforms the speech-gesture generation baseline in human-likeness while maintaining comparable appropriateness.
技術方法: 本文提出的方法:This paper presents a privacy-preserving vision-language framework for medical interpreter robots that detects specific speech acts (consent and instruction) and generates corresponding robotic gestur
Key Takeaway: Our approach significantly improves computational efficiency and, in user studies, outperforms the speech-gesture generation baseline in human-likeness while maintaining comparable appropriateness.
核心發現: 核心結果:Our approach significantly improves computational efficiency and, in user studies, outperforms the speech-gesture generation baseline in human-likeness while maintaining comparable appropriateness.
A Pivot-Based Kirigami Utensil for Hand-Held and Robot-Assisted Feeding
Authors: Keone Leao, Grace Brotherson, Iain Mischel et al. | Submitted: 2026-03-05 | arXiv: 2603.06716
Categories: cs.RO
Research Background: Eating is a daily challenge for over 60 million adults with essential tremors and other mobility limitations. For these users, traditional utensils like forks or spoons are difficult to manipulate — resulting in accidental spills and restricting the types of food that can be consumed.
研究背景: 在機器人學習領域,Eating is a daily challenge for over 60 million adults with essential tremors and other mobility limitations. For these users, traditional utensils like forks or spoons are difficu
Technical Approach: To assist a broader range of users, we introduce a re-designed kiri-spoon that can be leveraged as either a hand-held utensil or a robot-mounted attachment.
技術方法: 本文提出的方法:To assist a broader range of users, we introduce a re-designed kiri-spoon that can be leveraged as either a hand-held utensil or a robot-mounted attachment.
Key Takeaway: See a video of our kiri-spoon here: https://youtu.be/FFIomm5RL98
核心發現: 核心結果:See a video of our kiri-spoon here: https://youtu.be/FFIomm5RL98
Relational Semantic Reasoning on 3D Scene Graphs for Open World Interactive Object Search
Authors: Imen Mahdi, Matteo Cassinelli, Fabien Despinoy et al. | Submitted: 2026-03-05 | arXiv: 2603.05642
Categories: cs.RO, cs.AI
Research Background: Open-world interactive object search in household environments requires understanding semantic relationships between objects and their surrounding context to guide exploration efficiently. Prior methods either rely on vision-language embeddings similarity, which does not reliably capture task-relevant relational semantics, or large language models (LLMs), which are too slow and costly for real-time deployment.
研究背景: 在機器人學習領域,Open-world interactive object search in household environments requires understanding semantic relationships between objects and their surrounding context to guide exploration effi
Technical Approach: We introduce SCOUT: Scene Graph-Based Exploration with Learned Utility for Open-World Interactive Object Search, a novel method that searches directly over 3D scene graphs by assigning utility scores to rooms, frontiers, and objects using relational exploration heuristics such as room-object containment and object-object co-occurrence. To make this practical without sacrificing open-vocabulary generalization, we propose an offline procedural distillation framework that extracts structured relational knowledge from LLMs into lightweight models for on-robot inference. Furthermore, we present SymSearch, a scalable symbolic benchmark for evaluating semantic reasoning in interactive object search tasks.
技術方法: 本文提出的方法:We introduce SCOUT: Scene Graph-Based Exploration with Learned Utility for Open-World Interactive Object Search, a novel method that searches directly over 3D scene graphs by assigning utility scores
Key Takeaway: Finally, real-world experiments demonstrate effective transfer to physical environments, enabling open-world interactive object search under realistic sensing and navigation constraints.
核心發現: 核心結果:Finally, real-world experiments demonstrate effective transfer to physical environments, enabling open-world interactive object search under realistic sensing and navigation constraints.
Control Lyapunov Functions for Underactuated Soft Robots
Authors: Huy Pham, Zach J. Patterson | Submitted: 2026-03-05 | arXiv: 2603.05638
Categories: cs.RO
Research Background: Soft and soft-rigid hybrid robots are inherently underactuated and operate under tight actuator limits, making task-space control with stability guarantees challenging. Common nonlinear strategies for soft robots (e.g., those based on PD control) often rely on the assumption of full actuation with no actuator limits.
研究背景: 在機器人學習領域,Soft and soft-rigid hybrid robots are inherently underactuated and operate under tight actuator limits, making task-space control with stability guarantees challenging. Common nonl
Technical Approach: This paper presents a general control framework for task-space regulation and tracking of underactuated soft robots under bounded inputs.
技術方法: 本文提出的方法:This paper presents a general control framework for task-space regulation and tracking of underactuated soft robots under bounded inputs.
Key Takeaway: Results show improved task-space accuracy and consistent Lyapunov convergence under input limits, achieving superior set-point and trajectory-tracking performance.
核心發現: 核心結果:Results show improved task-space accuracy and consistent Lyapunov convergence under input limits, achieving superior set-point and trajectory-tracking performance.
RACAS: Controlling Diverse Robots With a Single Agentic System
Authors: Dylan R. Ashley, Jan Przepióra, Yimeng Chen et al. | Submitted: 2026-03-05 | arXiv: 2603.05621
Categories: cs.RO, cs.AI, cs.CL, cs.LG, cs.MA
Research Background: Many robotic platforms expose an API through which external software can command their actuators and read their sensors. However, transitioning from these low-level interfaces to high-level autonomous behaviour requires a complicated pipeline, whose components demand distinct areas of expertise.
研究背景: 在機器人學習領域,Many robotic platforms expose an API through which external software can command their actuators and read their sensors. However, transitioning from these low-level interfaces to h
Technical Approach: We introduce RACAS (Robot-Agnostic Control via Agentic Systems), a cooperative agentic architecture in which three LLM/VLM-based modules (Monitors, a Controller, and a Memory Curator) communicate exclusively through natural language to provide closed-loop robot control.
技術方法: 本文提出的方法:We introduce RACAS (Robot-Agnostic Control via Agentic Systems), a cooperative agentic architecture in which three LLM/VLM-based modules (Monitors, a Controller, and a Memory Curator) communicate excl
Key Takeaway: We evaluate RACAS on several tasks using a wheeled ground robot, a recently published novel multi-jointed robotic limb, and an underwater vehicle.
核心發現: 核心結果:We evaluate RACAS on several tasks using a wheeled ground robot, a recently published novel multi-jointed robotic limb, and an underwater vehicle.
Residual RL—MPC for Robust Microrobotic Cell Pushing Under Time-Varying Flow
Authors: Yanda Yang, Sambeeta Das | Submitted: 2026-03-05 | arXiv: 2603.05448
Categories: cs.RO, cs.AI
Research Background: Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large lateral drift. We study planar cell pushing with a magnetic rolling microrobot that tracks a waypoint-sampled reference curve under time-varying Poiseuille flow.
研究背景: 在機器人學習領域,Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large lateral drift. We study planar cell pushing
Technical Approach: We propose a hybrid controller that augments a nominal MPC with a learned residual policy trained by SAC.
技術方法: 本文提出的方法:We propose a hybrid controller that augments a nominal MPC with a learned residual policy trained by SAC.
Key Takeaway: Experiments show improved robustness and tracking accuracy over pure MPC and PID under nonstationary flow, with generalization from a clover training curve to unseen circle and square trajectories.
核心發現: 核心結果:Experiments show improved robustness and tracking accuracy over pure MPC and PID under nonstationary flow, with generalization from a clover training curve to unseen circle and square trajectories.
CT-Enabled Patient-Specific Simulation and Contact-Aware Robotic Planning for Cochlear Implantation
Authors: Lingxiao Xun, Gang Zheng, Alexandre Kruszewski et al. | Submitted: 2026-03-05 | arXiv: 2603.05333
Categories: cs.RO
Research Background: Robotic cochlear-implant (CI) insertion requires precise prediction and regulation of contact forces to minimize intracochlear trauma and prevent failure modes such as locking and buckling. Aligned with the integration of advanced medical imaging and robotics for autonomous, precision interventions, this paper presents a unified CT-to-simulation pipeline for contact-aware insertion planning and validation.
研究背景: 在機器人學習領域,Robotic cochlear-implant (CI) insertion requires precise prediction and regulation of contact forces to minimize intracochlear trauma and prevent failure modes such as locking and
Technical Approach: Aligned with the integration of advanced medical imaging and robotics for autonomous, precision interventions, this paper presents a unified CT-to-simulation pipeline for contact-aware insertion planning and validation. We develop a low-dimensional, differentiable Cosserat-rod model of the electrode array coupled with frictional contact and pseudo-dynamics regularization to ensure continuous stick-slip transitions.
技術方法: 本文提出的方法:Aligned with the integration of advanced medical imaging and robotics for autonomous, precision interventions, this paper presents a unified CT-to-simulation pipeline for contact-aware insertion plann
Key Takeaway: Simulations and benchtop experiments validate deformation and force trends, demonstrating reduced locking/buckling risk and improved insertion depth.
核心發現: 核心結果:Simulations and benchtop experiments validate deformation and force trends, demonstrating reduced locking/buckling risk and improved insertion depth.
Constraint-Free Static Modeling of Continuum Parallel Robot
Authors: Lingxiao Xun, Matyas Diezinger, Azad Artinian et al. | Submitted: 2026-03-05 | arXiv: 2603.05309
Categories: cs.RO
Research Background: Continuum parallel robots (CPR) combine rigid actuation mechanisms with multiple elastic rods in a closed-loop topology, making forward statics challenging when rigid—continuum junctions are enforced by explicit kinematic constraints. Such constraint-based formulations typically introduce additional algebraic variables and complicate both numerical solution and downstream control.
研究背景: 在機器人學習領域,Continuum parallel robots (CPR) combine rigid actuation mechanisms with multiple elastic rods in a closed-loop topology, making forward statics challenging when rigid—continuum ju
Technical Approach: This paper presents a geometric exact, configuration-based and constraint-free static model of CPR that remains valid under geometrically nonlinear, large-deformation and large-rotation conditions.
技術方法: 本文提出的方法:This paper presents a geometric exact, configuration-based and constraint-free static model of CPR that remains valid under geometrically nonlinear, large-deformation and large-rotation conditions.
Key Takeaway: Experiments on a three-servomotor, six-rod prototype validate the model by showing good agreement between simulation and measurements for both unloaded motions and externally loaded cases.
核心發現: 核心結果:Experiments on a three-servomotor, six-rod prototype validate the model by showing good agreement between simulation and measurements for both unloaded motions and externally loaded cases.
Iterative On-Policy Refinement of Hierarchical Diffusion Policies for Language-Conditioned Manipulation
Authors: Clemence Grislain, Olivier Sigaud, Mohamed Chetouani | Submitted: 2026-03-05 | arXiv: 2603.05291
Categories: cs.RO
Research Background: Hierarchical policies for language-conditioned manipulation decompose tasks into subgoals, where a high-level planner guides a low-level controller. However, these hierarchical agents often fail because the planner generates subgoals without considering the actual limitations of the controller.
研究背景: 在機器人學習領域,Hierarchical policies for language-conditioned manipulation decompose tasks into subgoals, where a high-level planner guides a low-level controller. However, these hierarchical age
Technical Approach: We propose HD-ExpIt, a framework for iterative fine-tuning of hierarchical diffusion policies via environment feedback.
技術方法: 本文提出的方法:We propose HD-ExpIt, a framework for iterative fine-tuning of hierarchical diffusion policies via environment feedback.
Key Takeaway: Empirically, HD-ExpIt significantly improves hierarchical policies trained solely on offline data, achieving state-of-the-art performance on the long-horizon CALVIN benchmark among methods trained from scratch.
核心發現: 核心結果:Empirically, HD-ExpIt significantly improves hierarchical policies trained solely on offline data, achieving state-of-the-art performance on the long-horizon CALVIN benchmark among methods trained fro
Curve-Induced Dynamical Systems on Riemannian Manifolds and Lie Groups
Authors: Saray Bakker, Martin Schonger, Tobias Löw et al. | Submitted: 2026-03-05 | arXiv: 2603.05268
Categories: cs.RO, eess.SY
Research Background: Deploying robots in household environments requires safe, adaptable, and interpretable behaviors that respect the geometric structure of tasks. Often represented on Lie groups and Riemannian manifolds, this includes poses on SE(3) or symmetric positive definite matrices encoding stiffness or damping matrices.
研究背景: 在機器人學習領域,Deploying robots in household environments requires safe, adaptable, and interpretable behaviors that respect the geometric structure of tasks. Often represented on Lie groups and
Technical Approach: We introduce Curve-induced Dynamical systems on Smooth Manifolds (CDSM), a real-time framework for constructing dynamical systems directly on Riemannian manifolds and Lie groups.
技術方法: 本文提出的方法:We introduce Curve-induced Dynamical systems on Smooth Manifolds (CDSM), a real-time framework for constructing dynamical systems directly on Riemannian manifolds and Lie groups.
Key Takeaway: Finally, we demonstrate the practical applicability of the framework on both a robotic manipulator, where poses on SE(3) and damping matrices on SPD(n) are adapted online, and a mobile manipulator.
核心發現: 核心結果:Finally, we demonstrate the practical applicability of the framework on both a robotic manipulator, where poses on SE(3) and damping matrices on SPD(n) are adapted online, and a mobile manipulator.
VinePT-Map: Pole-Trunk Semantic Mapping for Resilient Autonomous Robotics in Vineyards
Authors: Giorgio Audrito, Mauro Martini, Alessandro Navone et al. | Submitted: 2026-03-05 | arXiv: 2603.05070
Categories: cs.RO
Research Background: Reliable long-term deployment of autonomous robots in agricultural environments remains challenging due to perceptual aliasing, seasonal variability, and the dynamic nature of crop canopies. Vineyards, characterized by repetitive row structures and significant visual changes across phenological stages, represent a pivotal field challenge, limiting the robustness of conventional feature-based localization and mapping approaches.
研究背景: 在機器人學習領域,Reliable long-term deployment of autonomous robots in agricultural environments remains challenging due to perceptual aliasing, seasonal variability, and the dynamic nature of crop
Technical Approach: This paper introduces VinePT-Map, a semantic mapping framework that leverages vine trunks and support poles as persistent structural landmarks to enable season-agnostic and resilient robot localization. To validate the pipeline, we present a multi-season dataset for trunk and pole segmentation and tracking.
技術方法: 本文提出的方法:This paper introduces VinePT-Map, a semantic mapping framework that leverages vine trunks and support poles as persistent structural landmarks to enable season-agnostic and resilient robot localizatio
Key Takeaway: Extensive field experiments conducted across diverse seasons demonstrate the robustness and accuracy of the proposed approach, highlighting its suitability for long-term autonomous operation in agricultural environments.
核心發現: 核心結果:Extensive field experiments conducted across diverse seasons demonstrate the robustness and accuracy of the proposed approach, highlighting its suitability for long-term autonomous operation in agricu
U-OBCA: Uncertainty-Aware Optimization-Based Collision Avoidance via Wasserstein Distributionally Robust Chance Constraints
Authors: Zehao Wang, Yuxuan Tang, Han Zhang et al. | Submitted: 2026-03-05 | arXiv: 2603.04914
Categories: cs.RO, eess.SY, math.OC
Research Background: Uncertainties arising from localization error, trajectory prediction errors of the moving obstacles and environmental disturbances pose significant challenges to robot’s safe navigation. Existing uncertainty-aware planners often approximate polygon-shaped robots and obstacles using simple geometric primitives such as circles or ellipses.
研究背景: 在機器人學習領域,Uncertainties arising from localization error, trajectory prediction errors of the moving obstacles and environmental disturbances pose significant challenges to robot’s safe navig
Technical Approach: Existing uncertainty-aware planners often approximate polygon-shaped robots and obstacles using simple geometric primitives such as circles or ellipses. Though computationally convenient, these approximations substantially shrink the feasible space, leading to overly conservative trajectories and even planning failure in narrow environments. In addition, many such methods rely on specific assumptions about noise distributions, which may not hold in practice and thus limit their performance guarantees.
技術方法: 本文提出的方法:Existing uncertainty-aware planners often approximate polygon-shaped robots and obstacles using simple geometric primitives such as circles or ellipses. Though computationally convenient, these approx
Key Takeaway: The results demonstrate that U-OBCA significantly mitigates the conservatism in trajectory planning and achieves higher navigation efficiency compared to existing baseline methods, particularly in narrow and cluttered environments.
核心發現: 核心結果:The results demonstrate that U-OBCA significantly mitigates the conservatism in trajectory planning and achieves higher navigation efficiency compared to existing baseline methods, particularly in nar
Adaptive Policy Switching of Two-Wheeled Differential Robots for Traversing over Diverse Terrains
Authors: Haruki Izawa, Takeshi Takai, Shingo Kitano et al. | Submitted: 2026-03-05 | arXiv: 2603.04761
Categories: cs.RO, eess.SY
Research Background: Exploring lunar lava tubes requires robots to traverse without human intervention. Because pre-trained policies cannot fully cover all possible terrain conditions, our goal is to enable adaptive policy switching, where the robot selects an appropriate terrain-specialized model based on its current terrain features.
研究背景: 在機器人學習領域,Exploring lunar lava tubes requires robots to traverse without human intervention. Because pre-trained policies cannot fully cover all possible terrain conditions, our goal is to e
Technical Approach: Because pre-trained policies cannot fully cover all possible terrain conditions, our goal is to enable adaptive policy switching, where the robot selects an appropriate terrain-specialized model based on its current terrain features. This study investigates whether terrain types can be estimated effectively using posture-related observations collected during navigation. We fine-tuned a pre-trained policy using Proximal Policy Optimization (PPO), and then collected the robot’s 3D orientation data as it moved across flat and rough terrain in a simulated lava-tube environment.
技術方法: 本文提出的方法:Because pre-trained policies cannot fully cover all possible terrain conditions, our goal is to enable adaptive policy switching, where the robot selects an appropriate terrain-specialized model based
Key Takeaway: An accuracy of more than 98% was achieved when using a 70-step window.
核心發現: 核心結果:An accuracy of more than 98% was achieved when using a 70-step window.
Designing and Validating a Self-Aligning Tool Changer for Modular Reconfigurable Manipulation Robots
Authors: Mahfudz Maskur, Takuya Kiyokawa, Kensuke Harada | Submitted: 2026-03-05 | arXiv: 2603.04760
Categories: cs.RO
Research Background: Modular reconfigurable robots require reliable mechanisms for automated module exchange, but conventional rigid active couplings often fail due to inevitable positioning and orientational errors. To address this, we propose a misalignment-tolerant tool-changing system.
研究背景: 在機器人學習領域,Modular reconfigurable robots require reliable mechanisms for automated module exchange, but conventional rigid active couplings often fail due to inevitable positioning and orient
Technical Approach: To address this, we propose a misalignment-tolerant tool-changing system.
技術方法: 本文提出的方法:To address this, we propose a misalignment-tolerant tool-changing system.
Key Takeaway: Real-world autonomous tool-picking experiments validate that the self-aligning features successfully absorb execution errors, enabling highly reliable robotic tool reconfiguration.
核心發現: 核心結果:Real-world autonomous tool-picking experiments validate that the self-aligning features successfully absorb execution errors, enabling highly reliable robotic tool reconfiguration.
Gait Generation Balancing Joint Load and Mobility for Legged Modular Robots with Easily Detachable Joints
Authors: Kennosuke Chihara, Takuya Kiyokawa, Kensuke Harada | Submitted: 2026-03-05 | arXiv: 2603.04757
Categories: cs.RO
Research Background: While modular robots offer versatility, excessive joint torque during locomotion poses a significant risk of mechanical failure, especially for detachable joints. To address this, we propose an optimization framework using the NSGA-III algorithm.
研究背景: 在機器人學習領域,While modular robots offer versatility, excessive joint torque during locomotion poses a significant risk of mechanical failure, especially for detachable joints. To address this,
Technical Approach: To address this, we propose an optimization framework using the NSGA-III algorithm. Unlike conventional approaches that prioritize mobility alone, our method derives Pareto optimal solutions to minimize joint load while maintaining necessary locomotion speed and stability. Simulations and physical experiments demonstrate that our approach successfully generates gait motions for diverse environments, such as slopes and steps, ensuring structural integrity without compromising overall mobility.
技術方法: 本文提出的方法:To address this, we propose an optimization framework using the NSGA-III algorithm. Unlike conventional approaches that prioritize mobility alone, our method derives Pareto optimal solutions to minimi
Key Takeaway: Simulations and physical experiments demonstrate that our approach successfully generates gait motions for diverse environments, such as slopes and steps, ensuring structural integrity without compromising overall mobility.
核心發現: 核心結果:Simulations and physical experiments demonstrate that our approach successfully generates gait motions for diverse environments, such as slopes and steps, ensuring structural integrity without comprom
Design, Mapping, and Contact Anticipation with 3D-printed Whole-Body Tactile and Proximity Sensors
Authors: Carson Kohlbrenner, Anna Soukhovei, Caleb Escobedo et al. | Submitted: 2026-03-05 | arXiv: 2603.04714
Categories: cs.RO
Research Background: Robots operating in dynamic and shared environments benefit from anticipating contact before it occurs. We present GenTact-Prox, a fully 3D-printed artificial skin that integrates tactile and proximity sensing for contact detection and anticipation.
研究背景: 在機器人學習領域,Robots operating in dynamic and shared environments benefit from anticipating contact before it occurs. We present GenTact-Prox, a fully 3D-printed artificial skin that integrates
Technical Approach: We present GenTact-Prox, a fully 3D-printed artificial skin that integrates tactile and proximity sensing for contact detection and anticipation. To characterize how robots perceive nearby space through this skin, we introduce a data-driven framework for mapping the Perisensory Space — the body-centric volume of space around the robot where sensors provide actionable information for contact anticipation.
技術方法: 本文提出的方法:We present GenTact-Prox, a fully 3D-printed artificial skin that integrates tactile and proximity sensing for contact detection and anticipation. To characterize how robots perceive nearby space throu
Key Takeaway: We demonstrate this approach on a Franka Research 3 robot equipped with five GenTact-Prox units, enabling online object-aware operation and contact prediction.
核心發現: 核心結果:We demonstrate this approach on a Franka Research 3 robot equipped with five GenTact-Prox units, enabling online object-aware operation and contact prediction.
Failure Mechanisms and Risk Estimation for Legged Robot Locomotion on Granular Slopes
Authors: Xingjue Liao, Feifei Qian | Submitted: 2026-03-06 | arXiv: 2603.06928
Categories: cs.RO
Research Background: Locomotion on granular slopes such as sand dunes remains a fundamental challenge for legged robots due to reduced shear strength and gravity-induced anisotropic yielding of granular media. Using a hexapedal robot on a tiltable granular bed, we systematically measure locomotion speed together with slope-dependent normal and shear granular resistive forces.
研究背景: 在機器人學習領域,Locomotion on granular slopes such as sand dunes remains a fundamental challenge for legged robots due to reduced shear strength and gravity-induced anisotropic yielding of granula
Technical Approach: Guided by these measurements, we develop a simple robot-terrain interaction model that predicts anchoring timing, step length, and resulting robot speed, as functions of terrain strength and slope angle.
技術方法: 本文提出的方法:Guided by these measurements, we develop a simple robot-terrain interaction model that predicts anchoring timing, step length, and resulting robot speed, as functions of terrain strength and slope ang
Key Takeaway: This physics-informed framework provides predictive insight into terrain-dependent failure mechanisms and offers guidance for safer and more robust robot operation on deformable inclines.
核心發現: 核心結果:This physics-informed framework provides predictive insight into terrain-dependent failure mechanisms and offers guidance for safer and more robust robot operation on deformable inclines.
A Contrastive Fewshot RGBD Traversability Segmentation Framework for Indoor Robotic Navigation
Authors: Qiyuan An, Tuan Dang, Fillia Makedon | Submitted: 2026-03-06 | arXiv: 2603.06927
Categories: cs.RO
Research Background: Indoor traversability segmentation aims to identify safe, navigable free space for autonomous agents, which is critical for robotic navigation. Pure vision-based models often fail to detect thin obstacles, such as chair legs, which can pose serious safety risks.
研究背景: 在機器人學習領域,Indoor traversability segmentation aims to identify safe, navigable free space for autonomous agents, which is critical for robotic navigation. Pure vision-based models often fail
Technical Approach: We propose a multi-modal segmentation framework that leverages RGB images and sparse 1D laser depth information to capture geometric interactions and improve the detection of challenging obstacles. To address this, we introduce a negative contrastive learning (NCL) branch that leverages negative prototypes (obstacles) to refine free-space predictions. Additionally, we design a two-stage attention depth module to align 1D depth vectors with RGB images both horizontally and vertically.
技術方法: 本文提出的方法:We propose a multi-modal segmentation framework that leverages RGB images and sparse 1D laser depth information to capture geometric interactions and improve the detection of challenging obstacles. To
Key Takeaway: These results highlight the effectiveness of leveraging negative prototypes and sparse depth for robust and efficient traversability segmentation.
核心發現: 核心結果:These results highlight the effectiveness of leveraging negative prototypes and sparse depth for robust and efficient traversability segmentation.
Material Driven HRI Design: Aesthetics as Explainability
Authors: Natalie Friedman, Kevin Weatherwax, Chengchao Zhu | Submitted: 2026-03-06 | arXiv: 2603.06879
Categories: cs.RO
Research Background: Aesthetics - often treated as secondary to function-guides how people interpret robots’ roles. A great deal of robot designs - both real and fictitious - use sleek industrial aesthetics.
研究背景: 在機器人學習領域,Aesthetics - often treated as secondary to function-guides how people interpret robots’ roles. A great deal of robot designs - both real and fictitious - use sleek industrial aesth
Technical Approach: Rather than viewing appearance as decoration, we propose that color, texture, and material choices function as interaction signals.
技術方法: 本文提出的方法:Rather than viewing appearance as decoration, we propose that color, texture, and material choices function as interaction signals.
Key Takeaway: We use this framework to do a content analysis of 6 robots.
核心發現: 核心結果:We use this framework to do a content analysis of 6 robots.
CAR: Cross-Vehicle Kinodynamics Adaptation via Mobility Representation
Authors: Tong Xu, Chenhui Pan, Xuesu Xiao | Submitted: 2026-03-06 | arXiv: 2603.06866
Categories: cs.RO
Research Background: Developing autonomous off-road mobility typically requires either extensive, platform-specific data collection or relies on simplified abstractions, such as unicycle or bicycle models, that fail to capture the complex kinodynamics of diverse platforms, ranging from wheeled to tracked vehicles. This limitation hinders scalability across evolving heterogeneous autonomous robot fleets.
研究背景: 在機器人學習領域,Developing autonomous off-road mobility typically requires either extensive, platform-specific data collection or relies on simplified abstractions, such as unicycle or bicycle mod
Technical Approach: To address this challenge, we propose Cross-vehicle kinodynamics Adaptation via mobility Representation (CAR), a novel framework that enables rapid mobility transfer to new vehicles. By identifying and extracting commonality from nearest neighbors within this latent space, our approach enables rapid kinodynamics adaptation to novel platforms with minimal data collection and computational overhead.
技術方法: 本文提出的方法:To address this challenge, we propose Cross-vehicle kinodynamics Adaptation via mobility Representation (CAR), a novel framework that enables rapid mobility transfer to new vehicles. By identifying an
Key Takeaway: With only one minute of new trajectory data, CAR achieves up to 67.2% reduction in prediction error compared to direct neighbor transfer across diverse unseen vehicle configurations, demonstrating the effectiveness of cross-vehicle mobility knowledge transfer in both simulated and real-world environments.
核心發現: 核心結果:With only one minute of new trajectory data, CAR achieves up to 67.2% reduction in prediction error compared to direct neighbor transfer across diverse unseen vehicle configurations, demonstrating the
Robodimm: A Physics-Grounded Framework for Automated Actuator Sizing in Scalable Modular Robots
Authors: J. L. Torres, M. Munoz, J. D. Alvarez et al. | Submitted: 2026-03-06 | arXiv: 2603.06864
Categories: cs.RO
Research Background: Selecting an appropriate motor-gearbox combination is a critical design task in robotics because it directly affects cost, mass, and dynamic performance. This process is especially challenging in modular robots with closed kinematic chains, where joint torques are coupled and actuator inertia propagates through the mechanism.
研究背景: 在機器人學習領域,Selecting an appropriate motor-gearbox combination is a critical design task in robotics because it directly affects cost, mass, and dynamic performance. This process is especially
Technical Approach: We present Robodimm, a software framework for automated actuator sizing in scalable robot architectures.
技術方法: 本文提出的方法:We present Robodimm, a software framework for automated actuator sizing in scalable robot architectures.
Key Takeaway: The platform supports parametric scaling, interactive trajectory programming through jog modes, and a two-round validation workflow that addresses actuator self-weight effects.
核心發現: 核心結果:The platform supports parametric scaling, interactive trajectory programming through jog modes, and a two-round validation workflow that addresses actuator self-weight effects.
RoboCritics: Enabling Reliable End-to-End LLM Robot Programming through Expert-Informed Critics
Authors: Callie Y. Kim, Nathan Thomas White, Evan He et al. | Submitted: 2026-03-06 | arXiv: 2603.06842
Categories: cs.RO
Research Background: End-user robot programming grants users the flexibility to re-task robots in situ, yet it remains challenging for novices due to the need for specialized robotics knowledge. Large Language Models (LLMs) hold the potential to lower the barrier to robot programming by enabling task specification through natural language.
研究背景: 在機器人學習領域,End-user robot programming grants users the flexibility to re-task robots in situ, yet it remains challenging for novices due to the need for specialized robotics knowledge. Large
Technical Approach: We present RoboCritics, an approach that augments LLM-based robot programming with expert-informed motion-level critics.
技術方法: 本文提出的方法:We present RoboCritics, an approach that augments LLM-based robot programming with expert-informed motion-level critics.
Key Takeaway: Our findings demonstrate that RoboCritics enables more reliable and user-centered end-to-end robot programming with LLMs.
核心發現: 核心結果:Our findings demonstrate that RoboCritics enables more reliable and user-centered end-to-end robot programming with LLMs.
A Comprehensive Analysis of the Effects of Network Quality of Service on Robotic Telesurgery
Authors: Zhaomeng Zhang, Seyed Hamid Reza Roodabeh, Homa Alemzadeh | Submitted: 2026-03-06 | arXiv: 2603.06824
Categories: cs.RO
Research Background: The viability of long-distance telesurgery hinges on reliable network Quality of Service (QoS), yet the impact of realistic network degradations on task performance is not sufficiently understood. This paper presents a comprehensive analysis of how packet loss, delay, and communication loss affect telesurgical task execution.
研究背景: 在機器人學習領域,The viability of long-distance telesurgery hinges on reliable network Quality of Service (QoS), yet the impact of realistic network degradations on task performance is not sufficie
Technical Approach: This paper presents a comprehensive analysis of how packet loss, delay, and communication loss affect telesurgical task execution. We introduce NetFI, a novel fault injection tool that emulates different network conditions using stochastic QoS models informed by real-world network data.
技術方法: 本文提出的方法:This paper presents a comprehensive analysis of how packet loss, delay, and communication loss affect telesurgical task execution. We introduce NetFI, a novel fault injection tool that emulates differ
Key Takeaway: Our open-source tools and annotated dataset provide a foundation for developing robust and network-aware control and mitigation strategies.
核心發現: 核心結果:Our open-source tools and annotated dataset provide a foundation for developing robust and network-aware control and mitigation strategies.
Uncertainty-Aware Adaptive Dynamics For Underwater Vehicle-Manipulator Robots
Authors: Edward Morgan, Nenyi K Dadson, Corina Barbalata | Submitted: 2026-03-06 | arXiv: 2603.06548
Categories: cs.RO, eess.SY
Research Background: Accurate and adaptive dynamic models are critical for underwater vehicle-manipulator systems where hydrodynamic effects induce time-varying parameters. This paper introduces a novel uncertainty-aware adaptive dynamics model framework that remains linear in lumped vehicle and manipulator parameters, and embeds convex physical consistency constraints during online estimation.
研究背景: 在機器人學習領域,Accurate and adaptive dynamic models are critical for underwater vehicle-manipulator systems where hydrodynamic effects induce time-varying parameters. This paper introduces a nove
Technical Approach: This paper introduces a novel uncertainty-aware adaptive dynamics model framework that remains linear in lumped vehicle and manipulator parameters, and embeds convex physical consistency constraints during online estimation.
技術方法: 本文提出的方法:This paper introduces a novel uncertainty-aware adaptive dynamics model framework that remains linear in lumped vehicle and manipulator parameters, and embeds convex physical consistency constraints d
Key Takeaway: Results indicate physically plausible parameters and confidence intervals with near 100% coverage, enabling reliable feedforward control and simulation in underwater environments.
核心發現: 核心結果:Results indicate physically plausible parameters and confidence intervals with near 100% coverage, enabling reliable feedforward control and simulation in underwater environments.
Underactuated multimodal jumping robot for extraterrestrial exploration
Authors: Neil R. Wagner, Justin K. Yim | Submitted: 2026-03-06 | arXiv: 2603.06525
Categories: cs.RO
Research Background: We present a rolling and jumping underactuated monopedal robot designed to explore multimodal locomotion on low-gravity bodies. It uses only two reaction wheels to control its spatial orientation with two controllers: a balancing controller which can aim the robot’s jump direction on the ground, and an aerial reorientation controller which can aim the robot’s leg for landing after flight.
研究背景: 在機器人學習領域,We present a rolling and jumping underactuated monopedal robot designed to explore multimodal locomotion on low-gravity bodies. It uses only two reaction wheels to control its spat
Technical Approach: We present a rolling and jumping underactuated monopedal robot designed to explore multimodal locomotion on low-gravity bodies.
技術方法: 本文提出的方法:We present a rolling and jumping underactuated monopedal robot designed to explore multimodal locomotion on low-gravity bodies.
Key Takeaway: We demonstrate rolling, targeted jumping and landing, and self-righting using only three actuators total, keeping system size to 0.33m and 1.25kg.
核心發現: 核心結果:We demonstrate rolling, targeted jumping and landing, and self-righting using only three actuators total, keeping system size to 0.33m and 1.25kg.
A Unified Low-Dimensional Design Embedding for Joint Optimization of Shape, Material, and Actuation in Soft Robots
Authors: Vittorio Candiello, Manuel Mekkattu, Mike Y. Michelis et al. | Submitted: 2026-03-06 | arXiv: 2603.06497
Categories: cs.RO
Research Background: Soft robots achieve functionality through tight coupling among geometry, material composition, and actuation. As a result, effective design optimization requires these three aspects to be considered jointly rather than in isolation.
研究背景: 在機器人學習領域,Soft robots achieve functionality through tight coupling among geometry, material composition, and actuation. As a result, effective design optimization requires these three aspect
Technical Approach: We introduce a smooth, low-dimensional design embedding for soft robots that unifies shape morphing, multi-material distribution, and actuation within a single structured parameter space.
技術方法: 本文提出的方法:We introduce a smooth, low-dimensional design embedding for soft robots that unifies shape morphing, multi-material distribution, and actuation within a single structured parameter space.
Key Takeaway: Together, these findings demonstrate that structuring the design space itself enables efficient co-design of soft robots.
核心發現: 核心結果:Together, these findings demonstrate that structuring the design space itself enables efficient co-design of soft robots.
Safe Consensus of Cooperative Manipulation with Hierarchical Event-Triggered Control Barrier Functions
Authors: Simiao Zhuang, Bingkun Huang, Zewen Yang | Submitted: 2026-03-06 | arXiv: 2603.06356
Categories: cs.RO
Research Background: Cooperative transport and manipulation of heavy or bulky payloads by multiple manipulators requires coordinated formation tracking, while simultaneously enforcing strict safety constraints in varying environments with limited communication and real-time computation budgets. This paper presents a distributed control framework that achieves consensus coordination with safety guarantees via hierarchical event-triggered control barrier functions (CBFs).
研究背景: 在機器人學習領域,Cooperative transport and manipulation of heavy or bulky payloads by multiple manipulators requires coordinated formation tracking, while simultaneously enforcing strict safety con
Technical Approach: This paper presents a distributed control framework that achieves consensus coordination with safety guarantees via hierarchical event-triggered control barrier functions (CBFs). Building on this coordination layer, we propose a three-level hierarchical event-triggered safety architecture with CBFs, which is integrated with a risk-aware leader selection and smooth switching strategy to reduce online computation.
技術方法: 本文提出的方法:This paper presents a distributed control framework that achieves consensus coordination with safety guarantees via hierarchical event-triggered control barrier functions (CBFs). Building on this coor
Key Takeaway: Results demonstrate higher precision cooperation under strict safety constraints, achieving substantially reduced computational cost and communication frequency compared to baseline methods.
核心發現: 核心結果:Results demonstrate higher precision cooperation under strict safety constraints, achieving substantially reduced computational cost and communication frequency compared to baseline methods.
Open-Source Based and ETSI Compliant Cooperative, Connected, and Automated Mini-Cars
Authors: Lorenzo Farina, Federico Gavioli, Salvatore Iandolo et al. | Submitted: 2026-03-06 | arXiv: 2603.06343
Categories: cs.RO, cs.NI
Research Background: The automotive sector is following a revolutionary path from vehicles controlled by humans to vehicles that will be fully automated, fully connected, and ultimately fully cooperative. Along this road, new cooperative algorithms and protocols will be designed and field tested, which represents a great challenge in terms of costs.
研究背景: 在機器人學習領域,The automotive sector is following a revolutionary path from vehicles controlled by humans to vehicles that will be fully automated, fully connected, and ultimately fully cooperati
Technical Approach: Along this road, new cooperative algorithms and protocols will be designed and field tested, which represents a great challenge in terms of costs. In this context, in particular, moving from simulations to practical experiments requires huge investments that are not always affordable and may become a barrier in some cases. To solve this issue and provide the community with an intermediate step, we here propose the use of 1:10 scaled cooperative, autonomous, and connected mini-cars.
技術方法: 本文提出的方法:Along this road, new cooperative algorithms and protocols will be designed and field tested, which represents a great challenge in terms of costs. In this context, in particular, moving from simulatio
Key Takeaway: The feasibility and potential of the proposed platform is here demonstrated through the implementation of a case study where the Day-1 intersection collision warning (ICW) application is implemented and validated.
核心發現: 核心結果:The feasibility and potential of the proposed platform is here demonstrated through the implementation of a case study where the Day-1 intersection collision warning (ICW) application is implemented a
Robotic Foundation Models for Industrial Control: A Comprehensive Survey and Readiness Assessment Framework
Authors: David Kube, Simon Hadwiger, Tobias Meisen | Submitted: 2026-03-06 | arXiv: 2603.06749
Categories: cs.RO, cs.AI
Research Background: Robotic foundation models (RFMs) are emerging as a promising route towards flexible, instruction- and demonstration-driven robot control, however, a critical investigation of their industrial applicability is still lacking. This survey gives an extensive overview over the RFM-landscape and analyses, driven by concrete implications, how industrial domains and use cases shape the requirements of RFMs, with particular focus on collaborative robot platforms, heterogeneous sensing and actuation, edge-computing constraints, and safety-critical operation.
研究背景: 在機器人學習領域,Robotic foundation models (RFMs) are emerging as a promising route towards flexible, instruction- and demonstration-driven robot control, however, a critical investigation of their
Technical Approach: This survey gives an extensive overview over the RFM-landscape and analyses, driven by concrete implications, how industrial domains and use cases shape the requirements of RFMs, with particular focus on collaborative robot platforms, heterogeneous sensing and actuation, edge-computing constraints, and safety-critical operation. We synthesise industrial deployment perspectives into eleven interdependent implications and operationalise them into an assessment framework comprising a catalogue of 149 concrete criteria, spanning both model capabilities and ecosystem requirements. Using this framework, we evaluate 324 manipulation-capable RFMs via 48,276 criterion-level decisions obtained via a conservative LLM-assisted evaluation pipeline, validated against expert judgements.
技術方法: 本文提出的方法:This survey gives an extensive overview over the RFM-landscape and analyses, driven by concrete implications, how industrial domains and use cases shape the requirements of RFMs, with particular focus
Key Takeaway: The results indicate that industrial maturity is limited and uneven: even the highest-rated models satisfy only a fraction of criteria and typically exhibit narrow implication-specific peaks rather than integrated coverage.
核心發現: 核心結果:The results indicate that industrial maturity is limited and uneven: even the highest-rated models satisfy only a fraction of criteria and typically exhibit narrow implication-specific peaks rather th
A Hazard-Informed Data Pipeline for Robotics Physical Safety
Authors: Alexei Odinokov, Rostislav Yavorskiy | Submitted: 2026-03-06 | arXiv: 2603.06130
Categories: cs.RO, cs.AI
Research Background: This report presents a structured Robotics Physical Safety Framework based on explicit asset declaration, systematic vulnerability enumeration, and hazard-driven synthetic data generation. The approach bridges classical risk engineering with modern machine learning pipelines, enabling safety envelope learning grounded in a formalized hazard ontology.
研究背景: 在機器人學習領域,This report presents a structured Robotics Physical Safety Framework based on explicit asset declaration, systematic vulnerability enumeration, and hazard-driven synthetic data gen
Technical Approach: The approach bridges classical risk engineering with modern machine learning pipelines, enabling safety envelope learning grounded in a formalized hazard ontology.
技術方法: 本文提出的方法:The approach bridges classical risk engineering with modern machine learning pipelines, enabling safety envelope learning grounded in a formalized hazard ontology.
Key Takeaway: The key contribution of this framework is the alignment between classical safety engineering, digital twin simulation, synthetic data generation, and machine learning model training.
核心發現: 核心結果:The key contribution of this framework is the alignment between classical safety engineering, digital twin simulation, synthetic data generation, and machine learning model training.
Sticky-Glance: Robust Intent Recognition for Human Robot Collaboration via Single-Glance
Authors: Yuzhi Lai, Shenghai Yuan, Peizheng Li et al. | Submitted: 2026-03-06 | arXiv: 2603.06121
Categories: cs.RO
Research Background: Gaze is a valuable means of communication for impaired people with extremely limited motor capabilities. However, robust gaze-based intent recognition in multi-object environments is challenging due to gaze noise, micro-saccades, viewpoint changes, and dynamic objects.
研究背景: 在機器人學習領域,Gaze is a valuable means of communication for impaired people with extremely limited motor capabilities. However, robust gaze-based intent recognition in multi-object environments
Technical Approach: To address this, we propose an object-centric gaze grounding framework that stabilizes intent through a sticky-glance algorithm, jointly modeling geometric distance and direction trends.
技術方法: 本文提出的方法:To address this, we propose an object-centric gaze grounding framework that stabilizes intent through a sticky-glance algorithm, jointly modeling geometric distance and direction trends.
Key Takeaway: Experiments across dynamic tracking, multi-perspective alignment, a baseline comparison, user studies, and ablation studies demonstrate improved robustness, efficiency, and reduced workload compared to representative baselines.
核心發現: 核心結果:Experiments across dynamic tracking, multi-perspective alignment, a baseline comparison, user studies, and ablation studies demonstrate improved robustness, efficiency, and reduced workload compared t
Multimodal Behavior Tree Generation: A Small Vision-Language Model for Robot Task Planning
Authors: Cristiano Battistini, Riccardo Andrea Izzo, Gianluca Bardaro et al. | Submitted: 2026-03-06 | arXiv: 2603.06084
Categories: cs.RO
Research Background: Large and small language models have been widely used for robotic task planning. At the same time, vision-language models (VLMs) have successfully tackled problems such as image captioning, scene understanding, and visual question answering.
研究背景: 在機器人學習領域,Large and small language models have been widely used for robotic task planning. At the same time, vision-language models (VLMs) have successfully tackled problems such as image ca
Technical Approach: We propose a method to construct such a dataset starting from existing robotic episodes (i.e., Open X-Embodiment), in which a large model serves as a teacher in a multi-stage generation pipeline.
技術方法: 本文提出的方法:We propose a method to construct such a dataset starting from existing robotic episodes (i.e., Open X-Embodiment), in which a large model serves as a teacher in a multi-stage generation pipeline.
Key Takeaway: Our results demonstrate that our fine-tuned 4B-parameter VLM approaches the performance of state-of-the-art closed-source models, achieving an 87% success rate while requiring only a fraction of the computational resources.
核心發現: 核心結果:Our results demonstrate that our fine-tuned 4B-parameter VLM approaches the performance of state-of-the-art closed-source models, achieving an 87% success rate while requiring only a fraction of the
MagRobot:An Open Simulator for Magnetically Navigated Robots
Authors: Heng Wang, Haoyu Song, Jiatao Zheng et al. | Submitted: 2026-03-06 | arXiv: 2603.05992
Categories: cs.RO
Research Background: Magnetic navigation systems, including magnetic tracking systems and magnetic actuation systems, have shown great potential for occlusion-free localization and remote control of intracorporeal medical devices and robots in minimally invasive medicine, such as capsule endoscopy and cardiovascular intervention. However, the design of magnetically navigated robots remains heavily reliant on experimental prototyping, which is time-consuming and costly.
研究背景: 在機器人學習領域,Magnetic navigation systems, including magnetic tracking systems and magnetic actuation systems, have shown great potential for occlusion-free localization and remote control of in
Technical Approach: To address these challenges, we propose the first universal open-source simulation platform to facilitate research, design and benchmarking of magnetically navigated robots.
技術方法: 本文提出的方法:To address these challenges, we propose the first universal open-source simulation platform to facilitate research, design and benchmarking of magnetically navigated robots.
Key Takeaway: Three use cases of the simulator, i.e., bronchoscopy, endovascular intervention, and gastrointestinal endoscopy, are implemented to demonstrate the functionality of the simulator.
核心發現: 核心結果:Three use cases of the simulator, i.e., bronchoscopy, endovascular intervention, and gastrointestinal endoscopy, are implemented to demonstrate the functionality of the simulator.
Proprioceptive Shape Estimation of Tensegrity Manipulators Using Energy Minimisation
Authors: Tufail Ahmad Bhat, Shuhei Ikemoto | Submitted: 2026-03-06 | arXiv: 2603.05976
Categories: cs.RO
Research Background: Shape estimation is fundamental for controlling continuously bending tensegrity manipulators, yet achieving it remains a challenge. Although using exteroceptive sensors makes the implementation straightforward, it is costly and limited to specific environments.
研究背景: 在機器人學習領域,Shape estimation is fundamental for controlling continuously bending tensegrity manipulators, yet achieving it remains a challenge. Although using exteroceptive sensors makes the i
Technical Approach: This paper demonstrates that shape estimation of the entire tensegrity manipulator can be achieved using only the inclination angle information relative to gravity for each strut.
技術方法: 本文提出的方法:This paper demonstrates that shape estimation of the entire tensegrity manipulator can be achieved using only the inclination angle information relative to gravity for each strut.
Key Takeaway: Experiments conducted on a five-layer tensegrity manipulator with 20 struts and a total length of 1160 mm demonstrate that the proposed method can estimate the shape with an accuracy of 2.1 % of the total manipulator length, from arbitrary initial conditions under both static conditions and maintains stable shape estimation under external disturbances.
核心發現: 核心結果:Experiments conducted on a five-layer tensegrity manipulator with 20 struts and a total length of 1160 mm demonstrate that the proposed method can estimate the shape with an accuracy of 2.1 % of the
Improved hopping control on slopes for small robots using spring mass modeling
Authors: Heston Roberts, Pronoy Sarker, Sm Ashikul Islam et al. | Submitted: 2026-03-06 | arXiv: 2603.05902
Categories: cs.RO, eess.SY
Research Background: Hopping robots often lose balance on slopes because the tilted ground creates unwanted rotation at landing. This work analyzes that effect using a simple spring mass model and identifies how slope induced impulses destabilize the robot.
研究背景: 在機器人學習領域,Hopping robots often lose balance on slopes because the tilted ground creates unwanted rotation at landing. This work analyzes that effect using a simple spring mass model and iden
Technical Approach: To address this, we introduce two straightforward fixes, adjusting the bodys touchdown angle based on the slope and applying a small corrective torque before takeoff.
技術方法: 本文提出的方法:To address this, we introduce two straightforward fixes, adjusting the bodys touchdown angle based on the slope and applying a small corrective torque before takeoff.
Key Takeaway: The results from simulation confirm that even small slope aware adjustments can dramatically improve landing stability, making the technique suitable for future autonomous field robots that must navigate natural environments such as hills, rubble, and irregular outdoor landscapes.
核心發現: 核心結果:The results from simulation confirm that even small slope aware adjustments can dramatically improve landing stability, making the technique suitable for future autonomous field robots that must navig
Terrain characterization and locomotion adaptation in a small-scale lizard-inspired robot
Authors: Duncan Andrews, Landon Zimmerman, Evan Martin et al. | Submitted: 2026-03-06 | arXiv: 2603.05837
Categories: cs.RO
Research Background: Unlike their large-scale counterparts, small-scale robots are largely confined to laboratory environments and are rarely deployed in real-world settings. As robot size decreases, robot-terrain interactions fundamentally change; however, there remains a lack of systematic understanding of what sensory information small-scale robots should acquire and how they should respond when traversing complex natural terrains.
研究背景: 在機器人學習領域,Unlike their large-scale counterparts, small-scale robots are largely confined to laboratory environments and are rarely deployed in real-world settings. As robot size decreases, r
Technical Approach: To address these challenges, we develop a Small-scale, Intelligent, Lizard-inspired, Adaptive Robot (SILA Bot) capable of adapting to diverse substrates. Leveraging these relationships, we design a simple linear feedback controller that modulates body phase and substantially improves locomotion performance on terrains with unknown depth.
技術方法: 本文提出的方法:To address these challenges, we develop a Small-scale, Intelligent, Lizard-inspired, Adaptive Robot (SILA Bot) capable of adapting to diverse substrates. Leveraging these relationships, we design a si
Key Takeaway: Together, these results establish a principled framework for perception and control in small-scale locomotion and enable effective terrain-adaptive locomotion while maintaining low computational complexity.
核心發現: 核心結果:Together, these results establish a principled framework for perception and control in small-scale locomotion and enable effective terrain-adaptive locomotion while maintaining low computational compl
Exploring Socially Assistive Peer Mediation Robots for Teaching Conflict Resolution to Elementary School Students
Authors: Kaleen Shrestha, Harish Dukkipati, Avni Hulyalkar et al. | Submitted: 2026-03-06 | arXiv: 2603.06255
Categories: cs.HC
Research Background: In peer mediation—an approach to conflict resolution used in many K-12 schools in the United States—students help other students to resolve conflicts. For schools without peer mediation programs, socially assistive robots (SARs) may be able to provide an accessible option to practice peer mediation.
研究背景: 在機器人學習領域,In peer mediation—an approach to conflict resolution used in many K-12 schools in the United States—students help other students to resolve conflicts. For schools without peer me
Technical Approach: For schools without peer mediation programs, socially assistive robots (SARs) may be able to provide an accessible option to practice peer mediation. We investigate how elementary school students react to a peer mediator role-play activity through an exploratory study with SARs. We conducted a small single-session between-subjects study with 12 participants.
技術方法: 本文提出的方法:For schools without peer mediation programs, socially assistive robots (SARs) may be able to provide an accessible option to practice peer mediation. We investigate how elementary school students reac
Key Takeaway: Although we did not find statistical differences in pre-/post-session self-perception and quiz performance between the robot and tablet conditions, we found strong correlations (p<0.05) between certain trait-related measures and learning-related measures in the robot condition, which can inform future study design for SARs for this and related contexts.
核心發現: 核心結果:Although we did not find statistical differences in pre-/post-session self-perception and quiz performance between the robot and tablet conditions, we found strong correlations (p<0.05) between certai
REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation
Authors: Maëlic Neau, Zoe Falomir | Submitted: 2026-03-06 | arXiv: 2603.06386
Categories: cs.CV
Research Background: Scene Graph Generation (SGG) is a task that encodes visual relationships between objects in images as graph structures. SGG shows significant promise as a foundational component for downstream tasks, such as reasoning for embodied agents.
研究背景: 在機器人學習領域,Scene Graph Generation (SGG) is a task that encodes visual relationships between objects in images as graph structures. SGG shows significant promise as a foundational component fo
Technical Approach: To address this limitation, we build on the powerful Real-time Efficiency and Accuracy Compromise for Tradeoffs in Scene Graph Generation (REACT) architecture and propose REACT++, a new state-of-the-art model for real-time SGG.
技術方法: 本文提出的方法:To address this limitation, we build on the powerful Real-time Efficiency and Accuracy Compromise for Tradeoffs in Scene Graph Generation (REACT) architecture and propose REACT++, a new state-of-the-a
Key Takeaway: REACT++ achieves the highest inference speed among existing SGG models, improving relation prediction accuracy without sacrificing object detection performance.
核心發現: 核心結果:REACT++ achieves the highest inference speed among existing SGG models, improving relation prediction accuracy without sacrificing object detection performance.
SwiftBot: A Decentralized Platform for LLM-Powered Federated Robotic Task Execution
Authors: YueMing Zhang, Shuai Xu, Zhengxiong Li et al. | Submitted: 2026-03-07 | arXiv: 2603.20233
Categories: cs.RO
Research Background: Federated robotic task execution systems require bridging natural language instructions to distributed robot control while efficiently managing computational resources across heterogeneous edge devices without centralized coordination. Existing approaches face three limitations: rigid hand-coded planners requiring extensive domain engineering, centralized coordination that contradicts federated collaboration as robots scale, and static resource allocation failing to share containers across robots when workloads shift dynamically.
研究背景: 在機器人學習領域,Federated robotic task execution systems require bridging natural language instructions to distributed robot control while efficiently managing computational resources across heter
Technical Approach: We present SwiftBot, a federated task execution platform that integrates LLM-based task decomposition with intelligent container orchestration over a DHT overlay, enabling robots to collaboratively execute tasks without centralized control.
技術方法: 本文提出的方法:We present SwiftBot, a federated task execution platform that integrates LLM-based task decomposition with intelligent container orchestration over a DHT overlay, enabling robots to collaboratively ex
Key Takeaway: Evaluation on multimedia tasks validates that co-designing semantic understanding and federated resource management enables both flexibility and efficiency for robotic task control.
核心發現: 核心結果:Evaluation on multimedia tasks validates that co-designing semantic understanding and federated resource management enables both flexibility and efficiency for robotic task control.
Soft Rigid Hybrid Gripper with Inflatable Silicone Pockets for Tunable Frictional Grasping
Authors: Hoang Hiep Ly, Cong-Nhat Nguyen, Doan-Quang Tran et al. | Submitted: 2026-03-07 | arXiv: 2603.07308
Categories: cs.RO
Research Background: Grasping objects with diverse mechanical properties, such as heavy, slippery, or fragile items, remains a significant challenge in robotics. Conventional rigid grippers typically rely on increasing the normal forces to secure an object, however, this can cause damage to fragile objects due to excessive force.
研究背景: 在機器人學習領域,Grasping objects with diverse mechanical properties, such as heavy, slippery, or fragile items, remains a significant challenge in robotics. Conventional rigid grippers typically r
Technical Approach: To address this limitation, we propose a soft rigid hybrid gripper finger that combines rigid structural shells with soft, inflatable silicone pockets, which could be integrated into a conventional gripper.
技術方法: 本文提出的方法:To address this limitation, we propose a soft rigid hybrid gripper finger that combines rigid structural shells with soft, inflatable silicone pockets, which could be integrated into a conventional gr
Key Takeaway: The gripping experiments also show that the integrated gripper can stably lift heavy and slippery objects or fragile, deformable objects, such as eggs, tofu, fruits, and paper cups, with minimal damage by increasing friction rather than applying high force.
核心發現: 核心結果:The gripping experiments also show that the integrated gripper can stably lift heavy and slippery objects or fragile, deformable objects, such as eggs, tofu, fruits, and paper cups, with minimal damag
Model-based thermal drift compensation for high-precision hexapod robot actuators
Authors: Clément Robert, Alain Vissiere, Olivier Company et al. | Submitted: 2026-03-07 | arXiv: 2603.07141
Categories: cs.RO
Research Background: Thermal expansion is a significant source of positioning error in high-precision hexapod robots (Gough-Stewart platforms). Any variation in the temperature of the hexapod’s parts induces expansion, which alters their kinematic model and reduces the robot’s accuracy and repeatability.
研究背景: 在機器人學習領域,Thermal expansion is a significant source of positioning error in high-precision hexapod robots (Gough-Stewart platforms). Any variation in the temperature of the hexapod’s parts i
Technical Approach: Any variation in the temperature of the hexapod’s parts induces expansion, which alters their kinematic model and reduces the robot’s accuracy and repeatability. These variations may arise from internal heat sources (such as motors, encoders, and electronics) or from environmental changes. In this study, a method is proposed to anticipate and therefore correct the thermal drift of one of the hexapod precision electro-mechanical actuators.
技術方法: 本文提出的方法:Any variation in the temperature of the hexapod’s parts induces expansion, which alters their kinematic model and reduces the robot’s accuracy and repeatability. These variations may arise from intern
Key Takeaway: Experimental validation demonstrates a reduction of thermally induced expansion by more than 80%.
核心發現: 核心結果:Experimental validation demonstrates a reduction of thermally induced expansion by more than 80%.
The Talking Robot: Distortion-Robust Acoustic Models for Robot-Robot Communication
Authors: Hanlong Li, Karishma Kamalahasan, Jiahui Li et al. | Submitted: 2026-03-07 | arXiv: 2603.07072
Categories: cs.RO, cs.LG
Research Background: We present Artoo, a learned acoustic communication system for robots that replaces hand-designed signal processing with end-to-end co-trained neural networks. Our system pairs a lightweight text-to-speech (TTS) transmitter (1.18M parameters) with a conformer-based automatic speech recognition (ASR) receiver (938K parameters), jointly optimized through a differentiable channel.
研究背景: 在機器人學習領域,We present Artoo, a learned acoustic communication system for robots that replaces hand-designed signal processing with end-to-end co-trained neural networks. Our system pairs a li
Technical Approach: We present Artoo, a learned acoustic communication system for robots that replaces hand-designed signal processing with end-to-end co-trained neural networks. Our system pairs a lightweight text-to-speech (TTS) transmitter (1.18M parameters) with a conformer-based automatic speech recognition (ASR) receiver (938K parameters), jointly optimized through a differentiable channel.
技術方法: 本文提出的方法:We present Artoo, a learned acoustic communication system for robots that replaces hand-designed signal processing with end-to-end co-trained neural networks. Our system pairs a lightweight text-to-sp
Key Takeaway: The entire system requires only 2.1M parameters (8.4 MB) and runs in under 13 ms end-to-end on a CPU, making it suitable for deployment on resource-constrained robotic platforms.
核心發現: 核心結果:The entire system requires only 2.1M parameters (8.4 MB) and runs in under 13 ms end-to-end on a CPU, making it suitable for deployment on resource-constrained robotic platforms.
GuideTWSI: A Diverse Tactile Walking Surface Indicator Dataset from Synthetic and Real-World Images for Blind and Low-Vision Navigation
Authors: Hochul Hwang, Soowan Yang, Anh N. H. Nguyen et al. | Submitted: 2026-03-07 | arXiv: 2603.07060
Categories: cs.RO, cs.HC, eess.SY
Research Background: Tactile Walking Surface Indicators (TWSIs) are safety-critical landmarks that blind and low-vision (BLV) pedestrians use to locate crossings and hazard zones. From our observation sessions with BLV guide dog handlers, trainers, and an O&M specialist, we confirmed the critical importance of reliable and accurate TWSI segmentation for navigation assistance of BLV individuals.
研究背景: 在機器人學習領域,Tactile Walking Surface Indicators (TWSIs) are safety-critical landmarks that blind and low-vision (BLV) pedestrians use to locate crossings and hazard zones. From our observation
Technical Approach: From our observation sessions with BLV guide dog handlers, trainers, and an O&M specialist, we confirmed the critical importance of reliable and accurate TWSI segmentation for navigation assistance of BLV individuals. Achieving such reliability requires large-scale annotated data. However, TWSIs are severely underrepresented in existing urban perception datasets, and even existing dedicated paving datasets are limited: they lack robot-relevant viewpoints (e.g., egocentric or top-down) and are geographically biased toward East Asian directional bars - raised parallel strips used for continuous guidance along sidewalks.
技術方法: 本文提出的方法:From our observation sessions with BLV guide dog handlers, trainers, and an O&M specialist, we confirmed the critical importance of reliable and accurate TWSI segmentation for navigation assistance of
Key Takeaway: As a result, models trained only on bar-centric data struggle to generalize to dome-based warnings, leading to missed detections and false stops in safety-critical environments.
核心發現: 核心結果:As a result, models trained only on bar-centric data struggle to generalize to dome-based warnings, leading to missed detections and false stops in safety-critical environments.
TacDexGrasp: Compliant and Robust Dexterous Grasping with Tactile Feedback
Authors: Yubin Ke, Jiayi Chen, Hang Lv et al. | Submitted: 2026-03-07 | arXiv: 2603.07040
Categories: cs.RO
Research Background: Multi-fingered hands offer great potential for compliant and robust grasping of unknown objects, yet their high-dimensional force control presents a significant challenge. This work addresses two key problems: (1) distributing forces across multiple contacts to counteract an object’s weight, and (2) preventing rotational slip caused by gravitational torque when a grasp is distant from the object’s center of mass.
研究背景: 在機器人學習領域,Multi-fingered hands offer great potential for compliant and robust grasping of unknown objects, yet their high-dimensional force control presents a significant challenge. This wor
Technical Approach: Real-world experiments on 12 diverse objects demonstrate the robustness and compliance of our approach.
技術方法: 本文提出的方法:Real-world experiments on 12 diverse objects demonstrate the robustness and compliance of our approach.
Key Takeaway: Real-world experiments on 12 diverse objects demonstrate the robustness and compliance of our approach.
核心發現: 核心結果:Real-world experiments on 12 diverse objects demonstrate the robustness and compliance of our approach.
Two-Stage Path Following for Mobile Manipulators via Dimensionality-Reduced Graph Search and Numerical Optimization
Authors: Fuyu Guo, Yuting Mei, Yuyao Zhang et al. | Submitted: 2026-03-07 | arXiv: 2603.07003
Categories: cs.RO
Research Background: Efficient path following for mobile manipulators is often hindered by high-dimensional configuration spaces and kinematic constraints. This paper presents a robust two-stage configuration planning framework that decouples the 8-DoF planning problem into a tractable 2-DoF base optimization under a yaw-fixed base planning assumption.
研究背景: 在機器人學習領域,Efficient path following for mobile manipulators is often hindered by high-dimensional configuration spaces and kinematic constraints. This paper presents a robust two-stage config
Technical Approach: This paper presents a robust two-stage configuration planning framework that decouples the 8-DoF planning problem into a tractable 2-DoF base optimization under a yaw-fixed base planning assumption.
技術方法: 本文提出的方法:This paper presents a robust two-stage configuration planning framework that decouples the 8-DoF planning problem into a tractable 2-DoF base optimization under a yaw-fixed base planning assumption.
Key Takeaway: Simulation results demonstrate the theoretical precision of the proposed method by achieving sub-millimeter kinematic accuracy in simulation, and physical experiments on an omnidirectional mobile manipulator further validate the framework’s robustness and practical applicability.
核心發現: 核心結果:Simulation results demonstrate the theoretical precision of the proposed method by achieving sub-millimeter kinematic accuracy in simulation, and physical experiments on an omnidirectional mobile mani
VSL-Skin: Individually Addressable Phase-Change Voxel Skin for Variable-Stiffness and Virtual Joints Bridging Soft and Rigid Robots
Authors: Zihan Oliver Zeng, Jiajun An, Preston Luk et al. | Submitted: 2026-03-07 | arXiv: 2603.06979
Categories: cs.RO
Research Background: Soft robots are compliant but often cannot support loads or hold their shape, while rigid robots provide structural strength but are less adaptable. Existing variable-stiffness systems usually operate at the scale of whole segments or patches, which limits precise control over stiffness distribution and virtual joint placement.
研究背景: 在機器人學習領域,Soft robots are compliant but often cannot support loads or hold their shape, while rigid robots provide structural strength but are less adaptable. Existing variable-stiffness sys
Technical Approach: This paper presents the Variable Stiffness Lattice Skin (VSL-Skin), the first system to enable individually addressable voxel-level morphological control with centimeter-scale precision.
技術方法: 本文提出的方法:This paper presents the Variable Stiffness Lattice Skin (VSL-Skin), the first system to enable individually addressable voxel-level morphological control with centimeter-scale precision.
Key Takeaway: Experimental validation demonstrates 30% axial contraction, thermal switching in 75-second cycles, and cut-to-fit integration that preserves addressability after trimming.
核心發現: 核心結果:Experimental validation demonstrates 30% axial contraction, thermal switching in 75-second cycles, and cut-to-fit integration that preserves addressability after trimming.
Is Your Safe Controller Actually Safe? A Critical Review of CBF Tautologies and Hidden Assumptions
Authors: Taekyung Kim | Submitted: 2026-03-07 | arXiv: 2603.06954
Categories: cs.RO, eess.SY
Research Background: This tutorial provides a critical review of the practical application of Control Barrier Functions (CBFs) in robotic safety. While the theoretical foundations of CBFs are well-established, I identify a recurring gap between the mathematical assumption of a safe controller’s existence and its constructive realization in systems with input constraints.
研究背景: 在機器人學習領域,This tutorial provides a critical review of the practical application of Control Barrier Functions (CBFs) in robotic safety. While the theoretical foundations of CBFs are well-esta
Technical Approach: While the theoretical foundations of CBFs are well-established, I identify a recurring gap between the mathematical assumption of a safe controller’s existence and its constructive realization in systems with input constraints. I highlight the distinction between candidate and valid CBFs by analyzing the interplay of system dynamics, actuation limits, and class-K functions. I further show that some purported demonstrations of safe robot policies or controllers are limited to passively safe systems, such as single integrators or kinematic manipulators, where safety is already inherited from the underlying physics and even naive geometric hard constraints suffice to prevent collisions.
技術方法: 本文提出的方法:While the theoretical foundations of CBFs are well-established, I identify a recurring gap between the mathematical assumption of a safe controller’s existence and its constructive realization in syst
Key Takeaway: The goal of this tutorial is to bridge the gap between theoretical guarantees and actual implementation, supported by an open-source interactive web demonstration that visualizes these concepts intuitively.
核心發現: 核心結果:The goal of this tutorial is to bridge the gap between theoretical guarantees and actual implementation, supported by an open-source interactive web demonstration that visualizes these concepts intuit
FreeFly-Thinking : Aligning Chain-of-Thought Reasoning with Continuous UAV Navigation
Authors: Jiaxu Zhou, Shaobo Wang, Zhiyuan Yang et al. | Submitted: 2026-03-07 | arXiv: 2603.07181
Categories: cs.CV
Research Background: Vision-Language Navigation aims to enable agents to understand natural language instructions and carry out appropriate navigation actions in real-world environments. Most work focuses on indoor settings, with little research in complex outdoor scenes.
研究背景: 在機器人學習領域,Vision-Language Navigation aims to enable agents to understand natural language instructions and carry out appropriate navigation actions in real-world environments. Most work focu
Technical Approach: We introduce FreeFly-thinking, an end-to-end VLN framework that converts the UAV agent’s egocentric images and language instructions into a series of actions, inspired by environment of urban architecture proposed by OpenFly.
技術方法: 本文提出的方法:We introduce FreeFly-thinking, an end-to-end VLN framework that converts the UAV agent’s egocentric images and language instructions into a series of actions, inspired by environment of urban architec
Key Takeaway: Experiments on unseen test demonstrate a strong performance, presenting robustness and efficiency in UAV navigation issue.
核心發現: 核心結果:Experiments on unseen test demonstrate a strong performance, presenting robustness and efficiency in UAV navigation issue.
Inverse Resistive Force Theory (I-RFT): Learning granular properties through robot-terrain physical interactions
Authors: Shipeng Liu, Feng Xue, Yifeng Zhang et al. | Submitted: 2026-03-08 | arXiv: 2603.07796
Categories: cs.RO
Research Background: For robots to navigate safely and efficiently on soft, granular terrains, it is crucial to gather information about the terrain’s mechanical properties, which directly affect locomotion performance. Recent research has developed robotic legs that can accurately sense ground reaction forces during locomotion.
研究背景: 在機器人學習領域,For robots to navigate safely and efficiently on soft, granular terrains, it is crucial to gather information about the terrain’s mechanical properties, which directly affect locom
Technical Approach: To address this limitation, we introduce a physics-informed machine learning framework, Inverse Resistive Force Theory (I-RFT), which integrates the Granular Resistive Force Theory model with Gaussian Processes to infer terrain properties from proprioceptively measured contact forces under arbitrary gait trajectories.
技術方法: 本文提出的方法:To address this limitation, we introduce a physics-informed machine learning framework, Inverse Resistive Force Theory (I-RFT), which integrates the Granular Resistive Force Theory model with Gaussian
Key Takeaway: Moreover, we show that the quantified uncertainty over the terrain resistance stress map could enable robots to optimize foot design and gait trajectories for efficient information gathering.
核心發現: 核心結果:Moreover, we show that the quantified uncertainty over the terrain resistance stress map could enable robots to optimize foot design and gait trajectories for efficient information gathering.
A Robust Antenna Provides Tactile Feedback in a Multi-legged Robot
Authors: Zhaochen J. Xu, Juntao He, Delfin Aydan et al. | Submitted: 2026-03-08 | arXiv: 2603.07795
Categories: cs.RO
Research Background: Multi-legged elongate robots hold promise for maneuvering through complex environments. Prior work has demonstrated that reliable locomotion can be achieved using open-loop body undulation and foot placement on rugose terrain.
研究背景: 在機器人學習領域,Multi-legged elongate robots hold promise for maneuvering through complex environments. Prior work has demonstrated that reliable locomotion can be achieved using open-loop body un
Technical Approach: To address this challenge, we develop a pair of tactile antennae for multi-legged robots that enable real-time sensing of surrounding geometry, modeling the morphology and function of biological centipede antennae.
技術方法: 本文提出的方法:To address this challenge, we develop a pair of tactile antennae for multi-legged robots that enable real-time sensing of surrounding geometry, modeling the morphology and function of biological centi
Key Takeaway: These results highlight how mechanically tuned tactile appendages can simplify sensing and enhance autonomy in elongate multi-legged robots operating in constrained spaces.
核心發現: 核心結果:These results highlight how mechanically tuned tactile appendages can simplify sensing and enhance autonomy in elongate multi-legged robots operating in constrained spaces.
AeroPlace-Flow: Language-Grounded Object Placement for Aerial Manipulators via Visual Foresight and Object Flow
Authors: Sarthak Mishra, Rishabh Dev Yadav, Naveen Nair et al. | Submitted: 2026-03-08 | arXiv: 2603.07744
Categories: cs.RO
Research Background: Precise object placement remains underexplored in aerial manipulation, where most systems rely on predefined target coordinates and focus primarily on grasping and control. Specifying exact placement poses, however, is cumbersome in real-world settings, where users naturally communicate goals through language.
研究背景: 在機器人學習領域,Precise object placement remains underexplored in aerial manipulation, where most systems rely on predefined target coordinates and focus primarily on grasping and control. Specify
Technical Approach: In this work, we present AeroPlace-Flow, a training-free framework for language-grounded aerial object placement that unifies visual foresight with explicit 3D geometric reasoning and object flow. We validate our approach through extensive simulation and real-world experiments, demonstrating reliable language-conditioned placement across diverse aerial scenarios with an average success rate of 75% on hardware.
技術方法: 本文提出的方法:In this work, we present AeroPlace-Flow, a training-free framework for language-grounded aerial object placement that unifies visual foresight with explicit 3D geometric reasoning and object flow. We
Key Takeaway: We validate our approach through extensive simulation and real-world experiments, demonstrating reliable language-conditioned placement across diverse aerial scenarios with an average success rate of 75% on hardware.
核心發現: 核心結果:We validate our approach through extensive simulation and real-world experiments, demonstrating reliable language-conditioned placement across diverse aerial scenarios with an average success rate of
Model-Based and Neural-Aided Approaches for Dog Dead Reckoning
Authors: Gal Versano, Itai Savin, Itzik Klein | Submitted: 2026-03-08 | arXiv: 2603.07582
Categories: cs.RO
Research Background: Modern canine applications span medical and service roles, while robotic legged dogs serve as autonomous platforms for high-risk industrial inspection, disaster response, and search and rescue operations. For both, accurate positioning remains a significant challenge due to the cumulative drift inherent in inertial sensing.
研究背景: 在機器人學習領域,Modern canine applications span medical and service roles, while robotic legged dogs serve as autonomous platforms for high-risk industrial inspection, disaster response, and searc
Technical Approach: To bridge this gap, we propose three algorithms for accurate positioning using only inertial sensors, collectively referred to as dog dead reckoning (DDR). To evaluate our approaches, we designed DogMotion, a wearable unit for canine data recording.
技術方法: 本文提出的方法:To bridge this gap, we propose three algorithms for accurate positioning using only inertial sensors, collectively referred to as dog dead reckoning (DDR). To evaluate our approaches, we designed DogM
Key Takeaway: Across the two distinct datasets we demonstrate that our neural-aided methods consistently outperform model-based approaches, achieving an absolute distance error of less than 10%.
核心發現: 核心結果:Across the two distinct datasets we demonstrate that our neural-aided methods consistently outperform model-based approaches, achieving an absolute distance error of less than 10%.
FeasibleCap: Real-Time Embodiment Constraint Guidance for In-the-Wild Robot Demonstration Collection
Authors: Zi Yin, Fanhong Li, Yun Gui et al. | Submitted: 2026-03-08 | arXiv: 2603.07580
Categories: cs.RO
Research Background: Gripper-in-hand data collection decouples demonstration acquisition from robot hardware, but whether a trajectory is executable on the target robot remains unknown until a separate replay-and-validate stage. Failed demonstrations therefore inflate the effective cost per usable trajectory through repeated collection, diagnosis, and validation.
研究背景: 在機器人學習領域,Gripper-in-hand data collection decouples demonstration acquisition from robot hardware, but whether a trajectory is executable on the target robot remains unknown until a separate
Technical Approach: We present \textbf{FeasibleCap}, a gripper-in-hand data collection system that brings real-time executability guidance into robot-free capture.
技術方法: 本文提出的方法:We present \textbf{FeasibleCap}, a gripper-in-hand data collection system that brings real-time executability guidance into robot-free capture.
Key Takeaway: Simulation experiments further indicate that enforcing executability constraints during collection does not sacrifice cross-embodiment transfer across robot platforms.
核心發現: 核心結果:Simulation experiments further indicate that enforcing executability constraints during collection does not sacrifice cross-embodiment transfer across robot platforms.
ACCURATE: Arbitrary-shaped Continuum Reconstruction Under Robust Adaptive Two-view Estimation
Authors: Yaozhi Zhang, Shun Yu, Yugang Zhang et al. | Submitted: 2026-03-08 | arXiv: 2603.07533
Categories: cs.RO, cs.CV
Research Background: Accurate reconstruction of arbitrary-shaped long slender continuum bodies, such as guidewires, catheters and other soft continuum manipulators, is essential for accurate mechanical simulation. However, existing image-based reconstruction approaches often suffer from limited accuracy because they often underutilize camera geometry, or lack generality as they rely on rigid geometric assumptions that may fail for continuum robots with complex and highly deformable shapes.
研究背景: 在機器人學習領域,Accurate reconstruction of arbitrary-shaped long slender continuum bodies, such as guidewires, catheters and other soft continuum manipulators, is essential for accurate mechanical
Technical Approach: To address these limitations, we propose ACCURATE, a 3D reconstruction framework integrating an image segmentation neural network with a geometry-constrained topology traversal and dynamic programming algorithm that enforces global biplanar geometric consistency, minimizes the cumulative point-to-epipolar-line distance, and remains robust to occlusions and epipolar ambiguities cases caused by noise and discretization. Our method achieves high reconstruction accuracy on both simulated and real phantom datasets acquired using a clinical X-ray C-arm system, with mean absolute errors below 1.0 mm.
技術方法: 本文提出的方法:To address these limitations, we propose ACCURATE, a 3D reconstruction framework integrating an image segmentation neural network with a geometry-constrained topology traversal and dynamic programming
Key Takeaway: Our method achieves high reconstruction accuracy on both simulated and real phantom datasets acquired using a clinical X-ray C-arm system, with mean absolute errors below 1.0 mm.
核心發現: 核心結果:Our method achieves high reconstruction accuracy on both simulated and real phantom datasets acquired using a clinical X-ray C-arm system, with mean absolute errors below 1.0 mm.
GSAT: Geometric Traversability Estimation using Self-supervised Learning with Anomaly Detection for Diverse Terrains
Authors: Dongjin Cho, Miryeong Park, Juhui Lee et al. | Submitted: 2026-03-08 | arXiv: 2603.07480
Categories: cs.RO
Research Background: Safe autonomous navigation requires reliable estimation of environmental traversability. Traditional methods have relied on semantic or geometry-based approaches with human-defined thresholds, but these methods often yield unreliable predictions due to the inherent subjectivity of human supervision.
研究背景: 在機器人學習領域,Safe autonomous navigation requires reliable estimation of environmental traversability. Traditional methods have relied on semantic or geometry-based approaches with human-defined
Technical Approach: In this work, we propose GSAT, which addresses these limitations by constructing a positive hypersphere in latent space to classify traversable regions through anomaly detection without requiring additional prototypes (e.g., unlabeled or negative). Furthermore, our approach employs joint learning of anomaly classification and traversability prediction to more efficiently utilize robot experience.
技術方法: 本文提出的方法:In this work, we propose GSAT, which addresses these limitations by constructing a positive hypersphere in latent space to classify traversable regions through anomaly detection without requiring addi
Key Takeaway: We comprehensively evaluate the proposed framework through ablation studies, validation on heterogeneous real-world robotic platforms, and autonomous navigation demonstrations in simulation environments.
核心發現: 核心結果:We comprehensively evaluate the proposed framework through ablation studies, validation on heterogeneous real-world robotic platforms, and autonomous navigation demonstrations in simulation environmen
Cable-driven Continuum Robotics: Proprioception via Proximal-integrated Force Sensing
Authors: Gang Zhang, Junyan Yan, Jibiao Chen et al. | Submitted: 2026-03-08 | arXiv: 2603.07426
Categories: cs.RO
Research Background: Micro-scale continuum robots face significant limitations in achieving three-dimensional contact force perception, primarily due to structural miniaturization, nonlinear mechanical, and sensor integration. To overcome these limitations, this paper introduces a novel proprioception method for cable-driven continuum robots based on proximal-integrated force sensing (i.e., cable tension and six-axis force/torque (F/T) sensor), inspired by the tendon-joint collaborative sensing mechanism of the finger.
研究背景: 在機器人學習領域,Micro-scale continuum robots face significant limitations in achieving three-dimensional contact force perception, primarily due to structural miniaturization, nonlinear mechanical
Technical Approach: To overcome these limitations, this paper introduces a novel proprioception method for cable-driven continuum robots based on proximal-integrated force sensing (i.e., cable tension and six-axis force/torque (F/T) sensor), inspired by the tendon-joint collaborative sensing mechanism of the finger.
技術方法: 本文提出的方法:To overcome these limitations, this paper introduces a novel proprioception method for cable-driven continuum robots based on proximal-integrated force sensing (i.e., cable tension and six-axis force/
Key Takeaway: Finally, experimental validation demonstrates the effectiveness of the proposed method.
核心發現: 核心結果:Finally, experimental validation demonstrates the effectiveness of the proposed method.
Unifying Sidewinding and Rolling: A Wave-Based Framework for Self-Righting in Elongated Limbless and Multi-Legged Robots
Authors: Hangjun Liu, Jiarui Geng, Jinxuan Ding et al. | Submitted: 2026-03-08 | arXiv: 2603.07417
Categories: cs.RO
Research Background: Centipede-like robots offer unique locomotion advantages due to their small cross-sectional area for accessing confined spaces, and their redundant legs enhance robustness in cluttered environments such as search-and-rescue and pipe inspection. However, elongated robots are particularly vulnerable to tipping over when climbing large obstacles, making reliable self-righting essential for field deployment.
研究背景: 在機器人學習領域,Centipede-like robots offer unique locomotion advantages due to their small cross-sectional area for accessing confined spaces, and their redundant legs enhance robustness in clutt
Technical Approach: However, elongated robots are particularly vulnerable to tipping over when climbing large obstacles, making reliable self-righting essential for field deployment. Self-righting strategies for elongate, multi-legged systems remain poorly understood. In this study, we conduct a comparative biomechanics and robophysical investigation to address three key questions: (1) What self-righting strategies are effective for elongate, many-legged systems?
技術方法: 本文提出的方法:However, elongated robots are particularly vulnerable to tipping over when climbing large obstacles, making reliable self-righting essential for field deployment. Self-righting strategies for elongate
Key Takeaway: These results establish morphology-strategy coupling principles for self-righting in elongate robots and provide design guidelines for centipede-like systems operating in uncertain terrain.
核心發現: 核心結果:These results establish morphology-strategy coupling principles for self-righting in elongate robots and provide design guidelines for centipede-like systems operating in uncertain terrain.