arXiv Weekly Digest — Week 13, 2026
Fetched: 2026-03-29 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 318
Gaze-Aware Task Progression Detection Framework for Human-Robot Interaction Using RGB Cameras
Authors: Linlin Cheng, Koen Hindriks, Artem V. Belopolsky | Submitted: 2026-03-16 | arXiv: 2603.15951
Categories: cs.RO
Research Background: In human-robot interaction (HRI), detecting a human’s gaze helps robots interpret user attention and intent. However, most gaze detection approaches rely on specialized eye-tracking hardware, limiting deployment in everyday settings.
研究背景: 在機器人學習領域,In human-robot interaction (HRI), detecting a human’s gaze helps robots interpret user attention and intent. However, most gaze detection approaches rely on specialized eye-trackin
Technical Approach: We present a calibration-free framework for detecting task progression when information is conveyed via integrated display interfaces. We validate our framework in a “First Day at Work” scenario, comparing it to button-based interaction.
技術方法: 本文提出的方法:We present a calibration-free framework for detecting task progression when information is conveyed via integrated display interfaces. We validate our framework in a “First Day at Work” scenario, comp
Key Takeaway: This work demonstrates the feasibility of intuitive, low-cost, RGB-only gaze-based HRI for natural and engaging interactions.
核心發現: 核心結果:This work demonstrates the feasibility of intuitive, low-cost, RGB-only gaze-based HRI for natural and engaging interactions.
Resilience Meets Autonomy: Governing Embodied AI in Critical Infrastructure
Authors: Puneet Sharma, Christer Henrik Pursiainen | Submitted: 2026-03-16 | arXiv: 2603.15885
Categories: cs.AI, cs.RO
Research Background: Critical infrastructure increasingly incorporates embodied AI for monitoring, predictive maintenance, and decision support. However, AI systems designed to handle statistically representable uncertainty struggle with cascading failures and crisis dynamics that exceed their training assumptions.
研究背景: 在機器人學習領域,Critical infrastructure increasingly incorporates embodied AI for monitoring, predictive maintenance, and decision support. However, AI systems designed to handle statistically rep
Technical Approach: This paper argues that Embodied AIs resilience depends on bounded autonomy within a hybrid governance architecture.
技術方法: 本文提出的方法:This paper argues that Embodied AIs resilience depends on bounded autonomy within a hybrid governance architecture.
Key Takeaway: Drawing on the EU AI Act, ISO safety standards, and crisis management research, we argue that effective governance requires a structured allocation of machine capability and human judgement.
核心發現: 核心結果:Drawing on the EU AI Act, ISO safety standards, and crisis management research, we argue that effective governance requires a structured allocation of machine capability and human judgement.
Towards Generalizable Robotic Manipulation in Dynamic Environments
Authors: Heng Fang, Shangru Li, Shuhan Wang et al. | Submitted: 2026-03-16 | arXiv: 2603.15620
Categories: cs.CV, cs.RO
Research Background: Vision-Language-Action (VLA) models excel in static manipulation but struggle in dynamic environments with moving targets. This performance gap primarily stems from a scarcity of dynamic manipulation datasets and the reliance of mainstream VLAs on single-frame observations, restricting their spatiotemporal reasoning capabilities.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models excel in static manipulation but struggle in dynamic environments with moving targets. This performance gap primarily stems from a scarcity of d
Technical Approach: To address this, we introduce DOMINO, a large-scale dataset and benchmark for generalizable dynamic manipulation, featuring 35 tasks with hierarchical complexities, over 110K expert trajectories, and a multi-dimensional evaluation suite. Furthermore, we propose PUMA, a dynamics-aware VLA architecture.
技術方法: 本文提出的方法:To address this, we introduce DOMINO, a large-scale dataset and benchmark for generalizable dynamic manipulation, featuring 35 tasks with hierarchical complexities, over 110K expert trajectories, and
Key Takeaway: Moreover, we show that training on dynamic data fosters robust spatiotemporal representations that transfer to static tasks.
核心發現: 核心結果:Moreover, we show that training on dynamic data fosters robust spatiotemporal representations that transfer to static tasks.
From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulation
Authors: Yibin Liu, Yaxing Lyu, Daqi Gao et al. | Submitted: 2026-03-16 | arXiv: 2603.15600
Categories: cs.RO, cs.AI, cs.CL, cs.CV
Research Background: Accurate process supervision remains a critical challenge for long-horizon robotic manipulation. A primary bottleneck is that current video MLLMs, trained primarily under a Supervised Fine-Tuning (SFT) paradigm, function as passive “Observers” that recognize ongoing events rather than evaluating the current state relative to the final task goal.
研究背景: 在機器人學習領域,Accurate process supervision remains a critical challenge for long-horizon robotic manipulation. A primary bottleneck is that current video MLLMs, trained primarily under a Supervi
Technical Approach: In this paper, we introduce PRIMO R1 (Process Reasoning Induced Monitoring), a 7B framework that transforms video MLLMs into active “Critics”. We leverage outcome-based Reinforcement Learning to incentivize explicit Chain-of-Thought generation for progress estimation.
技術方法: 本文提出的方法:In this paper, we introduce PRIMO R1 (Process Reasoning Induced Monitoring), a 7B framework that transforms video MLLMs into active “Critics”. We leverage outcome-based Reinforcement Learning to incen
Key Takeaway: We establish state-of-the-art performance on RoboFail benchmark with 67.0% accuracy, surpassing closed-source models like OpenAI o1 by 6.0%.
核心發現: 核心結果:We establish state-of-the-art performance on RoboFail benchmark with 67.0% accuracy, surpassing closed-source models like OpenAI o1 by 6.0%.
MoE-ACT: Scaling Multi-Task Bimanual Manipulation with Sparse Language-Conditioned Mixture-of-Experts Transformers
Authors: Kangjun Guo, Haichao Liu, Yanji Sun et al. | Submitted: 2026-03-16 | arXiv: 2603.15265
Categories: cs.RO
Research Background: The ability of robots to handle multiple tasks under a unified policy is critical for deploying embodied intelligence in real-world household and industrial applications. However, out-of-distribution variation across tasks often causes severe task interference and negative transfer when training general robotic policies.
研究背景: 在機器人學習領域,The ability of robots to handle multiple tasks under a unified policy is critical for deploying embodied intelligence in real-world household and industrial applications. However,
Technical Approach: To address this challenge, we propose a lightweight multi-task imitation learning framework for bimanual manipulation, termed Mixture-of-Experts-Enhanced Action Chunking Transformer (MoE-ACT), which integrates sparse Mixture-of-Experts (MoE) modules into the Transformer encoder of ACT.
技術方法: 本文提出的方法:To address this challenge, we propose a lightweight multi-task imitation learning framework for bimanual manipulation, termed Mixture-of-Experts-Enhanced Action Chunking Transformer (MoE-ACT), which i
Key Takeaway: These results indicate that MoE-ACT provides stronger robustness and generalization in complex multi-task bimanual manipulation environments.
核心發現: 核心結果:These results indicate that MoE-ACT provides stronger robustness and generalization in complex multi-task bimanual manipulation environments.
HapticVLA: Contact-Rich Manipulation via Vision-Language-Action Model without Inference-Time Tactile Sensing
Authors: Konstantin Gubernatorov, Mikhail Sannikov, Ilya Mikhalchuk et al. | Submitted: 2026-03-16 | arXiv: 2603.15257
Categories: cs.RO
Research Background: Tactile sensing is a crucial capability for Vision-Language-Action (VLA) architectures, as it enables dexterous and safe manipulation in contact-rich tasks. However, reliance on dedicated tactile hardware increases cost and reduces reproducibility across robotic platforms.
研究背景: 在機器人學習領域,Tactile sensing is a crucial capability for Vision-Language-Action (VLA) architectures, as it enables dexterous and safe manipulation in contact-rich tasks. However, reliance on de
Technical Approach: To this end, we present HapticVLA, which proceeds in two tightly coupled stages: Safety-Aware Reward-Weighted Flow Matching (SA-RWFM) and Tactile Distillation (TD).
技術方法: 本文提出的方法:To this end, we present HapticVLA, which proceeds in two tightly coupled stages: Safety-Aware Reward-Weighted Flow Matching (SA-RWFM) and Tactile Distillation (TD).
Key Takeaway: On real-world experiments, HapticVLA achieves a mean success rate of 86.7%, consistently outperforming baseline VLAs - including versions provided with direct tactile feedback during inference.
核心發現: 核心結果:On real-world experiments, HapticVLA achieves a mean success rate of 86.7%, consistently outperforming baseline VLAs - including versions provided with direct tactile feedback during inference.
KiRAS: Keyframe Guided Self-Imitation for Robust and Adaptive Skill Learning in Quadruped Robots
Authors: Xiaoyi Wei, Peng Zhai, Jiaxin Tu et al. | Submitted: 2026-03-16 | arXiv: 2603.15179
Categories: cs.RO
Research Background: With advances in reinforcement learning and imitation learning, quadruped robots can acquire diverse skills within a single policy by imitating multiple skill-specific datasets. However, the lack of datasets on complex terrains limits the ability of such multi-skill policies to generalize effectively in unstructured environments.
研究背景: 在機器人學習領域,With advances in reinforcement learning and imitation learning, quadruped robots can acquire diverse skills within a single policy by imitating multiple skill-specific datasets. Ho
Technical Approach: We propose Keyframe Guided Self-Imitation for Robust and Adaptive Skill Learning (KiRAS), an end-to-end framework for acquiring and transitioning between diverse skill primitives on complex terrains.
技術方法: 本文提出的方法:We propose Keyframe Guided Self-Imitation for Robust and Adaptive Skill Learning (KiRAS), an end-to-end framework for acquiring and transitioning between diverse skill primitives on complex terrains.
Key Takeaway: This framework demonstrates its potential as a lightweight platform for multi-skill generation and dataset collection.
核心發現: 核心結果:This framework demonstrates its potential as a lightweight platform for multi-skill generation and dataset collection.
Confusion-Aware In-Context-Learning for Vision-Language Models in Robotic Manipulation
Authors: Yayun He, Zuheng Kang, Botao Zhao et al. | Submitted: 2026-03-16 | arXiv: 2603.15134
Categories: cs.RO
Research Background: Vision-language models (VLMs) have significantly improved the generalization capabilities of robotic manipulation. However, VLM-based systems often suffer from a lack of robustness, leading to unpredictable errors, particularly in scenarios involving confusable objects.
研究背景: 在機器人學習領域,Vision-language models (VLMs) have significantly improved the generalization capabilities of robotic manipulation. However, VLM-based systems often suffer from a lack of robustness
Technical Approach: To this end, we propose Confusion-Aware In-Context Learning (CAICL), a method that enhances VLM performance in confusable scenarios for robotic manipulation.
技術方法: 本文提出的方法:To this end, we propose Confusion-Aware In-Context Learning (CAICL), a method that enhances VLM performance in confusable scenarios for robotic manipulation.
Key Takeaway: Extensive experiments on the VIMA-Bench show that CAICL effectively addresses the shortcut learning issue, achieving a 85.5% success rate and showing good stability across tasks with different degrees of generalization.
核心發現: 核心結果:Extensive experiments on the VIMA-Bench show that CAICL effectively addresses the shortcut learning issue, achieving a 85.5% success rate and showing good stability across tasks with different degree
AnoleVLA: Lightweight Vision-Language-Action Model with Deep State Space Models for Mobile Manipulation
Authors: Yusuke Takagi, Motonari Kambara, Daichi Yashima et al. | Submitted: 2026-03-16 | arXiv: 2603.15046
Categories: cs.RO, cs.AI
Research Background: In this study, we address the problem of language-guided robotic manipulation, where a robot is required to manipulate a wide range of objects based on visual observations and natural language instructions. This task is essential for service robots that operate in human environments, and requires safety, efficiency, and task-level generality.
研究背景: 在機器人學習領域,In this study, we address the problem of language-guided robotic manipulation, where a robot is required to manipulate a wide range of objects based on visual observations and natu
Technical Approach: To overcome this limitation, we propose AnoleVLA, a lightweight VLA that uses a deep state space model to process multimodal sequences efficiently.
技術方法: 本文提出的方法:To overcome this limitation, we propose AnoleVLA, a lightweight VLA that uses a deep state space model to process multimodal sequences efficiently.
Key Takeaway: Notably, in real-world evaluations, AnoleVLA outperformed a representative large-scale VLA by 21 points for the task success rate while achieving an inference speed approximately three times faster.
核心發現: 核心結果:Notably, in real-world evaluations, AnoleVLA outperformed a representative large-scale VLA by 21 points for the task success rate while achieving an inference speed approximately three times faster.
ReMAP-DP: Reprojected Multi-view Aligned PointMaps for Diffusion Policy
Authors: Xinzhang Yang, Renjun Wu, Jinyan Liu et al. | Submitted: 2026-03-16 | arXiv: 2603.14977
Categories: cs.RO
Research Background: Generalist robot policies built upon 2D visual representations excel at semantic reasoning but inherently lack the explicit 3D spatial awareness required for high-precision tasks. Existing 3D integration methods struggle to bridge this gap due to the structural irregularity of sparse point clouds and the geometric distortion introduced by multi-view orthographic rendering.
研究背景: 在機器人學習領域,Generalist robot policies built upon 2D visual representations excel at semantic reasoning but inherently lack the explicit 3D spatial awareness required for high-precision tasks.
Technical Approach: To overcome these barriers, we present ReMAP-DP, a novel framework synergizing standardized perspective reprojection with a structure-aware dual-stream diffusion policy. On ManiSkill 3, our method yields a 28% improvement over DP3 on the geometrically challenging Stack Cube task.
技術方法: 本文提出的方法:To overcome these barriers, we present ReMAP-DP, a novel framework synergizing standardized perspective reprojection with a structure-aware dual-stream diffusion policy. On ManiSkill 3, our method yie
Key Takeaway: On ManiSkill 3, our method yields a 28% improvement over DP3 on the geometrically challenging Stack Cube task.
核心發現: 核心結果:On ManiSkill 3, our method yields a 28% improvement over DP3 on the geometrically challenging Stack Cube task.
AutoMoT: A Unified Vision-Language-Action Model with Asynchronous Mixture-of-Transformers for End-to-End Autonomous Driving
Authors: Wenhui Huang, Songyan Zhang, Qihang Huang et al. | Submitted: 2026-03-16 | arXiv: 2603.14851
Categories: cs.CV, cs.RO
Research Background: Integrating vision-language models (VLMs) into end-to-end (E2E) autonomous driving (AD) systems has shown promise in improving scene understanding. However, existing integration strategies suffer from several limitations: they either struggle to resolve distribution misalignment between reasoning and action spaces, underexploit the general reasoning capabilities of pretrained VLMs, or incur substantial inference latency during action policy generation, which degrades driving performance.
研究背景: 在機器人學習領域,Integrating vision-language models (VLMs) into end-to-end (E2E) autonomous driving (AD) systems has shown promise in improving scene understanding. However, existing integration st
Technical Approach: To address these challenges, we propose AutoMoT in this work, an end-to-end AD framework that unifies reasoning and action generation within a single vision-language-action (VLA) model. Our approach leverages a mixture-of-transformer (MoT) architecture with joint attention sharing, which preserves the general reasoning capabilities of pre-trained VLMs while enabling efficient fast-slow inference through asynchronous execution at different task frequencies.
技術方法: 本文提出的方法:To address these challenges, we propose AutoMoT in this work, an end-to-end AD framework that unifies reasoning and action generation within a single vision-language-action (VLA) model. Our approach l
Key Takeaway: We refer to https://automot-website.github.io/ for the demonstration videos and qualitative results.
核心發現: 核心結果:We refer to https://automot-website.github.io/ for the demonstration videos and qualitative results.
HiMemVLN: Enhancing Reliability of Open-Source Zero-Shot Vision-and-Language Navigation with Hierarchical Memory System
Authors: Kailin Lyu, Kangyi Wu, Pengna Li et al. | Submitted: 2026-03-16 | arXiv: 2603.14807
Categories: cs.CV, cs.RO
Research Background: LLM-based agents have demonstrated impressive zero-shot performance in vision-language navigation (VLN) tasks. However, most zero-shot methods primarily rely on closed-source LLMs as navigators, which face challenges related to high token costs and potential data leakage risks.
研究背景: 在機器人學習領域,LLM-based agents have demonstrated impressive zero-shot performance in vision-language navigation (VLN) tasks. However, most zero-shot methods primarily rely on closed-source LLMs
Technical Approach: To address this, we propose HiMemVLN, which incorporates a Hierarchical Memory System into a multimodal large model to enhance visual perception recall and long-term localization, mitigating the amnesia issue and improving the agent’s navigation performance.
技術方法: 本文提出的方法:To address this, we propose HiMemVLN, which incorporates a Hierarchical Memory System into a multimodal large model to enhance visual perception recall and long-term localization, mitigating the amnes
Key Takeaway: Extensive experiments in both simulated and real-world environments demonstrate that HiMemVLN achieves nearly twice the performance of the open-source state-of-the-art method.
核心發現: 核心結果:Extensive experiments in both simulated and real-world environments demonstrate that HiMemVLN achieves nearly twice the performance of the open-source state-of-the-art method.
Exploring Human Quadruped Locomotion for Exergames
Authors: Shamit Ahmed, Perttu Hämäläinen | Submitted: 2026-03-16 | arXiv: 2603.15428
Categories: cs.HC
Research Background: Embodying non-human characters and exercising abdominal muscles are both underexplored in exergames. We address this by describing the design and evaluation of a novel human quadruped locomotion exergame.
研究背景: 在機器人學習領域,Embodying non-human characters and exercising abdominal muscles are both underexplored in exergames. We address this by describing the design and evaluation of a novel human quadru
Technical Approach: The motion tracking is computer vision-based, utilizing a Kinect sensor placed above the player, which makes our approach suitable for commercial premises such as indoor activity parks where a system needs to run unattended and without any wearable components. Our system extends embodied interaction beyond traditional bipedal or controller-based systems, demonstrating how natural limb movements can generate responsive and immersive quadrupedal motion within virtual environments. The findings demonstrate the usability and potential of our system, highlighting its intense physical nature.
技術方法: 本文提出的方法:The motion tracking is computer vision-based, utilizing a Kinect sensor placed above the player, which makes our approach suitable for commercial premises such as indoor activity parks where a system
Key Takeaway: The findings demonstrate the usability and potential of our system, highlighting its intense physical nature.
核心發現: 核心結果:The findings demonstrate the usability and potential of our system, highlighting its intense physical nature.
Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
Authors: Yulin Luo, Hao Chen, Zhuangzhe Wu et al. | Submitted: 2026-03-16 | arXiv: 2603.15618
Categories: cs.CV
Research Background: Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on language instructions. Although recent works have sought to enhance the visual capabilities of VLA models, most approaches treat the LLM backbone as a black box, providing limited insight into how visual information is grounded into action generation.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately int
Technical Approach: Motivated by this observation, we propose \textbf{DeepVision-VLA}, built on a \textbf{Vision-Language Mixture-of-Transformers (VL-MoT)} framework. In addition, we introduce \textbf{Action-Guided Visual Pruning (AGVP)}, which leverages shallow-layer attention to prune irrelevant visual tokens while preserving task-relevant ones, reinforcing critical visual cues for manipulation with minimal computational overhead.
技術方法: 本文提出的方法:Motivated by this observation, we propose \textbf{DeepVision-VLA}, built on a \textbf{Vision-Language Mixture-of-Transformers (VL-MoT)} framework. In addition, we introduce \textbf{Action-Guided Visua
Key Takeaway: DeepVision-VLA outperforms prior state-of-the-art methods by 9.0% and 7.5% on simulated and real-world tasks, respectively, providing new insights for the design of visually enhanced VLA models.
核心發現: 核心結果:DeepVision-VLA outperforms prior state-of-the-art methods by 9.0% and 7.5% on simulated and real-world tasks, respectively, providing new insights for the design of visually enhanced VLA models.
Trajectory-Diversity-Driven Robust Vision-and-Language Navigation
Authors: Jiangyang Li, Cong Wan, SongLin Dong et al. | Submitted: 2026-03-16 | arXiv: 2603.15370
Categories: cs.CV
Research Background: Vision-and-Language Navigation (VLN) requires agents to navigate photo-realistic environments following natural language instructions. Current methods predominantly rely on imitation learning, which suffers from limited generalization and poor robustness to execution perturbations.
研究背景: 在機器人學習領域,Vision-and-Language Navigation (VLN) requires agents to navigate photo-realistic environments following natural language instructions. Current methods predominantly rely on imitati
Technical Approach: We present NavGRPO, a reinforcement learning framework that learns goal-directed navigation policies through Group Relative Policy Optimization. By exploring diverse trajectories and optimizing via within-group performance comparisons, our method enables agents to distinguish effective strategies beyond expert paths without requiring additional value networks.
技術方法: 本文提出的方法:We present NavGRPO, a reinforcement learning framework that learns goal-directed navigation policies through Group Relative Policy Optimization. By exploring diverse trajectories and optimizing via wi
Key Takeaway: Under extreme early-stage perturbations, we demonstrate +14.89% SPL gain over the baseline, confirming that goal-directed RL training builds substantially more robust navigation policies.
核心發現: 核心結果:Under extreme early-stage perturbations, we demonstrate +14.89% SPL gain over the baseline, confirming that goal-directed RL training builds substantially more robust navigation policies.
Influence of Gripper Design on Human Demonstration Quality for Robot Learning
Authors: Gina L. Georgadarellis, Natalija Beslic, Seonhun Lee et al. | Submitted: 2026-03-17 | arXiv: 2603.17189
Categories: cs.RO
Research Background: Opening sterile medical packaging is routine for healthcare workers but remains challenging for robots. Learning from demonstration enables robots to acquire manipulation skills directly from humans, and handheld gripper tools such as the Universal Manipulation Interface (UMI) offer a pathway for efficient data collection.
研究背景: 在機器人學習領域,Opening sterile medical packaging is routine for healthcare workers but remains challenging for robots. Learning from demonstration enables robots to acquire manipulation skills di
Technical Approach: Learning from demonstration enables robots to acquire manipulation skills directly from humans, and handheld gripper tools such as the Universal Manipulation Interface (UMI) offer a pathway for efficient data collection. However, the effectiveness of these tools depends heavily on their usability. We evaluated UMI in demonstrating a bandage opening task, a common manipulation task in hospital settings, by testing three conditions: distributed load grippers, concentrated load grippers, and bare hands.
技術方法: 本文提出的方法:Learning from demonstration enables robots to acquire manipulation skills directly from humans, and handheld gripper tools such as the Universal Manipulation Interface (UMI) offer a pathway for effici
Key Takeaway: These results underscore the importance of ergonomic and mechanical refinements in handheld grippers to reduce user burden and improve demonstration quality, especially for applications in healthcare robotics.
核心發現: 核心結果:These results underscore the importance of ergonomic and mechanical refinements in handheld grippers to reduce user burden and improve demonstration quality, especially for applications in healthcare
TeleDex: Accessible Dexterous Teleoperation
Authors: Omar Rayyan, Maximilian Gilles, Yuchen Cui | Submitted: 2026-03-17 | arXiv: 2603.17065
Categories: cs.RO
Research Background: Despite increasing dataset scale and model capacity, robot manipulation policies still struggle to generalize beyond their training distributions. As a result, deploying state-of-the-art policies in new environments, tasks, or robot embodiments often requires collecting additional demonstrations.
研究背景: 在機器人學習領域,Despite increasing dataset scale and model capacity, robot manipulation policies still struggle to generalize beyond their training distributions. As a result, deploying state-of-t
Technical Approach: We present TeleDex, an open-source system for intuitive teleoperation of dexterous hands and robotic manipulators using any readily available phone.
技術方法: 本文提出的方法:We present TeleDex, an open-source system for intuitive teleoperation of dexterous hands and robotic manipulators using any readily available phone.
Key Takeaway: We evaluate the system across simulation and real-world manipulation tasks, demonstrating its effectiveness as a unified scalable interface for robot teleoperation.
核心發現: 核心結果:We evaluate the system across simulation and real-world manipulation tasks, demonstrating its effectiveness as a unified scalable interface for robot teleoperation.
Efficient and Reliable Teleoperation through Real-to-Sim-to-Real Shared Autonomy
Authors: Shuo Sha, Yixuan Wang, Binghao Huang et al. | Submitted: 2026-03-17 | arXiv: 2603.17016
Categories: cs.RO
Research Background: Fine-grained, contact-rich teleoperation remains slow, error-prone, and unreliable in real-world manipulation tasks, even for experienced operators. Shared autonomy offers a promising way to improve performance by combining human intent with automated assistance, but learning effective assistance in simulation requires a faithful model of human behavior, which is difficult to obtain in practice.
研究背景: 在機器人學習領域,Fine-grained, contact-rich teleoperation remains slow, error-prone, and unreliable in real-world manipulation tasks, even for experienced operators. Shared autonomy offers a promis
Technical Approach: We propose a real-to-sim-to-real shared autonomy framework that augments human teleoperation with learned corrective behaviors, using a simple yet effective k-nearest-neighbor (kNN) human surrogate to model operator actions in simulation. Through simulation experiments and a user study with sixteen participants on industry-relevant tasks, including nut threading, gear meshing, and peg insertion, we show that our system improves task success for novice operators and execution efficiency for experienced operators compared to direct teleoperation and shared-autonomy baselines that rely on expert priors or behavioral-cloning pilots.
技術方法: 本文提出的方法:We propose a real-to-sim-to-real shared autonomy framework that augments human teleoperation with learned corrective behaviors, using a simple yet effective k-nearest-neighbor (kNN) human surrogate to
Key Takeaway: Through simulation experiments and a user study with sixteen participants on industry-relevant tasks, including nut threading, gear meshing, and peg insertion, we show that our system improves task success for novice operators and execution efficiency for experienced operators compared to direct teleoperation and shared-autonomy baselines that rely on expert priors or behavioral-cloning pilots.
核心發現: 核心結果:Through simulation experiments and a user study with sixteen participants on industry-relevant tasks, including nut threading, gear meshing, and peg insertion, we show that our system improves task su
CABTO: Context-Aware Behavior Tree Grounding for Robot Manipulation
Authors: Yishuai Cai, Xinglin Chen, Yunxin Mao et al. | Submitted: 2026-03-17 | arXiv: 2603.16809
Categories: cs.RO, cs.AI
Research Background: Behavior Trees (BTs) offer a powerful paradigm for designing modular and reactive robot controllers. BT planning, an emerging field, provides theoretical guarantees for the automated generation of reliable BTs.
研究背景: 在機器人學習領域,Behavior Trees (BTs) offer a powerful paradigm for designing modular and reactive robot controllers. BT planning, an emerging field, provides theoretical guarantees for the automat
Technical Approach: In this paper, we formalize the BT Grounding problem: the automated construction of a complete and consistent BT system.
技術方法: 本文提出的方法:In this paper, we formalize the BT Grounding problem: the automated construction of a complete and consistent BT system.
Key Takeaway: Experiments spanning seven task sets across three distinct robotic manipulation scenarios demonstrate CABTO’s effectiveness and efficiency in generating complete and consistent behavior tree systems.
核心發現: 核心結果:Experiments spanning seven task sets across three distinct robotic manipulation scenarios demonstrate CABTO’s effectiveness and efficiency in generating complete and consistent behavior tree systems.
Beyond Cybathlon: On-demand Quadrupedal Assistance for People with Limited Mobility
Authors: Carmen Scheidemann, Andrei Cramariuc, Changan Chen et al. | Submitted: 2026-03-17 | arXiv: 2603.16772
Categories: cs.RO, cs.HC
Research Background: Background: Assistance robots have the potential to increase the independence of people who need daily care due to limited mobility or being wheelchair-bound. Current solutions of attaching robotic arms to motorized wheelchairs offer limited additional mobility at the cost of increased size and reduced wheelchair maneuverability.
研究背景: 在機器人學習領域,Background: Assistance robots have the potential to increase the independence of people who need daily care due to limited mobility or being wheelchair-bound. Current solutions of
Technical Approach: Methods: We present an on-demand quadrupedal assistance robot system controlled via a shared autonomy approach, which combines semi-autonomous task execution with human teleoperation. For teleoperation, we present a mouth-level joystick interface that enables an operator with reduced mobility to control the robot’s end effector for precision manipulation. Results: We showcase our system in the \textit{Cybathlon 2024 Assistance Robot Race}, and validate it in an at-home experimental setup, where we measure task completion times and user satisfaction.
技術方法: 本文提出的方法:Methods: We present an on-demand quadrupedal assistance robot system controlled via a shared autonomy approach, which combines semi-autonomous task execution with human teleoperation. For teleoperatio
Key Takeaway: We achieve results comparable to previous state-of-the-art on subjective metrics while allowing for more autonomy of the operator and greater agility for manipulation.
核心發現: 核心結果:We achieve results comparable to previous state-of-the-art on subjective metrics while allowing for more autonomy of the operator and greater agility for manipulation.
Learning Whole-Body Control for a Salamander Robot
Authors: Mengze Tian, Qiyuan Fu, Chuanfang Ning et al. | Submitted: 2026-03-17 | arXiv: 2603.16683
Categories: cs.RO
Research Background: Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional quadrupedal robots, most salamander robots relied on central-pattern-generator (CPG)-based and model-based coordination strategies for locomotion control.
研究背景: 在機器人學習領域,Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers
Technical Approach: However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional quadrupedal robots, most salamander robots relied on central-pattern-generator (CPG)-based and model-based coordination strategies for locomotion control. Learning unified joint-level whole-body control that reliably transfers from simulation to highly articulated physical salamander robots remains relatively underexplored. In addition, few legged robots have tried learning-based controllers in amphibious environments.
技術方法: 本文提出的方法:However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional quadrupedal robots, most salamander robots relied on central-pattern-generato
Key Takeaway: The learned controller achieves stable and coordinated walking on both flat and uneven terrains in the real world.
核心發現: 核心結果:The learned controller achieves stable and coordinated walking on both flat and uneven terrains in the real world.
Dexterous grasp data augmentation based on grasp synthesis with fingertip workspace cloud and contact-aware sampling
Authors: Liqi Wu, Haoyu Jia, Kento Kawaharazuka et al. | Submitted: 2026-03-17 | arXiv: 2603.16609
Categories: cs.RO
Research Background: Robotic grasping is a fundamental yet crucial component of robotic applications, as effective grasping often serves as the starting point for various tasks. With the rapid advancement of neural networks, data-driven approaches for robotic grasping have become mainstream.
研究背景: 在機器人學習領域,Robotic grasping is a fundamental yet crucial component of robotic applications, as effective grasping often serves as the starting point for various tasks. With the rapid advancem
Technical Approach: In this work, we propose a teleoperation-based framework to collect a small set of grasp pose demonstrations, which are augmented using FSG—a Fingertip-contact-aware Sampling-based Grasp generator. Based on the demonstrated grasp poses, we propose AutoWS, which automatically generates structured workspace clouds of robotic fingertips, embedding the hand structure information directly into the clouds to eliminate the need for inverse kinematics calculations. Experiments on grasping the YCB objects show that our method significantly outperforms existing approaches in both speed and valid pose generation rate.
技術方法: 本文提出的方法:In this work, we propose a teleoperation-based framework to collect a small set of grasp pose demonstrations, which are augmented using FSG—a Fingertip-contact-aware Sampling-based Grasp generator. B
Key Takeaway: Experiments on grasping the YCB objects show that our method significantly outperforms existing approaches in both speed and valid pose generation rate.
核心發現: 核心結果:Experiments on grasping the YCB objects show that our method significantly outperforms existing approaches in both speed and valid pose generation rate.
Conservative Offline Robot Policy Learning via Posterior-Transition Reweighting
Authors: Wanpeng Zhang, Hao Luo, Sipeng Zheng et al. | Submitted: 2026-03-17 | arXiv: 2603.16542
Categories: cs.RO
Research Background: Offline post-training adapts a pretrained robot policy to a target dataset by supervised regression on recorded actions. In practice, robot datasets are heterogeneous: they mix embodiments, camera setups, and demonstrations of varying quality, so many trajectories reflect recovery behavior, inconsistent operator skill, or weakly informative supervision.
研究背景: 在機器人學習領域,Offline post-training adapts a pretrained robot policy to a target dataset by supervised regression on recorded actions. In practice, robot datasets are heterogeneous: they mix emb
Technical Approach: We propose Posterior-Transition Reweighting (PTR), a reward-free and conservative post-training method that decides how much each training sample should influence the supervised update.
技術方法: 本文提出的方法:We propose Posterior-Transition Reweighting (PTR), a reward-free and conservative post-training method that decides how much each training sample should influence the supervised update.
Key Takeaway: Rather than uniformly trusting all recorded supervision, PTR reallocates credit according to how attributable each sample’s post-action consequence is under the current representation, improving conservative offline adaptation to heterogeneous robot data.
核心發現: 核心結果:Rather than uniformly trusting all recorded supervision, PTR reallocates credit according to how attributable each sample’s post-action consequence is under the current representation, improving conse
Encoding Predictability and Legibility for Style-Conditioned Diffusion Policy
Authors: Adrien Jacquet Crétides, Mouad Abrini, Hamed Rahimi et al. | Submitted: 2026-03-17 | arXiv: 2603.16368
Categories: cs.RO, cs.LG
Research Background: Striking a balance between efficiency and transparent motion is a core challenge in human-robot collaboration, as highly expressive movements often incur unnecessary time and energy costs. In collaborative environments, legibility allows a human observer a better understanding of the robot’s actions, increasing safety and trust.
研究背景: 在機器人學習領域,Striking a balance between efficiency and transparent motion is a core challenge in human-robot collaboration, as highly expressive movements often incur unnecessary time and energ
Technical Approach: To address this trade-off, we propose Style-Conditioned Diffusion Policy (SCDP), a modular framework that constrains the trajectory generation of a pre-trained diffusion model toward either legibility or efficiency based on the environment’s configuration. Our method utilizes a post-training pipeline that freezes the base policy and trains a lightweight scene encoder and conditioning predictor to modulate the diffusion process.
技術方法: 本文提出的方法:To address this trade-off, we propose Style-Conditioned Diffusion Policy (SCDP), a modular framework that constrains the trajectory generation of a pre-trained diffusion model toward either legibility
Key Takeaway: We evaluate SCDP on manipulation and navigation tasks, and results show that it enhances legibility in ambiguous settings while preserving optimal efficiency when legibility is unnecessary, all without retraining the base policy.
核心發現: 核心結果:We evaluate SCDP on manipulation and navigation tasks, and results show that it enhances legibility in ambiguous settings while preserving optimal efficiency when legibility is unnecessary, all withou
Enabling Dynamic Tracking in Vision-Language-Action Models via Time-Discrete and Time-Continuous Velocity Feedforward
Authors: Johannes Hechtl, Philipp Schmitt, Georg von Wichert et al. | Submitted: 2026-03-17 | arXiv: 2603.16218
Categories: cs.RO
Research Background: While vision-language-action (VLA) models have shown great promise for robot manipulation, their deployment on rigid industrial robots remains challenging due to the inherent trade-off between compliance and responsiveness. Standard Behavior Cloning (BC) approaches predict discrete poses at low frequencies, omitting the velocity and acceleration feedforward terms typically used by low-level compliant controllers.
研究背景: 在機器人學習領域,While vision-language-action (VLA) models have shown great promise for robot manipulation, their deployment on rigid industrial robots remains challenging due to the inherent trade
Technical Approach: In this paper, we demonstrate the importance of integrating velocity feedforward terms into VLA policies to resolve this trade-off. We propose two methods for extracting velocity targets from VLAs: a time-discrete finite-difference approximation that serves as a highly effective bridge for existing models, and a continuous Cubic B-Spline action space that natively yields continuous trajectories for high-frequency control. We fine-tune the model and evaluate both of our approaches on a demanding, contact-rich cube-in-hole task.
技術方法: 本文提出的方法:In this paper, we demonstrate the importance of integrating velocity feedforward terms into VLA policies to resolve this trade-off. We propose two methods for extracting velocity targets from VLAs: a
Key Takeaway: Our results indicate that incorporating the velocity feedforward term via finite differences significantly improves task execution speed, while the continuous B-Spline approach maintains high overall success rates and provides a foundation for smoother higher-order derivatives without compromising compliance.
核心發現: 核心結果:Our results indicate that incorporating the velocity feedforward term via finite differences significantly improves task execution speed, while the continuous B-Spline approach maintains high overall
EFF-Grasp: Energy-Field Flow Matching for Physics-Aware Dexterous Grasp Generation
Authors: Yukun Zhao, Zichen Zhong, Yongshun Gong et al. | Submitted: 2026-03-17 | arXiv: 2603.16151
Categories: cs.CV
Research Background: Denoising generative models have recently become the dominant paradigm for dexterous grasp generation, owing to their ability to model complex grasp distributions from large-scale data. However, existing diffusion-based methods typically formulate generation as a stochastic differential equation (SDE), which often requires many sequential denoising steps and introduces trajectory instability that can lead to physically infeasible grasps.
研究背景: 在機器人學習領域,Denoising generative models have recently become the dominant paradigm for dexterous grasp generation, owing to their ability to model complex grasp distributions from large-scale
Technical Approach: In this paper, we propose EFF-Grasp, a novel Flow-Matching-based framework for physics-aware dexterous grasp generation. To further enforce physical feasibility, we introduce a training-free physics-aware energy guidance strategy. Our method defines an energy-guided target distribution using adapted explicit physical energy functions that capture key grasp constraints, and estimates the corresponding guidance term via a local Monte Carlo approximation during inference.
技術方法: 本文提出的方法:In this paper, we propose EFF-Grasp, a novel Flow-Matching-based framework for physics-aware dexterous grasp generation. To further enforce physical feasibility, we introduce a training-free physics-a
Key Takeaway: Extensive experiments on five benchmark datasets show that EFF-Grasp achieves superior performance in grasp quality and physical feasibility, while requiring substantially fewer sampling steps than diffusion-based baselines.
核心發現: 核心結果:Extensive experiments on five benchmark datasets show that EFF-Grasp achieves superior performance in grasp quality and physical feasibility, while requiring substantially fewer sampling steps than di
HRI-SA: A Multimodal Dataset for Online Assessment of Human Situational Awareness during Remote Human-Robot Teaming
Authors: Hashini Senaratne, Richard Attfield, Samith Widhanapathirana et al. | Submitted: 2026-03-18 | arXiv: 2603.18344
Categories: cs.RO, cs.HC, cs.LG, cs.MA
Research Background: Maintaining situational awareness (SA) is critical in human-robot teams. Yet, under high workload and dynamic conditions, operators often experience SA gaps.
研究背景: 在機器人學習領域,Maintaining situational awareness (SA) is critical in human-robot teams. Yet, under high workload and dynamic conditions, operators often experience SA gaps.
Technical Approach: To advance the development of online SA assessment tools, we introduce HRI-SA, a multimodal dataset from 30 participants in a realistic search-and-rescue human-robot teaming context, incorporating eye movements, pupil diameter, biosignals, user interactions, and robot data. This paper contributes the first public dataset supporting the systematic evaluation of SA throughout a human-robot teaming mission, while also demonstrating the potential of generic eye-tracking features for continuous perceptual SA latency detection in remote human-robot teaming.
技術方法: 本文提出的方法:To advance the development of online SA assessment tools, we introduce HRI-SA, a multimodal dataset from 30 participants in a realistic search-and-rescue human-robot teaming context, incorporating eye
Key Takeaway: This paper contributes the first public dataset supporting the systematic evaluation of SA throughout a human-robot teaming mission, while also demonstrating the potential of generic eye-tracking features for continuous perceptual SA latency detection in remote human-robot teaming.
核心發現: 核心結果:This paper contributes the first public dataset supporting the systematic evaluation of SA throughout a human-robot teaming mission, while also demonstrating the potential of generic eye-tracking feat
Shifting Uncertainty to Critical Moments: Towards Reliable Uncertainty Quantification for VLA Model
Authors: Yanchuan Tang, Taowen Wang, Yuefei Chen et al. | Submitted: 2026-03-18 | arXiv: 2603.18342
Categories: cs.RO, cs.AI, cs.LG
Research Background: Vision-Language-Action (VLA) models enable general-purpose robotic policies by mapping visual observations and language instructions to low-level actions, but they often lack reliable introspection. A common practice is to compute a token-level uncertainty signal and take its mean over a rollout.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models enable general-purpose robotic policies by mapping visual observations and language instructions to low-level actions, but they often lack relia
Technical Approach: We propose a unified uncertainty quantification approach for predicting rollout success versus failure that (1) uses max-based sliding window pooling to preserve transient risk signals, (2) applies motion-aware stability weighting to emphasize high-frequency action oscillations associated with unstable behaviors, and (3) performs DoF-adaptive calibration via Bayesian Optimization to prioritize kinematically critical axes. Experiments on the LIBERO benchmark show that our method substantially improves failure prediction accuracy and yields more reliable signals for failure detection, which can support downstream human-in-the-loop interventions.
技術方法: 本文提出的方法:We propose a unified uncertainty quantification approach for predicting rollout success versus failure that (1) uses max-based sliding window pooling to preserve transient risk signals, (2) applies mo
Key Takeaway: Experiments on the LIBERO benchmark show that our method substantially improves failure prediction accuracy and yields more reliable signals for failure detection, which can support downstream human-in-the-loop interventions.
核心發現: 核心結果:Experiments on the LIBERO benchmark show that our method substantially improves failure prediction accuracy and yields more reliable signals for failure detection, which can support downstream human-i
Offload or Overload: A Platform Measurement Study of Mobile Robotic Manipulation Workloads
Authors: Sara Pohland, Xenofon Foukas, Ganesh Ananthanarayanan et al. | Submitted: 2026-03-18 | arXiv: 2603.18284
Categories: cs.RO, cs.AI, cs.NI, eess.SY
Research Background: Mobile robotic manipulation—the ability of robots to navigate spaces and interact with objects—is a core capability of physical AI. Foundation models have led to breakthroughs in their performance, but at a significant computational cost.
研究背景: 在機器人學習領域,Mobile robotic manipulation—the ability of robots to navigate spaces and interact with objects—is a core capability of physical AI. Foundation models have led to breakthroughs in
Technical Approach: We present the first measurement study of mobile robotic manipulation workloads across onboard, edge, and cloud GPU platforms.
技術方法: 本文提出的方法:We present the first measurement study of mobile robotic manipulation workloads across onboard, edge, and cloud GPU platforms.
Key Takeaway: We find that the full workload stack is infeasible to run on smaller onboard GPUs, while larger onboard GPUs drain robot batteries several hours faster.
核心發現: 核心結果:We find that the full workload stack is infeasible to run on smaller onboard GPUs, while larger onboard GPUs drain robot batteries several hours faster.
Rapid Adaptation of Particle Dynamics for Generalized Deformable Object Mobile Manipulation
Authors: Bohan Wu, Roberto Martín-Martín, Li Fei-Fei | Submitted: 2026-03-18 | arXiv: 2603.18246
Categories: cs.RO
Research Background: We address the challenge of learning to manipulate deformable objects with unknown dynamics. In non-rigid objects, the dynamics parameters define how they react to interactions — how they stretch, bend, compress, and move — and they are critical to determining the optimal actions to perform a manipulation task successfully.
研究背景: 在機器人學習領域,We address the challenge of learning to manipulate deformable objects with unknown dynamics. In non-rigid objects, the dynamics parameters define how they react to interactions —
Technical Approach: In non-rigid objects, the dynamics parameters define how they react to interactions — how they stretch, bend, compress, and move — and they are critical to determining the optimal actions to perform a manipulation task successfully. In other robotic domains, such as legged locomotion and in-hand rigid object manipulation, state-of-the-art approaches can handle unknown dynamics using Rapid Motor Adaptation (RMA). Through a supervised procedure in simulation that encodes each rigid object’s dynamics, such as mass and position, these approaches learn a policy that conditions actions on a vector of latent dynamic parameters inferred from sequences of state-actions.
技術方法: 本文提出的方法:In non-rigid objects, the dynamics parameters define how they react to interactions — how they stretch, bend, compress, and move — and they are critical to determining the optimal actions to perform
Key Takeaway: On a mobile manipulator with 22 degrees of freedom, RAPiD enables over 80%+ success rates across two vision-based deformable object mobile manipulation tasks in the real world, under various object dynamics, categories, and instances.
核心發現: 核心結果:On a mobile manipulator with 22 degrees of freedom, RAPiD enables over 80%+ success rates across two vision-based deformable object mobile manipulation tasks in the real world, under various object dy
DexViTac: Collecting Human Visuo-Tactile-Kinematic Demonstrations for Contact-Rich Dexterous Manipulation
Authors: Xitong Chen, Yifeng Pan, Min Li et al. | Submitted: 2026-03-18 | arXiv: 2603.17851
Categories: cs.RO
Research Background: Large-scale, high-quality multimodal demonstrations are essential for robot learning of contact-rich dexterous manipulation. While human-centric data collection systems lower the barrier to scaling, they struggle to capture the tactile information during physical interactions.
研究背景: 在機器人學習領域,Large-scale, high-quality multimodal demonstrations are essential for robot learning of contact-rich dexterous manipulation. While human-centric data collection systems lower the b
Technical Approach: Motivated by this, we present DexViTac, a portable, human-centric data collection system tailored for contact-rich dexterous manipulation. Building upon this hardware, we propose a kinematics-grounded tactile representation learning algorithm that effectively resolves semantic ambiguities within tactile signals.
技術方法: 本文提出的方法:Motivated by this, we present DexViTac, a portable, human-centric data collection system tailored for contact-rich dexterous manipulation. Building upon this hardware, we propose a kinematics-grounded
Key Takeaway: This performance significantly outperforms baseline methods, thereby validating the substantial improvement the system provides for learning contact-rich dexterous manipulation.
核心發現: 核心結果:This performance significantly outperforms baseline methods, thereby validating the substantial improvement the system provides for learning contact-rich dexterous manipulation.
ProbeFlow: Training-Free Adaptive Flow Matching for Vision-Language-Action Models
Authors: Zhou Fang, Jiaqi Wang, Yi Zhou et al. | Submitted: 2026-03-18 | arXiv: 2603.17850
Categories: cs.RO
Research Background: Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference latency that precludes responsive physical control.
研究背景: 在機器人學習領域,Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step
Technical Approach: To address this, we propose ProbeFlow, a training-free adaptive inference framework tai- lored for continuous robotic control.
技術方法: 本文提出的方法:To address this, we propose ProbeFlow, a training-free adaptive inference framework tai- lored for continuous robotic control.
Key Takeaway: On the MetaWorld benchmark, it accelerates action decoding by 14.8x (reducing average steps from N = 50 to 2.6) and cuts end-to-end system latency by 2.8x without compromising the manipulation success rate.
核心發現: 核心結果:On the MetaWorld benchmark, it accelerates action decoding by 14.8x (reducing average steps from N = 50 to 2.6) and cuts end-to-end system latency by 2.8x without compromising the manipulation success
VolumeDP: Modeling Volumetric Representation for Manipulation Policy Learning
Authors: Tianxing Zhou, Feiyang Xue, Zhangchen Ye et al. | Submitted: 2026-03-18 | arXiv: 2603.17720
Categories: cs.RO
Research Background: Imitation learning is a prominent paradigm for robotic manipulation. However, existing visual imitation methods map 2D image observations directly to 3D action outputs, imposing a 2D-3D mismatch that hinders spatial reasoning and degrades robustness.
研究背景: 在機器人學習領域,Imitation learning is a prominent paradigm for robotic manipulation. However, existing visual imitation methods map 2D image observations directly to 3D action outputs, imposing a
Technical Approach: We present VolumeDP, a policy architecture that restores spatial alignment by explicitly reasoning in 3D.
技術方法: 本文提出的方法:We present VolumeDP, a policy architecture that restores spatial alignment by explicitly reasoning in 3D.
Key Takeaway: Real-world experiments further demonstrate higher success rates and robust generalization to novel spatial layouts, camera viewpoints, and environment backgrounds.
核心發現: 核心結果:Real-world experiments further demonstrate higher success rates and robust generalization to novel spatial layouts, camera viewpoints, and environment backgrounds.
AERR-Nav: Adaptive Exploration-Recovery-Reminiscing Strategy for Zero-Shot Object Navigation
Authors: Jingzhi Huang, Junkai Huang, Haoyang Yang et al. | Submitted: 2026-03-18 | arXiv: 2603.17712
Categories: cs.RO, cs.CV
Research Background: Zero-Shot Object Navigation (ZSON) in unknown multi-floor environments presents a significant challenge. Recent methods, mostly based on semantic value greedy waypoint selection, spatial topology-enhanced memory, and Multimodal Large Language Model (MLLM) as a decision-making framework, have led to improvements.
研究背景: 在機器人學習領域,Zero-Shot Object Navigation (ZSON) in unknown multi-floor environments presents a significant challenge. Recent methods, mostly based on semantic value greedy waypoint selection, s
Technical Approach: To overcome these challenges, we propose AERR-Nav, a Zero-Shot Object Navigation framework that dynamically adjusts its state based on the robot’s environment.
技術方法: 本文提出的方法:To overcome these challenges, we propose AERR-Nav, a Zero-Shot Object Navigation framework that dynamically adjusts its state based on the robot’s environment.
Key Takeaway: Extensive experiments on the HM3D and MP3D benchmarks demonstrate that our AERR-Nav achieves state-of-the-art performance among zero-shot methods.
核心發現: 核心結果:Extensive experiments on the HM3D and MP3D benchmarks demonstrate that our AERR-Nav achieves state-of-the-art performance among zero-shot methods.
AgentVLN: Towards Agentic Vision-and-Language Navigation
Authors: Zihao Xin, Wentong Li, Yixuan Jiang et al. | Submitted: 2026-03-18 | arXiv: 2603.17670
Categories: cs.RO
Research Background: Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding, current VLN systems remain constrained by limited spatial perception, 2D-3D representation mismatch, and monocular scale ambiguity.
研究背景: 在機器人學習領域,Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-La
Technical Approach: In this paper, we propose AgentVLN, a novel and efficient embodied navigation framework that can be deployed on edge computing platforms. We formulate VLN as a Partially Observable Semi-Markov Decision Process (POSMDP) and introduce a VLM-as-Brain paradigm that decouples high-level semantic reasoning from perception and planning via a plug-and-play skill library. To resolve multi-level representation inconsistency, we design a cross-space representation mapping that projects perception-layer 3D topological waypoints into the image plane, yielding pixel-aligned visual prompts for the VLM.
技術方法: 本文提出的方法:In this paper, we propose AgentVLN, a novel and efficient embodied navigation framework that can be deployed on edge computing platforms. We formulate VLN as a Partially Observable Semi-Markov Decisio
Key Takeaway: Extensive experiments show that AgentVLN consistently outperforms prior state-of-the-art methods (SOTA) on long-horizon VLN benchmarks, offering a practical paradigm for lightweight deployment of next-generation embodied navigation models.
核心發現: 核心結果:Extensive experiments show that AgentVLN consistently outperforms prior state-of-the-art methods (SOTA) on long-horizon VLN benchmarks, offering a practical paradigm for lightweight deployment of next
HeiSD: Hybrid Speculative Decoding for Embodied Vision-Language-Action Models with Kinematic Awareness
Authors: Zihao Zheng, Zhihao Mao, Sicheng Tian et al. | Submitted: 2026-03-18 | arXiv: 2603.17573
Categories: cs.RO, cs.DB, cs.LG
Research Background: Vision-Language-Action (VLA) Models have become the mainstream solution for robot control, but suffer from slow inference speeds. Speculative Decoding (SD) is a promising acceleration method which can be divided into two categories: drafter-based SD and retrieval-based SD.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) Models have become the mainstream solution for robot control, but suffer from slow inference speeds. Speculative Decoding (SD) is a promising accelerat
Technical Approach: In this paper, we first conduct a series of detailed analyses to reveal the advantages and feasibility of hybrid utilization. To address these, we propose the HeiSD framework. We propose a retrieval-based SD optimization method in HeiSD, which contains a verify-skip mechanism and a sequence-wise relaxed acceptance strategy.
技術方法: 本文提出的方法:In this paper, we first conduct a series of detailed analyses to reveal the advantages and feasibility of hybrid utilization. To address these, we propose the HeiSD framework. We propose a retrieval-b
Key Takeaway: Experimental results demonstrate that HeiSD attains a speedup of up to 2.45x in simulation benchmarks and 2.06x2.41x in real-world scenarios, while sustaining a high task success rate.2.41x in real-world scenarios, while sustaining a high task success rate.
核心發現: 核心結果:Experimental results demonstrate that HeiSD attains a speedup of up to 2.45x in simulation benchmarks and 2.06x
KineVLA: Towards Kinematics-Aware Vision-Language-Action Models with Bi-Level Action Decomposition
Authors: Gaoge Han, Zhengqing Gao, Ziwen Li et al. | Submitted: 2026-03-18 | arXiv: 2603.17524
Categories: cs.RO, cs.AI
Research Background: In this paper, we introduce a novel kinematics-rich vision-language-action (VLA) task, in which language commands densely encode diverse kinematic attributes (such as direction, trajectory, orientation, and relative displacement) from initiation through completion, at key moments, unlike existing action instructions that capture kinematics only coarsely or partially, thereby supporting fine-grained and personalized manipulation. In this setting, where task goals remain invariant while execution trajectories must adapt to instruction-level kinematic specifications.
研究背景: 在機器人學習領域,In this paper, we introduce a novel kinematics-rich vision-language-action (VLA) task, in which language commands densely encode diverse kinematic attributes (such as direction, tr
Technical Approach: In this paper, we introduce a novel kinematics-rich vision-language-action (VLA) task, in which language commands densely encode diverse kinematic attributes (such as direction, trajectory, orientation, and relative displacement) from initiation through completion, at key moments, unlike existing action instructions that capture kinematics only coarsely or partially, thereby supporting fine-grained and personalized manipulation. To address this challenge, we propose KineVLA, a vision-language-action framework that explicitly decouples goal-level invariance from kinematics-level variability through a bi-level action representation and bi-level reasoning tokens to serve as explicit, supervised intermediate variables that align language and action.
技術方法: 本文提出的方法:In this paper, we introduce a novel kinematics-rich vision-language-action (VLA) task, in which language commands densely encode diverse kinematic attributes (such as direction, trajectory, orientatio
Key Takeaway: Extensive experiments on LIBERO and a Realman-75 robot demonstrate that KineVLA consistently outperforms strong VLA baselines on kinematics-sensitive benchmarks, achieving more precise, controllable, and generalizable manipulation behaviors.
核心發現: 核心結果:Extensive experiments on LIBERO and a Realman-75 robot demonstrate that KineVLA consistently outperforms strong VLA baselines on kinematics-sensitive benchmarks, achieving more precise, controllable,
Action Draft and Verify: A Self-Verifying Framework for Vision-Language-Action Model
Authors: Chen Zhao, Zhuoran Wang, Haoyang Li et al. | Submitted: 2026-03-18 | arXiv: 2603.18091
Categories: cs.CV, cs.RO
Research Background: Vision-Language-Action (VLA) models have recently demonstrated strong performance across embodied tasks. Modern VLAs commonly employ diffusion action experts to efficiently generate high-precision continuous action chunks, while auto-regressive generation can be slower and less accurate at low-level control.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have recently demonstrated strong performance across embodied tasks. Modern VLAs commonly employ diffusion action experts to efficiently generat
Technical Approach: To leverage both paradigms, we propose Action-Draft-and-Verify (ADV): diffusion action expert drafts multiple candidate action chunks, and the VLM selects one by scoring all candidates in a single forward pass with a perplexity-style metric.
技術方法: 本文提出的方法:To leverage both paradigms, we propose Action-Draft-and-Verify (ADV): diffusion action expert drafts multiple candidate action chunks, and the VLM selects one by scoring all candidates in a single for
Key Takeaway: Under matched backbones, training data, and action-chunk length, ADV improves success rate by +4.3 points in simulation and +19.7 points in real-world over diffusion-based baseline, with a single-pass VLM reranking overhead.
核心發現: 核心結果:Under matched backbones, training data, and action-chunk length, ADV improves success rate by +4.3 points in simulation and +19.7 points in real-world over diffusion-based baseline, with a single-pass
Interpreting Context-Aware Human Preferences for Multi-Objective Robot Navigation
Authors: Tharun Sethuraman, Subham Agrawal, Nils Dengler et al. | Submitted: 2026-03-18 | arXiv: 2603.17510
Categories: cs.RO
Research Background: Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt their behavior to human preferences. However, as human preferences are typically expressed in natural language and depend on environmental context, it is difficult to directly integrate them into low-level robot control policies.
研究背景: 在機器人學習領域,Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt their behavior to human preferenc
Technical Approach: In this work, we present a pipeline that enables robots to understand and apply context-dependent navigation preferences by combining foundational models with a Multi-Objective Reinforcement Learning (MORL) navigation policy. Thus, our approach integrates high-level semantic reasoning with low-level motion control.
技術方法: 本文提出的方法:In this work, we present a pipeline that enables robots to understand and apply context-dependent navigation preferences by combining foundational models with a Multi-Objective Reinforcement Learning
Key Takeaway: Overall, the proposed pipeline improves the adaptability, transparency, and usability of robots operating in shared human environments, while maintaining safe and responsive real-time control.
核心發現: 核心結果:Overall, the proposed pipeline improves the adaptability, transparency, and usability of robots operating in shared human environments, while maintaining safe and responsive real-time control.
PNav: End-to-End Perception, Prediction and Planning for Vision-and-Language Navigation
Authors: Tianfu Li, Wenbo Chen, Haoxuan Xu et al. | Submitted: 2026-03-18 | arXiv: 2603.17459
Categories: cs.RO
Research Background: In Vision-and-Language Navigation (VLN), an agent is required to plan a path to the target specified by the language instruction, using its visual observations. Consequently, prevailing VLN methods primarily focus on building powerful planners through visual-textual alignment.
研究背景: 在機器人學習領域,In Vision-and-Language Navigation (VLN), an agent is required to plan a path to the target specified by the language instruction, using its visual observations. Consequently, preva
Technical Approach: Thus, we propose PNav, a novel end-to-end framework integrating perception, prediction, and planning in a unified pipeline to strengthen the VLN agent’s scene understanding and boost navigation success.
技術方法: 本文提出的方法:Thus, we propose PNav, a novel end-to-end framework integrating perception, prediction, and planning in a unified pipeline to strengthen the VLN agent’s scene understanding and boost navigation
Key Takeaway: Extensive experiments demonstrate that our PNav achieves new state-of-the-art performance on the REVERIE, R2R-CE, and RxR-CE benchmarks.
核心發現: 核心結果:Extensive experiments demonstrate that our PNav achieves new state-of-the-art performance on the REVERIE, R2R-CE, and RxR-CE benchmarks.
Speculative Policy Orchestration: A Latency-Resilient Framework for Cloud-Robotic Manipulation
Authors: Chanh Nguyen, Shutong Jin, Florian T. Pokorny et al. | Submitted: 2026-03-19 | arXiv: 2603.19418
Categories: cs.RO, cs.DC
Research Background: Cloud robotics enables robots to offload high-dimensional motion planning and reasoning to remote servers. However, for continuous manipulation tasks requiring high-frequency control, network latency and jitter can severely destabilize the system, causing command starvation and unsafe physical execution.
研究背景: 在機器人學習領域,Cloud robotics enables robots to offload high-dimensional motion planning and reasoning to remote servers. However, for continuous manipulation tasks requiring high-frequency contr
Technical Approach: To address this, we propose Speculative Policy Orchestration (SPO), a latency-resilient cloud-edge framework.
技術方法: 本文提出的方法:To address this, we propose Speculative Policy Orchestration (SPO), a latency-resilient cloud-edge framework.
Key Takeaway: Results show that even when deployed with learned models of modest accuracy, SPO reduces network-induced idle time by over 60% compared to blocking remote inference.
核心發現: 核心結果:Results show that even when deployed with learned models of modest accuracy, SPO reduces network-induced idle time by over 60% compared to blocking remote inference.
Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models
Authors: Bryce Grant, Xijia Zhao, Peng Wang | Submitted: 2026-03-19 | arXiv: 2603.19233
Categories: cs.RO
Research Background: Vision-Language-Action (VLA) models combine perception, language, and motor control in a single architecture, yet how they translate multimodal inputs into actions remains poorly understood. We apply activation injection, sparse autoencoders (SAEs), and linear probes to six models spanning 80M—7B parameters across 394,000+ rollout episodes on four benchmarks.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models combine perception, language, and motor control in a single architecture, yet how they translate multimodal inputs into actions remains poorly u
Technical Approach: We apply activation injection, sparse autoencoders (SAEs), and linear probes to six models spanning 80M—7B parameters across 394,000+ rollout episodes on four benchmarks. The visual pathway dominates action generation across all architectures: injecting baseline activations into null-prompt episodes recovers near-identical behavior, while cross-task injection steers robots toward source-task positions (99.8% of X-VLA episodes align with the source trajectory), exposing spatially bound motor programs tied to scene coordinates rather than abstract task representations. Language sensitivity depends on task structure, not model design: when visual context uniquely specifies the task, language is ignored; when multiple goals share a scene, language becomes essential (X-VLA \texttt{libero_goal}: 94%10% under wrong prompts vs.\ \texttt{libero_object}: 60—100% regardless).
技術方法: 本文提出的方法:We apply activation injection, sparse autoencoders (SAEs), and linear probes to six models spanning 80M—7B parameters across 394,000+ rollout episodes on four benchmarks. The visual pathway dominates
Key Takeaway: Per-token SAE processing is essential for action fidelity on most architectures, though mean-pooling improves fidelity on X-VLA.
核心發現: 核心結果:Per-token SAE processing is essential for action fidelity on most architectures, though mean-pooling improves fidelity on X-VLA.
NavTrust: Benchmarking Trustworthiness for Embodied Navigation
Authors: Huaide Jiang, Yash Chaudhary, Yuping Wang et al. | Submitted: 2026-03-19 | arXiv: 2603.19229
Categories: cs.RO, cs.AI, cs.CV, cs.LG, eess.SY
Research Background: There are two major categories of embodied navigation: Vision-Language Navigation (VLN), where agents navigate by following natural language instructions; and Object-Goal Navigation (OGN), where agents navigate to a specified target object. However, existing work primarily evaluates model performance under nominal conditions, overlooking the potential corruptions that arise in real-world settings.
研究背景: 在機器人學習領域,There are two major categories of embodied navigation: Vision-Language Navigation (VLN), where agents navigate by following natural language instructions; and Object-Goal Navigatio
Technical Approach: To address this gap, we present NavTrust, a unified benchmark that systematically corrupts input modalities, including RGB, depth, and instructions, in realistic scenarios and evaluates their impact on navigation performance.
技術方法: 本文提出的方法:To address this gap, we present NavTrust, a unified benchmark that systematically corrupts input modalities, including RGB, depth, and instructions, in realistic scenarios and evaluates their impact o
Key Takeaway: Furthermore, we systematically evaluate four distinct mitigation strategies to enhance robustness against RGB-Depth and instructions corruptions.
核心發現: 核心結果:Furthermore, we systematically evaluate four distinct mitigation strategies to enhance robustness against RGB-Depth and instructions corruptions.
OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation
Authors: Yuhang Zheng, Songen Gu, Weize Li et al. | Submitted: 2026-03-19 | arXiv: 2603.19201
Categories: cs.RO
Research Background: Contact-rich manipulation tasks, such as wiping and assembly, require accurate perception of contact forces, friction changes, and state transitions that cannot be reliably inferred from vision alone. Despite growing interest in visuo-tactile manipulation, progress is constrained by two persistent limitations: existing datasets are small in scale and narrow in task coverage, and current methods treat tactile signals as passive observations rather than using them to model contact dynamics or enable closed-loop control explicitly.
研究背景: 在機器人學習領域,Contact-rich manipulation tasks, such as wiping and assembly, require accurate perception of contact forces, friction changes, and state transitions that cannot be reliably inferre
Technical Approach: In this paper, we present \textbf{OmniViTac}, a large-scale visuo-tactile-action dataset comprising trajectories across tasks and objects, organized into six physics-grounded interaction patterns. Building on this dataset, we propose \textbf{OmniVTA}, a world-model-based visuo-tactile manipulation framework that integrates four tightly coupled modules: a self-supervised tactile encoder, a two-stream visuo-tactile world model for predicting short-horizon contact evolution, a contact-aware fusion policy for action generation, and a 60Hz reflexive controller that corrects deviations between predicted and observed tactile signals in a closed loop.
技術方法: 本文提出的方法:In this paper, we present \textbf{OmniViTac}, a large-scale visuo-tactile-action dataset comprising trajectories across tasks and objects, organized into six physics-grounded i
Key Takeaway: Real-robot experiments across all six interaction categories show that OmniVTA outperforms existing methods and generalizes well to unseen objects and geometric configurations, confirming the value of combining predictive contact modeling with high-frequency tactile feedback for contact-rich manipulation.
核心發現: 核心結果:Real-robot experiments across all six interaction categories show that OmniVTA outperforms existing methods and generalizes well to unseen objects and geometric configurations, confirming the value of
FASTER: Rethinking Real-Time Flow VLAs
Authors: Yuxiang Lu, Zhe Liu, Xianzhe Fan et al. | Submitted: 2026-03-19 | arXiv: 2603.19199
Categories: cs.RO, cs.CV
Research Background: Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world. Existing asynchronous inference methods primarily optimize trajectory smoothness, but neglect the critical latency in reacting to environmental changes.
研究背景: 在機器人學習領域,Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world. Existing asynchronous inference methods primarily optimize trajectory smooth
Technical Approach: By rethinking the notion of reaction in action chunking policies, this paper presents a systematic analysis of the factors governing reaction time. To overcome this issue, we propose Fast Action Sampling for ImmediaTE Reaction (FASTER).
技術方法: 本文提出的方法:By rethinking the notion of reaction in action chunking policies, this paper presents a systematic analysis of the factors governing reaction time. To overcome this issue, we propose Fast Action Sampl
Key Takeaway: Real-world experiments, including a highly dynamic table tennis task, prove that FASTER unlocks substantially improved real-time responsiveness for generalist policies, enabling rapid generation of accurate and smooth trajectories.
核心發現: 核心結果:Real-world experiments, including a highly dynamic table tennis task, prove that FASTER unlocks substantially improved real-time responsiveness for generalist policies, enabling rapid generation of ac
Sparse Autoencoders Reveal Interpretable and Steerable Features in VLA Models
Authors: Aiden Swann, Lachlain McGranahan, Hugo Buurmeijer et al. | Submitted: 2026-03-19 | arXiv: 2603.19183
Categories: cs.RO
Research Background: Vision-Language-Action (VLA) models have emerged as a promising approach for general-purpose robot manipulation. However, their generalization is inconsistent: while these models can perform impressively in some settings, fine-tuned variants often fail on novel objects, scenes, and instructions.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have emerged as a promising approach for general-purpose robot manipulation. However, their generalization is inconsistent: while these models c
Technical Approach: We propose a metric to categorize features according to whether they represent generalizable transferable primitives or episode-specific memorization.
技術方法: 本文提出的方法:We propose a metric to categorize features according to whether they represent generalizable transferable primitives or episode-specific memorization.
Key Takeaway: We show that individual SAE features causally influence robot behavior.
核心發現: 核心結果:We show that individual SAE features causally influence robot behavior.
ADMM-Based Distributed MPC with Control Barrier Functions for Safe Multi-Robot Quadrupedal Locomotion
Authors: Yicheng Zeng, Ruturaj S. Sambhus, Basit Muhammad Imran et al. | Submitted: 2026-03-19 | arXiv: 2603.19170
Categories: cs.RO, math.OC
Research Background: This paper proposes a fully decentralized model predictive control (MPC) framework with control barrier function (CBF) constraints for safety-critical trajectory planning in multi-robot legged systems. The incorporation of CBF constraints introduces explicit inter-agent coupling, which prevents direct decomposition of the resulting optimal control problems.
研究背景: 在機器人學習領域,This paper proposes a fully decentralized model predictive control (MPC) framework with control barrier function (CBF) constraints for safety-critical trajectory planning in multi-
Technical Approach: This paper proposes a fully decentralized model predictive control (MPC) framework with control barrier function (CBF) constraints for safety-critical trajectory planning in multi-robot legged systems.
技術方法: 本文提出的方法:This paper proposes a fully decentralized model predictive control (MPC) framework with control barrier function (CBF) constraints for safety-critical trajectory planning in multi-robot legged systems
Key Takeaway: The results show that the proposed distributed formulation achieves performance comparable to centralized MPC while reducing the average per-cycle planning time by up to 51% in the four-agent case, enabling efficient real-time decentralized implementation.
核心發現: 核心結果:The results show that the proposed distributed formulation achieves performance comparable to centralized MPC while reducing the average per-cycle planning time by up to 51% in the four-agent case, en
Introducing M: A Modular, Modifiable Social Robot
Authors: Victor Nikhil Antony, Zhili Gong, Yoonjae Kim et al. | Submitted: 2026-03-19 | arXiv: 2603.19134
Categories: cs.RO, cs.HC
Research Background: We present M, an open-source, low-cost social robot platform designed to reduce platform friction that slows social robotics research by making robots easier to reproduce, modify, and deploy in real-world settings. M combines a modular mechanical design, multimodal sensing, and expressive yet mechanically simple actuation architecture with a ROS2-native software package that cleanly separates perception, expression control, and data management.
研究背景: 在機器人學習領域,We present M, an open-source, low-cost social robot platform designed to reduce platform friction that slows social robotics research by making robots easier to reproduce, modify,
Technical Approach: We present M, an open-source, low-cost social robot platform designed to reduce platform friction that slows social robotics research by making robots easier to reproduce, modify, and deploy in real-world settings.
技術方法: 本文提出的方法:We present M, an open-source, low-cost social robot platform designed to reduce platform friction that slows social robotics research by making robots easier to reproduce, modify, and deploy in real-w
Key Takeaway: We demonstrate extensibility through additional sensing/actuation modules and provide example interaction templates for storytelling and two-way conversational coaching.
核心發現: 核心結果:We demonstrate extensibility through additional sensing/actuation modules and provide example interaction templates for storytelling and two-way conversational coaching.
From Inference Efficiency to Embodied Efficiency: Revisiting Efficiency Metrics for Vision-Language-Action Models
Authors: Zhuofan Li, Hongkun Yang, Zhenyang Chen et al. | Submitted: 2026-03-19 | arXiv: 2603.19131
Categories: cs.LG, cs.RO
Research Background: Vision-Language-Action (VLA) models have recently enabled embodied agents to perform increasingly complex tasks by jointly reasoning over visual, linguistic, and motor modalities. However, we find that the prevailing notion of “efficiency” in current VLA research, characterized by parameters, FLOPs, or token decoding throughput, does not reflect actual performance on robotic platforms.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have recently enabled embodied agents to perform increasingly complex tasks by jointly reasoning over visual, linguistic, and motor modalities.
Technical Approach: However, we find that the prevailing notion of efficiency'' in current VLA research, characterized by parameters, FLOPs, or token decoding throughput, does not reflect actual performance on robotic platforms. In real-world execution, efficiency is determined by system-level embodied behaviors such as task completion time, trajectory smoothness, cumulative joint rotation, and motion energy. Through controlled studies across model compression, token sparsification, and action sequence compression, we make several observations that challenge common assumptions. **技術方法:** 本文提出的方法:However, we find that the prevailing notion of efficiency” in current VLA research, characterized by parameters, FLOPs, or token decoding throughput, does not reflect actual performance on robotic
Key Takeaway: Taken together, our results suggest that conventional inference efficiency metrics can overlook important aspects of embodied execution.
核心發現: 核心結果:Taken together, our results suggest that conventional inference efficiency metrics can overlook important aspects of embodied execution.
Articulated-Body Dynamics Network: Dynamics-Grounded Prior for Robot Learning
Authors: Sangwoo Shin, Kunzhao Ren, Xiaobin Xiong et al. | Submitted: 2026-03-19 | arXiv: 2603.19078
Categories: cs.RO
Research Background: Recent work in reinforcement learning has shown that incorporating structural priors for articulated robots, such as link connectivity, into policy networks improves learning efficiency. However, dynamics properties, despite their fundamental role in determining how forces and motion propagate through the body, remain largely underexplored as an inductive bias for policy learning.
研究背景: 在機器人學習領域,Recent work in reinforcement learning has shown that incorporating structural priors for articulated robots, such as link connectivity, into policy networks improves learning effic
Technical Approach: To address this gap, we present the Articulated-Body Dynamics Network (ABD-Net), a novel graph neural network architecture grounded in the computational structure of forward dynamics. Through experiments with simulated humanoid, quadruped, and hopper robots, our approach demonstrates increased sample efficiency and generalization to dynamics shifts compared to transformer-based and GNN baselines.
技術方法: 本文提出的方法:To address this gap, we present the Articulated-Body Dynamics Network (ABD-Net), a novel graph neural network architecture grounded in the computational structure of forward dynamics. Through experime
Key Takeaway: We further validate the learned policy on real Unitree G1 and Go2 robots, state-of-the-art humanoid and quadruped platforms, generating dynamic, versatile and robust locomotion behaviors through sim-to-real transfer with real-time inference.
核心發現: 核心結果:We further validate the learned policy on real Unitree G1 and Go2 robots, state-of-the-art humanoid and quadruped platforms, generating dynamic, versatile and robust locomotion behaviors through sim-t
MERGE: Guided Vision-Language Models for Multi-Actor Event Reasoning and Grounding in Human-Robot Interaction
Authors: Joerg Deigmoeller, Nakul Agarwal, Stephan Hasler et al. | Submitted: 2026-03-19 | arXiv: 2603.18988
Categories: cs.RO
Research Background: We introduce MERGE, a system for situational grounding of actors, objects, and events in dynamic human-robot group interactions. Effective collaboration in such settings requires consistent situational awareness, built on persistent representations of people and objects and an episodic abstraction of events.
研究背景: 在機器人學習領域,We introduce MERGE, a system for situational grounding of actors, objects, and events in dynamic human-robot group interactions. Effective collaboration in such settings requires c
Technical Approach: We introduce MERGE, a system for situational grounding of actors, objects, and events in dynamic human-robot group interactions. To address the absence of suitable benchmarks for multi-actor collaboration, we introduce the GROUND dataset, which offers fine-grained situational annotations of multi-person and human-robot interactions. On this dataset, our approach improves the average grounding score by a factor of 2 compared to the performance of VLM-only baselines - including GPT-4o, GPT-5 and Gemini 2.5 Flash - while also reducing run-time by a factor of 4.
技術方法: 本文提出的方法:We introduce MERGE, a system for situational grounding of actors, objects, and events in dynamic human-robot group interactions. To address the absence of suitable benchmarks for multi-actor collabora
Key Takeaway: On this dataset, our approach improves the average grounding score by a factor of 2 compared to the performance of VLM-only baselines - including GPT-4o, GPT-5 and Gemini 2.5 Flash - while also reducing run-time by a factor of 4.
核心發現: 核心結果:On this dataset, our approach improves the average grounding score by a factor of 2 compared to the performance of VLM-only baselines - including GPT-4o, GPT-5 and Gemini 2.5 Flash - while also reduci
Safety-Guaranteed Imitation Learning from Nonlinear Model Predictive Control for Spacecraft Close Proximity Operations
Authors: Alexander Meinert, Niklas Baldauf, Peter Stadler et al. | Submitted: 2026-03-19 | arXiv: 2603.18910
Categories: cs.RO, eess.SY
Research Background: This paper presents a safety-guaranteed, runtime-efficient imitation learning framework for spacecraft close proximity control. We leverage Control Barrier Functions (CBFs) for safety certificates and Control Lyapunov Functions (CLFs) for stability as unified design principles across data generation, training, and deployment.
研究背景: 在機器人學習領域,This paper presents a safety-guaranteed, runtime-efficient imitation learning framework for spacecraft close proximity control. We leverage Control Barrier Functions (CBFs) for saf
Technical Approach: This paper presents a safety-guaranteed, runtime-efficient imitation learning framework for spacecraft close proximity control. We leverage Control Barrier Functions (CBFs) for safety certificates and Control Lyapunov Functions (CLFs) for stability as unified design principles across data generation, training, and deployment.
技術方法: 本文提出的方法:This paper presents a safety-guaranteed, runtime-efficient imitation learning framework for spacecraft close proximity control. We leverage Control Barrier Functions (CBFs) for safety certificates and
Key Takeaway: A runtime analysis demonstrates real-time feasibility on a commercial off-the-shelf processor, supporting onboard deployment for safety-critical on-orbit servicing.
核心發現: 核心結果:A runtime analysis demonstrates real-time feasibility on a commercial off-the-shelf processor, supporting onboard deployment for safety-critical on-orbit servicing.
”You’ve got a friend in me”: Co-Designing a Peer Social Robot for Young Newcomers’ Language and Cultural Learning
Authors: Neil Fernandes, Cheng Tang, Tehniyat Shahbaz et al. | Submitted: 2026-03-19 | arXiv: 2603.18804
Categories: cs.RO, cs.HC
Research Background: Community literacy programs supporting young newcomer children in Canada face limited staffing and scarce one-to-one time, which constrains personalized English and cultural learning support. This paper reports on a co-design study with United for Literacy tutors that informed Maple, a table-top, peer-like Socially Assistive Robot (SAR) designed as a practice partner within tutor-mediated sessions.
研究背景: 在機器人學習領域,Community literacy programs supporting young newcomer children in Canada face limited staffing and scarce one-to-one time, which constrains personalized English and cultural learni
Technical Approach: This paper reports on a co-design study with United for Literacy tutors that informed Maple, a table-top, peer-like Socially Assistive Robot (SAR) designed as a practice partner within tutor-mediated sessions.
技術方法: 本文提出的方法:This paper reports on a co-design study with United for Literacy tutors that informed Maple, a table-top, peer-like Socially Assistive Robot (SAR) designed as a practice partner within tutor-mediated
Key Takeaway: We contribute system design implications for tutor-in-the-loop SARs supporting language socialization in community settings and outline directions for child-centered evaluation in authentic programs.
核心發現: 核心結果:We contribute system design implications for tutor-in-the-loop SARs supporting language socialization in community settings and outline directions for child-centered evaluation in authentic programs.
ViTac-Tracing: Visual-Tactile Imitation Learning of Deformable Object Tracing
Authors: Yongqiang Zhao, Haining Luo, Yupeng Wang et al. | Submitted: 2026-03-19 | arXiv: 2603.18784
Categories: cs.RO
Research Background: Deformable objects often appear in unstructured configurations. Tracing deformable objects helps bringing them into extended states and facilitating the downstream manipulation tasks.
研究背景: 在機器人學習領域,Deformable objects often appear in unstructured configurations. Tracing deformable objects helps bringing them into extended states and facilitating the downstream manipulation tas
Technical Approach: To address this, we propose a novel visual-tactile imitation learning method to achieve one-dimensional (1D) and two-dimensional (2D) deformable object tracing with a unified model. Our method is designed from both local and global perspectives based on visual and tactile sensing. Locally, we introduce a weighted loss that emphasizes actions maintaining contact near the center of the tactile image, improving fine-grained adjustment.
技術方法: 本文提出的方法:To address this, we propose a novel visual-tactile imitation learning method to achieve one-dimensional (1D) and two-dimensional (2D) deformable object tracing with a unified model. Our method is desi
Key Takeaway: Extensive ablation and comparative experiments on diverse 1D and 2D deformable objects demonstrate the effectiveness of our approach, achieving an average success rate of 80% on seen objects and 65% on unseen objects.
核心發現: 核心結果:Extensive ablation and comparative experiments on diverse 1D and 2D deformable objects demonstrate the effectiveness of our approach, achieving an average success rate of 80% on seen objects and 65% o
Scaling Sim-to-Real Reinforcement Learning for Robot VLAs with Generative 3D Worlds
Authors: Andrew Choi, Xinjie Wang, Zhizhong Su et al. | Submitted: 2026-03-19 | arXiv: 2603.18532
Categories: cs.RO, cs.AI, cs.LG
Research Background: The strong performance of large vision-language models (VLMs) trained with reinforcement learning (RL) has motivated similar approaches for fine-tuning vision-language-action (VLA) models in robotics. Many recent works fine-tune VLAs directly in the real world to avoid addressing the sim-to-real gap.
研究背景: 在機器人學習領域,The strong performance of large vision-language models (VLMs) trained with reinforcement learning (RL) has motivated similar approaches for fine-tuning vision-language-action (VLA)
Technical Approach: Starting from a pretrained imitation baseline, our approach increases simulation success from 9.7% to 79.8% while achieving a 1.25 speedup in task completion time.
技術方法: 本文提出的方法:Starting from a pretrained imitation baseline, our approach increases simulation success from 9.7% to 79.8% while achieving a 1.25 speedup in task completion time.
Key Takeaway: Finally, we further highlight the benefits of leveraging the effectively unlimited data from 3D world generative models through an ablation study showing that increasing scene diversity directly improves zero-shot generalization.
核心發現: 核心結果:Finally, we further highlight the benefits of leveraging the effectively unlimited data from 3D world generative models through an ablation study showing that increasing scene diversity directly impro
MemoAct: Atkinson-Shiffrin-Inspired Memory-Augmented Visuomotor Policy for Robotic Manipulation
Authors: Liufan Tan, Jiale Li, Gangshan Jing | Submitted: 2026-03-19 | arXiv: 2603.18494
Categories: cs.RO
Research Background: Memory-augmented robotic policies are essential in handling memory-dependent tasks. However, existing approaches typically rely on simple observation window extensions, struggling to simultaneously achieve precise task state tracking and robust long-horizon retention.
研究背景: 在機器人學習領域,Memory-augmented robotic policies are essential in handling memory-dependent tasks. However, existing approaches typically rely on simple observation window extensions, struggling
Technical Approach: To overcome these challenges, inspired by the Atkinson-Shiffrin memory model, we propose MemoAct, a hierarchical memory-based policy that leverages distinct memory tiers to tackle specific bottlenecks.
技術方法: 本文提出的方法:To overcome these challenges, inspired by the Atkinson-Shiffrin memory model, we propose MemoAct, a hierarchical memory-based policy that leverages distinct memory tiers to tackle specific bottlenecks
Key Takeaway: Extensive experiments across simulated and real-world scenarios demonstrate that MemoAct achieves superior performance compared to both existing Markovian baselines and history-aware policies.
核心發現: 核心結果:Extensive experiments across simulated and real-world scenarios demonstrate that MemoAct achieves superior performance compared to both existing Markovian baselines and history-aware policies.
Efficient and Versatile Quadrupedal Skating: Optimal Co-design via Reinforcement Learning and Bayesian Optimization
Authors: Hanwen Wang, Zhenlong Fang, Josiah Hanna et al. | Submitted: 2026-03-19 | arXiv: 2603.18408
Categories: cs.RO
Research Background: In this paper, we present a hardware-control co-design approach that enables efficient and versatile roller skating on quadrupedal robots equipped with passive wheels. Passive-wheel skating reduces leg inertia and improves energy efficiency, particularly at high speeds.
研究背景: 在機器人學習領域,In this paper, we present a hardware-control co-design approach that enables efficient and versatile roller skating on quadrupedal robots equipped with passive wheels. Passive-whee
Technical Approach: In this paper, we present a hardware-control co-design approach that enables efficient and versatile roller skating on quadrupedal robots equipped with passive wheels. To unlock the full potential of this modality, we formulate a bilevel optimization framework: an upper-level Bayesian Optimization searches the mechanical design space, while a lower-level Reinforcement Learning trains a motor control policy for each candidate design.
技術方法: 本文提出的方法:In this paper, we present a hardware-control co-design approach that enables efficient and versatile roller skating on quadrupedal robots equipped with passive wheels. To unlock the full potential of
Key Takeaway: The resulting design-policy pairs not only outperform human-engineered baselines, but also exhibit versatile behaviors such as hockey stop (rapid braking by turning sideways to maximize friction) and self-aligning motion (automatic reorientation to improve energy efficiency in the direction of travel), offering the first system-level study of dynamic skating motion on quadrupedal robots.
核心發現: 核心結果:The resulting design-policy pairs not only outperform human-engineered baselines, but also exhibit versatile behaviors such as hockey stop (rapid braking by turning sideways to maximize friction) and
AcceRL: A Distributed Asynchronous Reinforcement Learning and World Model Framework for Vision-Language-Action Models
Authors: Chengxuan Lu, Shukuan Wang, Yanjie Li et al. | Submitted: 2026-03-19 | arXiv: 2603.18464
Categories: cs.LG
Research Background: Reinforcement learning (RL) for large-scale Vision-Language-Action (VLA) models faces significant challenges in computational efficiency and data acquisition. We propose AcceRL, a fully asynchronous and decoupled RL framework designed to eliminate synchronization barriers by physically isolating training, inference, and rollouts.
研究背景: 在機器人學習領域,Reinforcement learning (RL) for large-scale Vision-Language-Action (VLA) models faces significant challenges in computational efficiency and data acquisition. We propose AcceRL, a
Technical Approach: We propose AcceRL, a fully asynchronous and decoupled RL framework designed to eliminate synchronization barriers by physically isolating training, inference, and rollouts.
技術方法: 本文提出的方法:We propose AcceRL, a fully asynchronous and decoupled RL framework designed to eliminate synchronization barriers by physically isolating training, inference, and rollouts.
Key Takeaway: Experiments on the LIBERO~\cite{liu2023libero} benchmark demonstrate that AcceRL achieves state-of-the-art (SOTA) performance.
核心發現: 核心結果:Experiments on the LIBERO~\cite{liu2023libero} benchmark demonstrate that AcceRL achieves state-of-the-art (SOTA) performance.
Multi-Robot Learning-Informed Task Planning Under Uncertainty
Authors: Abhish Khanal, Abhishek Paudel, Hung Pham et al. | Submitted: 2026-03-20 | arXiv: 2603.20544
Categories: cs.RO, cs.MA
Research Background: We want a multi-robot team to complete complex tasks in minimum time where the locations of task-relevant objects are not known. Effective task completion requires reasoning over long horizons about the likely locations of task-relevant objects, how individual actions contribute to overall progress, and how to coordinate team efforts.
研究背景: 在機器人學習領域,We want a multi-robot team to complete complex tasks in minimum time where the locations of task-relevant objects are not known. Effective task completion requires reasoning over l
Technical Approach: To address this, we propose a multi-robot planning abstraction that integrates learning to estimate uncertain aspects of the environment with model-based planning for long-horizon coordination. We demonstrate the efficient multi-stage task planning of our approach for 1, 2, and 3 robot teams over competitive baselines in large ProcTHOR household environments. Additionally, we demonstrate the effectiveness of our approach with a team of two LoCoBot mobile robots in real household settings.
技術方法: 本文提出的方法:To address this, we propose a multi-robot planning abstraction that integrates learning to estimate uncertain aspects of the environment with model-based planning for long-horizon coordination. We dem
Key Takeaway: Additionally, we demonstrate the effectiveness of our approach with a team of two LoCoBot mobile robots in real household settings.
核心發現: 核心結果:Additionally, we demonstrate the effectiveness of our approach with a team of two LoCoBot mobile robots in real household settings.
AGILE: A Comprehensive Workflow for Humanoid Loco-Manipulation Learning
Authors: Huihua Zhao, Rafael Cathomen, Lionel Gulich et al. | Submitted: 2026-03-20 | arXiv: 2603.20147
Categories: cs.RO
Research Background: Recent advances in reinforcement learning (RL) have enabled impressive humanoid behaviors in simulation, yet transferring these results to new robots remains challenging. In many real deployments, the primary bottleneck is no longer simulation throughput or algorithm design, but the absence of systematic infrastructure that links environment verification, training, evaluation, and deployment in a coherent loop.
研究背景: 在機器人學習領域,Recent advances in reinforcement learning (RL) have enabled impressive humanoid behaviors in simulation, yet transferring these results to new robots remains challenging. In many r
Technical Approach: To address this gap, we present AGILE, an end-to-end workflow for humanoid RL that standardizes the policy-development lifecycle to mitigate common sim-to-real failure modes.
技術方法: 本文提出的方法:To address this gap, we present AGILE, an end-to-end workflow for humanoid RL that standardizes the policy-development lifecycle to mitigate common sim-to-real failure modes.
Key Takeaway: For evaluation stage, AGILE supports both scenario-based tests and randomized rollouts under a shared suite of motion-quality diagnostics, enabling automated regression testing and principled robustness assessment.
核心發現: 核心結果:For evaluation stage, AGILE supports both scenario-based tests and randomized rollouts under a shared suite of motion-quality diagnostics, enabling automated regression testing and principled robustne
KUKAloha: A General, Low-Cost, and Shared-Control based Teleoperation Framework for Construction Robot Arm
Authors: Yifan Xu, Qizhang Shen, Vineet Kamat et al. | Submitted: 2026-03-20 | arXiv: 2603.20129
Categories: cs.RO
Research Background: This paper presents KUKAloha, a general, low-cost, and shared-control teleoperation framework designed for construction robot arms. The proposed system employs a leader-follower paradigm in which a lightweight leading arm enables intuitive human guidance for coarse robot motion, while an autonomous perception module based on AprilTag detection performs precise alignment and grasp execution.
研究背景: 在機器人學習領域,This paper presents KUKAloha, a general, low-cost, and shared-control teleoperation framework designed for construction robot arms. The proposed system employs a leader-follower pa
Technical Approach: This paper presents KUKAloha, a general, low-cost, and shared-control teleoperation framework designed for construction robot arms.
技術方法: 本文提出的方法:This paper presents KUKAloha, a general, low-cost, and shared-control teleoperation framework designed for construction robot arms.
Key Takeaway: Experimental results demonstrate that KUKAloha reduces operator workload, improves task completion efficiency, and provides a practical solution for scalable demonstration collection and shared human-robot control in construction environments.
核心發現: 核心結果:Experimental results demonstrate that KUKAloha reduces operator workload, improves task completion efficiency, and provides a practical solution for scalable demonstration collection and shared human-
Evolving Embodied Intelligence: Graph Neural Network—Driven Co-Design of Morphology and Control in Soft Robotics
Authors: Jianqiang Wang, Shuaiqun Pan, Alvaro Serra-Gomez et al. | Submitted: 2026-03-20 | arXiv: 2603.19582
Categories: cs.RO, cs.AI
Research Background: The intelligent behavior of robots does not emerge solely from control systems, but from the tight coupling between body and brain, a principle known as embodied intelligence. Designing soft robots that leverage this interaction remains a significant challenge, particularly when morphology and control require simultaneous optimization.
研究背景: 在機器人學習領域,The intelligent behavior of robots does not emerge solely from control systems, but from the tight coupling between body and brain, a principle known as embodied intelligence. Desi
Technical Approach: Designing soft robots that leverage this interaction remains a significant challenge, particularly when morphology and control require simultaneous optimization. A significant obstacle in this co-design process is that morphological evolution can disrupt learned control strategies, making it difficult to reuse or adapt existing knowledge. We address this by develop a Graph Neural Network-based approach for the co-design of morphology and controller.
技術方法: 本文提出的方法:Designing soft robots that leverage this interaction remains a significant challenge, particularly when morphology and control require simultaneous optimization. A significant obstacle in this co-desi
Key Takeaway: These results indicate that graph-structured policies provide a more effective interface between evolving morphologies and control for embodied intelligence.
核心發現: 核心結果:These results indicate that graph-structured policies provide a more effective interface between evolving morphologies and control for embodied intelligence.
Understanding Behavior Cloning with Action Quantization
Authors: Haoqun Cao, Tengyang Xie | Submitted: 2026-03-20 | arXiv: 2603.20538
Categories: cs.LG, stat.ML
Research Background: Behavior cloning is a fundamental paradigm in machine learning, enabling policy learning from expert demonstrations across robotics, autonomous driving, and generative models. Autoregressive models like transformer have proven remarkably effective, from large language models (LLMs) to vision-language-action systems (VLAs).
研究背景: 在機器人學習領域,Behavior cloning is a fundamental paradigm in machine learning, enabling policy learning from expert demonstrations across robotics, autonomous driving, and generative models. Auto
Technical Approach: This paper provides theoretical foundations for this practice.
技術方法: 本文提出的方法:This paper provides theoretical foundations for this practice.
Key Takeaway: We further characterize when different quantization schemes satisfy or violate these requirements, and propose a model-based augmentation that provably improves the error bound without requiring policy smoothness.
核心發現: 核心結果:We further characterize when different quantization schemes satisfy or violate these requirements, and propose a model-based augmentation that provably improves the error bound without requiring polic
HUGE-Bench: A Benchmark for High-Level UAV Vision-Language-Action Tasks
Authors: Jingyu Guo, Ziye Chen, Ziwen Li et al. | Submitted: 2026-03-20 | arXiv: 2603.19822
Categories: cs.CV
Research Background: Existing UAV vision-language navigation (VLN) benchmarks have enabled language-guided flight, but they largely focus on long, step-wise route descriptions with goal-centric evaluation, making them less diagnostic for real operations where brief, high-level commands must be grounded into safe multi-stage behaviors. We present HUGE-Bench, a benchmark for High-Level UAV Vision-Language-Action (HL-VLA) tasks that tests whether an agent can interpret concise language and execute complex, process-oriented trajectories with safety awareness.
研究背景: 在機器人學習領域,Existing UAV vision-language navigation (VLN) benchmarks have enabled language-guided flight, but they largely focus on long, step-wise route descriptions with goal-centric evaluat
Technical Approach: We present HUGE-Bench, a benchmark for High-Level UAV Vision-Language-Action (HL-VLA) tasks that tests whether an agent can interpret concise language and execute complex, process-oriented trajectories with safety awareness. We introduce process-oriented and collision-aware metrics to assess process fidelity, terminal accuracy, and safety.
技術方法: 本文提出的方法:We present HUGE-Bench, a benchmark for High-Level UAV Vision-Language-Action (HL-VLA) tasks that tests whether an agent can interpret concise language and execute complex, process-oriented trajectorie
Key Takeaway: Experiments on representative state-of-the-art VLA models reveal significant gaps in high-level semantic completion and safe execution, highlighting HUGE-Bench as a diagnostic testbed for high-level UAV autonomy.
核心發現: 核心結果:Experiments on representative state-of-the-art VLA models reveal significant gaps in high-level semantic completion and safe execution, highlighting HUGE-Bench as a diagnostic testbed for high-level U
RoboECC: Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Models
Authors: Zihao Zheng, Hangyu Cao, Jiayu Chen et al. | Submitted: 2026-03-21 | arXiv: 2603.20711
Categories: cs.DC, cs.LG, cs.RO
Research Background: Vision-Language-Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) deployment offers an effective fix by easing edge-device computing pressure to meet real-time needs.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) deployment offers an effective fix by easi
Technical Approach: To address these issues, we propose a novel ECC deployment framework for various VLA models, termed RoboECC. Specifically, we propose a model-hardware co-aware segmentation strategy to help find the optimal segmentation point for various VLA models. Moreover, we propose a network-aware deployment adjustment approach to adapt to the network fluctuations for maintaining optimal performance.
技術方法: 本文提出的方法:To address these issues, we propose a novel ECC deployment framework for various VLA models, termed RoboECC. Specifically, we propose a model-hardware co-aware segmentation strategy to help find the o
Key Takeaway: Experiments demonstrate that RoboECC achieves a speedup of up to 3.28x with only 2.55%~2.62% overhead.
核心發現: 核心結果:Experiments demonstrate that RoboECC achieves a speedup of up to 3.28x with only 2.55%~2.62% overhead.
ROI-Driven Foveated Attention for Unified Egocentric Representations in Vision-Language-Action Systems
Authors: Xinhai Sun, Xiang Shi, Menglin Zou et al. | Submitted: 2026-03-21 | arXiv: 2603.20668
Categories: cs.RO
Research Background: The development of embodied AI systems is increasingly constrained by the availability and structure of physical interaction data. Despite recent advances in vision-language-action (VLA) models, current pipelines suffer from high data collection cost, limited cross-embodiment alignment, and poor transfer from internet-scale visual data to robot control.
研究背景: 在機器人學習領域,The development of embodied AI systems is increasingly constrained by the availability and structure of physical interaction data. Despite recent advances in vision-language-action
Technical Approach: We propose a region-of-interest (ROI) driven engineering workflow that introduces an egocentric, geometry-grounded data representation. We present a reproducible pipeline covering calibration, synchronization, ROI generation, deterministic boundary handling, and metadata governance.
技術方法: 本文提出的方法:We propose a region-of-interest (ROI) driven engineering workflow that introduces an egocentric, geometry-grounded data representation. We present a reproducible pipeline covering calibration, synchro
Key Takeaway: We argue that egocentric ROI serves as a practical data abstraction for scalable collection and cross-embodiment learning, bridging internet-scale perception and robot-specific control.
核心發現: 核心結果:We argue that egocentric ROI serves as a practical data abstraction for scalable collection and cross-embodiment learning, bridging internet-scale perception and robot-specific control.
StageCraft: Execution Aware Mitigation of Distractor and Obstruction Failures in VLA Models
Authors: Kartikay Milind Pangaonkar, Prabin Rath, Omkar Patil et al. | Submitted: 2026-03-21 | arXiv: 2603.20659
Categories: cs.RO
Research Background: Large scale pre-training on text and image data along with diverse robot demonstrations has helped Vision Language Action models (VLAs) to generalize to novel tasks, objects and scenes. However, these models are still susceptible to failure in the presence of execution-time impediments such as distractors and physical obstructions in the robot’s workspace.
研究背景: 在機器人學習領域,Large scale pre-training on text and image data along with diverse robot demonstrations has helped Vision Language Action models (VLAs) to generalize to novel tasks, objects and sc
Technical Approach: To this end, we propose StageCraft, a training-free approach to improve pretrained VLA policy performance by manipulating the environment’s initial state using VLM-based in-context reasoning.
技術方法: 本文提出的方法:To this end, we propose StageCraft, a training-free approach to improve pretrained VLA policy performance by manipulating the environment’s initial state using VLM-based in-context reasoning.
Key Takeaway: Our simulation experiments in RLBench empirically show that StageCraft tailors its extent of intervention based on the strength of the underlying policy and improves its performance with more in-context samples.
核心發現: 核心結果:Our simulation experiments in RLBench empirically show that StageCraft tailors its extent of intervention based on the strength of the underlying policy and improves its performance with more in-conte
Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Models
Authors: Zhilong Zhang, Haoxiang Ren, Yihao Sun et al. | Submitted: 2026-03-21 | arXiv: 2603.20607
Categories: cs.RO, cs.LG
Research Background: Vision-Language-Action (VLA) models show strong generalization for robotic control, but finetuning them with reinforcement learning (RL) is constrained by the high cost and safety risks of real-world interaction. Training VLA models in interactive world models avoids these issues but introduces several challenges, including pixel-level world modeling, multi-view consistency, and compounding errors under sparse rewards.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models show strong generalization for robotic control, but finetuning them with reinforcement learning (RL) is constrained by the high cost and safety
Technical Approach: Building on recent advances across large multimodal models and model-based RL, we propose VLA-MBPO, a practical framework to tackle these problems in VLA finetuning. Our approach has three key design choices: (i) adapting unified multimodal models (UMMs) for data-efficient world modeling; (ii) an interleaved view decoding mechanism to enforce multi-view consistency; and (iii) chunk-level branched rollout to mitigate error compounding.
技術方法: 本文提出的方法:Building on recent advances across large multimodal models and model-based RL, we propose VLA-MBPO, a practical framework to tackle these problems in VLA finetuning. Our approach has three key design
Key Takeaway: Theoretical analysis and experiments across simulation and real-world tasks demonstrate that VLA-MBPO significantly improves policy performance and sample efficiency, underscoring its robustness and scalability for real-world robotic deployment.
核心發現: 核心結果:Theoretical analysis and experiments across simulation and real-world tasks demonstrate that VLA-MBPO significantly improves policy performance and sample efficiency, underscoring its robustness and s
Cortical Policy: A Dual-Stream View Transformer for Robotic Manipulation
Authors: Xuening Zhang, Qi Lv, Xiang Deng et al. | Submitted: 2026-03-22 | arXiv: 2603.21051
Categories: cs.RO
Research Background: View transformers process multi-view observations to predict actions and have shown impressive performance in robotic manipulation. Existing methods typically extract static visual representations in a view-specific manner, leading to inadequate 3D spatial reasoning ability and a lack of dynamic adaptation.
研究背景: 在機器人學習領域,View transformers process multi-view observations to predict actions and have shown impressive performance in robotic manipulation. Existing methods typically extract static visual
Technical Approach: Taking inspiration from how the human brain integrates static and dynamic views to address these challenges, we propose Cortical Policy, a novel dual-stream view transformer for robotic manipulation that jointly reasons from static-view and dynamic-view streams.
技術方法: 本文提出的方法:Taking inspiration from how the human brain integrates static and dynamic views to address these challenges, we propose Cortical Policy, a novel dual-stream view transformer for robotic manipulation t
Key Takeaway: Empirical evaluations on RLBench, the challenging COLOSSEUM benchmark, and real-world tasks demonstrate that Cortical Policy outperforms state-of-the-art baselines substantially, validating the superiority of dual-stream design for visuomotor control.
核心發現: 核心結果:Empirical evaluations on RLBench, the challenging COLOSSEUM benchmark, and real-world tasks demonstrate that Cortical Policy outperforms state-of-the-art baselines substantially, validating the superi
Dreaming the Unseen: World Model-regularized Diffusion Policy for Out-of-Distribution Robustness
Authors: Ziou Hu, Xiangtong Yao, Yuan Meng et al. | Submitted: 2026-03-22 | arXiv: 2603.21017
Categories: cs.RO
Research Background: Diffusion policies excel at visuomotor control but often fail catastrophically under severe out-of-distribution (OOD) disturbances, such as unexpected object displacements or visual corruptions. To address this vulnerability, we introduce the Dream Diffusion Policy (DDP), a framework that deeply integrates a diffusion world model into the policy’s training objective via a shared 3D visual encoder.
研究背景: 在機器人學習領域,Diffusion policies excel at visuomotor control but often fail catastrophically under severe out-of-distribution (OOD) disturbances, such as unexpected object displacements or visua
Technical Approach: To address this vulnerability, we introduce the Dream Diffusion Policy (DDP), a framework that deeply integrates a diffusion world model into the policy’s training objective via a shared 3D visual encoder.
技術方法: 本文提出的方法:To address this vulnerability, we introduce the Dream Diffusion Policy (DDP), a framework that deeply integrates a diffusion world model into the policy’s training objective via a shared 3D visual enc
Key Takeaway: Furthermore, as a stress test, DDP maintains a 76.7% real-world success rate even when relying entirely on open-loop imagination post-initialization.
核心發現: 核心結果:Furthermore, as a stress test, DDP maintains a 76.7% real-world success rate even when relying entirely on open-loop imagination post-initialization.
SpatialFly: Geometry-Guided Representation Alignment for UAV Vision-and-Language Navigation in Urban Environments
Authors: Wen Jiang, Kangyao Huang, Li Wang et al. | Submitted: 2026-03-22 | arXiv: 2603.21046
Categories: cs.CV, cs.AI
Research Background: UAVs play an important role in applications such as autonomous exploration, disaster response, and infrastructure inspection. However, UAV VLN in complex 3D environments remains challenging.
研究背景: 在機器人學習領域,UAVs play an important role in applications such as autonomous exploration, disaster response, and infrastructure inspection. However, UAV VLN in complex 3D environments remains ch
Technical Approach: To this end, we propose SpatialFly, a geometry-guided spatial representation framework for UAV VLN.
技術方法: 本文提出的方法:To this end, we propose SpatialFly, a geometry-guided spatial representation framework for UAV VLN.
Key Takeaway: Experimental results show that SpatialFly consistently outperforms state-of-the-art UAV VLN baselines across both seen and unseen environments, reducing NE by 4.03m and improving SR by 1.27% over the strongest baseline on the unseen Full split.
核心發現: 核心結果:Experimental results show that SpatialFly consistently outperforms state-of-the-art UAV VLN baselines across both seen and unseen environments, reducing NE by 4.03m and improving SR by 1.27% over the
FlatLands: Generative Floormap Completion From a Single Egocentric View
Authors: Subhransu S. Bhattacharjee, Dylan Campbell, Rahul Shome | Submitted: 2026-03-16 | arXiv: 2603.16016
Categories: cs.CV, cs.AI, cs.RO, eess.IV
Research Background: A single egocentric image typically captures only a small portion of the floor, yet a complete metric traversability map of the surroundings would better serve applications such as indoor navigation. We introduce FlatLands, a dataset and benchmark for single-view bird’s-eye view (BEV) floor completion.
研究背景: 在機器人學習領域,A single egocentric image typically captures only a small portion of the floor, yet a complete metric traversability map of the surroundings would better serve applications such as
Technical Approach: We introduce FlatLands, a dataset and benchmark for single-view bird’s-eye view (BEV) floor completion.
技術方法: 本文提出的方法:We introduce FlatLands, a dataset and benchmark for single-view bird’s-eye view (BEV) floor completion.
Key Takeaway: The dataset contains 270,575 observations from 17,656 real metric indoor scenes drawn from six existing datasets, with aligned observation, visibility, validity, and ground-truth BEV maps, and the benchmark includes both in- and out-of-distribution evaluation protocols.
核心發現: 核心結果:The dataset contains 270,575 observations from 17,656 real metric indoor scenes drawn from six existing datasets, with aligned observation, visibility, validity, and ground-truth BEV maps, and the ben
Safety Case Patterns for VLA-based driving systems: Insights from SimLingo
Authors: Gerhard Yu, Fuyuki Ishikawa, Oluwafemi Odu et al. | Submitted: 2026-03-16 | arXiv: 2603.16013
Categories: cs.RO, cs.SE
Research Background: Vision-Language-Action (VLA)-based driving systems represent a significant paradigm shift in autonomous driving since, by combining traffic scene understanding, linguistic interpretation, and action generation, these systems enable more flexible, adaptive, and instruction-responsive driving behaviors. However, despite their growing adoption and potential to support socially responsible autonomous driving as well as understanding high-level human instructions, VLA-based driving systems may exhibit new types of hazardous behaviors.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA)-based driving systems represent a significant paradigm shift in autonomous driving since, by combining traffic scene understanding, linguistic interpre
Technical Approach: To support this, we propose a novel safety case design approach called RAISE. Our approach introduces novel patterns tailored to instruction-based driving systems such as VLA-based driving systems, an extension of Hazard Analysis and Risk Assessment (HARA) detailing safe scenarios and their outcomes, and a design technique to create the safety cases of VLA-based driving systems. A case study on SimLingo illustrates how our approach can be used to construct rigorous, evidence-based safety claims for this emerging class of autonomous driving systems.
技術方法: 本文提出的方法:To support this, we propose a novel safety case design approach called RAISE. Our approach introduces novel patterns tailored to instruction-based driving systems such as VLA-based driving systems, an
Key Takeaway: A case study on SimLingo illustrates how our approach can be used to construct rigorous, evidence-based safety claims for this emerging class of autonomous driving systems.
核心發現: 核心結果:A case study on SimLingo illustrates how our approach can be used to construct rigorous, evidence-based safety claims for this emerging class of autonomous driving systems.
ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors
Authors: Zifan Xu, Ran Gong, Maria Vittoria Minniti et al. | Submitted: 2026-03-16 | arXiv: 2603.15956
Categories: cs.RO, cs.AI
Research Background: Learning generalizable and robust behavior cloning policies requires large volumes of high-quality robotics data. While human demonstrations (e.g., through teleoperation) serve as the standard source for expert behaviors, acquiring such data at scale in the real world is prohibitively expensive.
研究背景: 在機器人學習領域,Learning generalizable and robust behavior cloning policies requires large volumes of high-quality robotics data. While human demonstrations (e.g., through teleoperation) serve as
Technical Approach: This paper introduces ExpertGen, a framework that automates expert policy learning in simulation to enable scalable sim-to-real transfer.
技術方法: 本文提出的方法:This paper introduces ExpertGen, a framework that automates expert policy learning in simulation to enable scalable sim-to-real transfer.
Key Takeaway: On industrial assembly tasks, ExpertGen achieves a 90.5% overall success rate, while on long-horizon manipulation tasks it attains 85% overall success, outperforming all baseline methods.
核心發現: 核心結果:On industrial assembly tasks, ExpertGen achieves a 90.5% overall success rate, while on long-horizon manipulation tasks it attains 85% overall success, outperforming all baseline methods.
Embodied Foundation Models at the Edge: A Survey of Deployment Constraints and Mitigation Strategies
Authors: Utkarsh Grover, Ravi Ranjan, Mingyang Mao et al. | Submitted: 2026-03-16 | arXiv: 2603.16952
Categories: cs.RO, cs.AI
Research Background: Deploying foundation models in embodied edge systems is fundamentally a systems problem, not just a problem of model compression. Real-time control must operate within strict size, weight, and power constraints, where memory traffic, compute latency, timing variability, and safety margins interact directly.
研究背景: 在機器人學習領域,Deploying foundation models in embodied edge systems is fundamentally a systems problem, not just a problem of model compression. Real-time control must operate within strict size,
Technical Approach: Real-time control must operate within strict size, weight, and power constraints, where memory traffic, compute latency, timing variability, and safety margins interact directly. The Deployment Gauntlet organizes these constraints into eight coupled barriers that determine whether embodied foundation models can run reliably in practice. Across representative edge workloads, autoregressive Vision-Language-Action policies are constrained primarily by memory bandwidth, whereas diffusion-based controllers are limited more by compute latency and sustained execution cost.
技術方法: 本文提出的方法:Real-time control must operate within strict size, weight, and power constraints, where memory traffic, compute latency, timing variability, and safety margins interact directly. The Deployment Gauntl
Key Takeaway: Reliable deployment therefore depends on system-level co-design across memory, scheduling, communication, and model architecture, including decompositions that separate fast control from slower semantic reasoning.
核心發現: 核心結果:Reliable deployment therefore depends on system-level co-design across memory, scheduling, communication, and model architecture, including decompositions that separate fast control from slower semant
AsgardBench — Evaluating Visually Grounded Interactive Planning Under Minimal Feedback
Authors: Andrea Tupini, Lars Liden, Reuben Tan et al. | Submitted: 2026-03-16 | arXiv: 2603.15888
Categories: cs.AI, cs.CV, cs.RO
Research Background: With AsgardBench we aim to evaluate visually grounded, high-level action sequence generation and interactive planning, focusing specifically on plan adaptation during execution based on visual observations rather than navigation or low-level manipulation. In the landscape of embodied AI benchmarks, AsgardBench targets the capability category of interactive planning, which is more sophisticated than offline high-level planning as it requires agents to revise plans in response to environmental feedback, yet remains distinct from low-level execution.
研究背景: 在機器人學習領域,With AsgardBench we aim to evaluate visually grounded, high-level action sequence generation and interactive planning, focusing specifically on plan adaptation during execution bas
Technical Approach: In the landscape of embodied AI benchmarks, AsgardBench targets the capability category of interactive planning, which is more sophisticated than offline high-level planning as it requires agents to revise plans in response to environmental feedback, yet remains distinct from low-level execution. Unlike prior embodied AI benchmarks that conflate reasoning with navigation or provide rich corrective feedback that substitutes for perception, AsgardBench restricts agent input to images, action history, and lightweight success/failure signals, isolating interactive planning in a controlled simulator without low-level control noise. The benchmark contains 108 task instances spanning 12 task types, each systematically varied through object state, placement, and scene configuration.
技術方法: 本文提出的方法:In the landscape of embodied AI benchmarks, AsgardBench targets the capability category of interactive planning, which is more sophisticated than offline high-level planning as it requires agents to r
Key Takeaway: Our evaluations of leading vision language models show that performance drops sharply without visual input, revealing weaknesses in visual grounding and state tracking that ultimately undermine interactive planning.
核心發現: 核心結果:Our evaluations of leading vision language models show that performance drops sharply without visual input, revealing weaknesses in visual grounding and state tracking that ultimately undermine intera
Emergent Dexterity via Diverse Resets and Large-Scale Reinforcement Learning
Authors: Patrick Yin, Tyler Westenbroek, Zhengyu Zhang et al. | Submitted: 2026-03-16 | arXiv: 2603.15789
Categories: cs.RO
Research Background: Reinforcement learning in massively parallel physics simulations has driven major progress in sim-to-real robot learning. However, current approaches remain brittle and task-specific, relying on extensive per-task engineering to design rewards, curricula, and demonstrations.
研究背景: 在機器人學習領域,Reinforcement learning in massively parallel physics simulations has driven major progress in sim-to-real robot learning. However, current approaches remain brittle and task-specif
Technical Approach: We introduce OmniReset, a simple and scalable framework that enables on-policy reinforcement learning to robustly solve a broad class of dexterous manipulation tasks using a single reward function, fixed algorithm hyperparameters, no curricula, and no human demonstrations.
技術方法: 本文提出的方法:We introduce OmniReset, a simple and scalable framework that enables on-policy reinforcement learning to robustly solve a broad class of dexterous manipulation tasks using a single reward function, fi
Key Takeaway: Finally, we distill OmniReset into visuomotor policies which display robust retrying behavior and substantially higher success rates than baselines when transferred to the real world zero-shot.
核心發現: 核心結果:Finally, we distill OmniReset into visuomotor policies which display robust retrying behavior and substantially higher success rates than baselines when transferred to the real world zero-shot.
CorrectionPlanner: Self-Correction Planner with Reinforcement Learning in Autonomous Driving
Authors: Yihong Guo, Dongqiangzi Ye, Sijia Chen et al. | Submitted: 2026-03-16 | arXiv: 2603.15771
Categories: cs.RO, cs.AI
Research Background: Autonomous driving requires safe planning, but most learning-based planners lack explicit self-correction ability: once an unsafe action is proposed, there is no mechanism to correct it. Thus, we propose CorrectionPlanner, an autoregressive planner with self-correction that models planning as motion-token generation within a propose, evaluate, and correct loop.
研究背景: 在機器人學習領域,Autonomous driving requires safe planning, but most learning-based planners lack explicit self-correction ability: once an unsafe action is proposed, there is no mechanism to corre
Technical Approach: Thus, we propose CorrectionPlanner, an autoregressive planner with self-correction that models planning as motion-token generation within a propose, evaluate, and correct loop.
技術方法: 本文提出的方法:Thus, we propose CorrectionPlanner, an autoregressive planner with self-correction that models planning as motion-token generation within a propose, evaluate, and correct loop.
Key Takeaway: Closed-loop evaluations show that CorrectionPlanner reduces collision rate by over 20% on Waymax and achieves state-of-the-art planning scores on nuPlan.
核心發現: 核心結果:Closed-loop evaluations show that CorrectionPlanner reduces collision rate by over 20% on Waymax and achieves state-of-the-art planning scores on nuPlan.
Simulation Distillation: Pretraining World Models in Simulation for Rapid Real-World Adaptation
Authors: Jacob Levy, Tyler Westenbroek, Kevin Huang et al. | Submitted: 2026-03-16 | arXiv: 2603.15759
Categories: cs.RO, cs.AI, cs.LG
Research Background: Robot learning requires adaptation methods that improve reliably from limited, mixed-quality interaction data. This is especially challenging in long-horizon, contact-rich tasks, where end-to-end policy finetuning remains inefficient and brittle.
研究背景: 在機器人學習領域,Robot learning requires adaptation methods that improve reliably from limited, mixed-quality interaction data. This is especially challenging in long-horizon, contact-rich tasks, w
Technical Approach: We introduce Simulation Distillation (SimDist), a framework that uses physics simulators as a scalable source of action-conditioned robot experience.
技術方法: 本文提出的方法:We introduce Simulation Distillation (SimDist), a framework that uses physics simulators as a scalable source of action-conditioned robot experience.
Key Takeaway: Across contact-rich manipulation and quadruped locomotion tasks, SimDist rapidly improves with experience, while prior adaptation methods struggle to make progress or degrade during online finetuning.
核心發現: 核心結果:Across contact-rich manipulation and quadruped locomotion tasks, SimDist rapidly improves with experience, while prior adaptation methods struggle to make progress or degrade during online finetuning.
You’ve Got a Golden Ticket: Improving Generative Robot Policies With A Single Noise Vector
Authors: Omkar Patil, Ondrej Biza, Thomas Weng et al. | Submitted: 2026-03-16 | arXiv: 2603.15757
Categories: cs.RO, cs.AI
Research Background: What happens when a pretrained generative robot policy is provided a constant initial noise as input, rather than repeatedly sampling it from a Gaussian? We demonstrate that the performance of a pretrained, frozen diffusion or flow matching policy can be improved with respect to a downstream reward by swapping the sampling of initial noise from the prior distribution (typically isotropic Gaussian) with a well-chosen, constant initial noise input — a golden ticket.
研究背景: 在機器人學習領域,What happens when a pretrained generative robot policy is provided a constant initial noise as input, rather than repeatedly sampling it from a Gaussian? We demonstrate that the pe
Technical Approach: We propose a search method to find golden tickets using Monte-Carlo policy evaluation that keeps the pretrained policy frozen, does not train any new networks, and is applicable to all diffusion/flow matching policies (and therefore many VLAs). Our approach to policy improvement makes no assumptions beyond being able to inject initial noise into the policy and calculate (sparse) task rewards of episode rollouts, making it deployable with no additional infrastructure or models. Our method improves the performance of policies in 38 out of 43 tasks across simulated and real-world robot manipulation benchmarks, with relative improvements in success rate by up to 58% for some simulated tasks, and 60% within 50 search episodes for real-world tasks.
技術方法: 本文提出的方法:We propose a search method to find golden tickets using Monte-Carlo policy evaluation that keeps the pretrained policy frozen, does not train any new networks, and is applicable to all diffusion/flow
Key Takeaway: We also show unique benefits of golden tickets for multi-task settings: the diversity of behaviors from different tickets naturally defines a Pareto frontier for balancing different objectives (e.g., speed, success rates); in VLAs, we find that a golden ticket optimized for one task can also boost performance in other related tasks.
核心發現: 核心結果:We also show unique benefits of golden tickets for multi-task settings: the diversity of behaviors from different tickets naturally defines a Pareto frontier for balancing different objectives (e.g.,
HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions
Authors: Yukang Cao, Haozhe Xie, Fangzhou Hong et al. | Submitted: 2026-03-16 | arXiv: 2603.15612
Categories: cs.CV, cs.RO
Research Background: We present HSImul3R, a unified framework for simulation-ready 3D reconstruction of human-scene interactions (HSI) from casual captures, including sparse-view images and monocular videos. Existing methods suffer from a perception-simulation gap: visually plausible reconstructions often violate physical constraints, leading to instability in physics engines and failure in embodied AI applications.
研究背景: 在機器人學習領域,We present HSImul3R, a unified framework for simulation-ready 3D reconstruction of human-scene interactions (HSI) from casual captures, including sparse-view images and monocular v
Technical Approach: We present HSImul3R, a unified framework for simulation-ready 3D reconstruction of human-scene interactions (HSI) from casual captures, including sparse-view images and monocular videos. To bridge this gap, we introduce a physically-grounded bi-directional optimization pipeline that treats the physics simulator as an active supervisor to jointly refine human dynamics and scene geometry. In the reverse direction, we propose Direct Simulation Reward Optimization, which leverages simulation feedback on gravitational stability and interaction success to refine scene geometry.
技術方法: 本文提出的方法:We present HSImul3R, a unified framework for simulation-ready 3D reconstruction of human-scene interactions (HSI) from casual captures, including sparse-view images and monocular videos. To bridge thi
Key Takeaway: Extensive experiments demonstrate that HSImul3R produces the first stable, simulation-ready HSI reconstructions and can be directly deployed to real-world humanoid robots.
核心發現: 核心結果:Extensive experiments demonstrate that HSImul3R produces the first stable, simulation-ready HSI reconstructions and can be directly deployed to real-world humanoid robots.
Panoramic Affordance Prediction
Authors: Zixin Zhang, Chenfei Liao, Hongfei Zhang et al. | Submitted: 2026-03-16 | arXiv: 2603.15558
Categories: cs.CV, cs.RO
Research Background: Affordance prediction serves as a critical bridge between perception and action in embodied AI. However, existing research is confined to pinhole camera models, which suffer from narrow Fields of View (FoV) and fragmented observations, often missing critical holistic environmental context.
研究背景: 在機器人學習領域,Affordance prediction serves as a critical bridge between perception and action in embodied AI. However, existing research is confined to pinhole camera models, which suffer from n
Technical Approach: In this paper, we present the first exploration into Panoramic Affordance Prediction, utilizing 360-degree imagery to capture global spatial relationships and holistic scene understanding. Furthermore, we propose PAP, a training-free, coarse-to-fine pipeline inspired by the human foveal visual system to tackle the ultra-high resolution and severe distortion inherent in panoramic images.
技術方法: 本文提出的方法:In this paper, we present the first exploration into Panoramic Affordance Prediction, utilizing 360-degree imagery to capture global spatial relationships and holistic scene understanding. Furthermore
Key Takeaway: In contrast, PAP framework effectively overcomes these obstacles, significantly outperforming state-of-the-art baselines and highlighting the immense potential of panoramic perception for robust embodied intelligence.
核心發現: 核心結果:In contrast, PAP framework effectively overcomes these obstacles, significantly outperforming state-of-the-art baselines and highlighting the immense potential of panoramic perception for robust embod
RoCo Challenge at AAAI 2026: Benchmarking Robotic Collaborative Manipulation for Assembly Towards Industrial Automation
Authors: Haichao Liu, Yuheng Zhou, Zhenyu Wu et al. | Submitted: 2026-03-16 | arXiv: 2603.15469
Categories: cs.RO, cs.AI
Research Background: Embodied Artificial Intelligence (EAI) is rapidly developing, gradually subverting previous autonomous systems’ paradigms from isolated perception to integrated, continuous action. This transition is highly significant for industrial robotic manipulation, promising to free human workers from repetitive, dangerous daily labor.
研究背景: 在機器人學習領域,Embodied Artificial Intelligence (EAI) is rapidly developing, gradually subverting previous autonomous systems’ paradigms from isolated perception to integrated, continuous action.
Technical Approach: To benchmark and advance this capability, we introduce the Robotic Collaborative Assembly Assistance (RoCo) Challenge with a dataset towards simulation and real-world assembly manipulation.
技術方法: 本文提出的方法:To benchmark and advance this capability, we introduce the Robotic Collaborative Assembly Assistance (RoCo) Challenge with a dataset towards simulation and real-world assembly manipulation.
Key Takeaway: Our dataset, CAD files, code, and evaluation results can be found at: https://rocochallenge.github.io/RoCo2026/.
核心發現: 核心結果:Our dataset, CAD files, code, and evaluation results can be found at: https://rocochallenge.github.io/RoCo2026/.
MA-VLCM: A Vision Language Critic Model for Value Estimation of Policies in Multi-Agent Team Settings
Authors: Shahil Shaik, Aditya Parameshwaran, Anshul Nayak et al. | Submitted: 2026-03-16 | arXiv: 2603.15418
Categories: cs.RO, cs.AI
Research Background: Multi-agent reinforcement learning (MARL) commonly relies on a centralized critic to estimate the value function. However, learning such a critic from scratch is highly sample-inefficient and often lacks generalization across environments.
研究背景: 在機器人學習領域,Multi-agent reinforcement learning (MARL) commonly relies on a centralized critic to estimate the value function. However, learning such a critic from scratch is highly sample-inef
Technical Approach: To address these challenges, we propose Multi-Agent Vision-Language-Critic Models (MA-VLCM), a framework that replaces the learned centralized critic in MARL with a pretrained vision-language model fine-tuned to evaluate multi-agent behavior. By eliminating critic learning during policy optimization, our approach significantly improves sample efficiency while producing compact execution policies suitable for deployment on resource-constrained robots.
技術方法: 本文提出的方法:To address these challenges, we propose Multi-Agent Vision-Language-Critic Models (MA-VLCM), a framework that replaces the learned centralized critic in MARL with a pretrained vision-language model fi
Key Takeaway: Results show good zero-shot return estimation on models with differing VLM backbones on in-distribution and out-of-distribution scenarios in multi-agent team settings
核心發現: 核心結果:Results show good zero-shot return estimation on models with differing VLM backbones on in-distribution and out-of-distribution scenarios in multi-agent team settings
End-to-End Dexterous Grasp Learning from Single-View Point Clouds via a Multi-Object Scene Dataset
Authors: Tao Geng, Dapeng Yang, Ziwei Liu et al. | Submitted: 2026-03-16 | arXiv: 2603.15410
Categories: cs.RO
Research Background: Dexterous grasping in multi-object scene constitutes a fundamental challenge in robotic manipulation. Current mainstream grasping datasets predominantly focus on single-object scenarios and predefined grasp configurations, often neglecting environmental interference and the modeling of dexterous pre-grasp gesture, thereby limiting their generalizability in real-world applications.
研究背景: 在機器人學習領域,Dexterous grasping in multi-object scene constitutes a fundamental challenge in robotic manipulation. Current mainstream grasping datasets predominantly focus on single-object scen
Technical Approach: To address this, we propose DGS-Net, an end-to-end grasp prediction network capable of learning dense grasp configurations from single-view point clouds in multi-object scene. Furthermore, we propose a two-stage grasp data generation strategy that progresses from dense single-object grasp synthesis to dense scene-level grasp generation.
技術方法: 本文提出的方法:To address this, we propose DGS-Net, an end-to-end grasp prediction network capable of learning dense grasp configurations from single-view point clouds in multi-object scene. Furthermore, we propose
Key Takeaway: Experimental results show that DGS-Net achieves grasp success rates of 88.63% in simulation and 78.98% on a real robotic platform, while exhibiting lower penetration with a mean penetration depth of 0.375 mm and penetration volume of 559.45 mm^3, outperforming existing methods and demonstrating strong effectiveness and generalization capability.
核心發現: 核心結果:Experimental results show that DGS-Net achieves grasp success rates of 88.63% in simulation and 78.98% on a real robotic platform, while exhibiting lower penetration with a mean penetration depth of
User-Tailored Learning to Forecast Walking Modes for Exosuits
Authors: Gabriele Abbate, Enrica Tricomi, Nathalie Gierden et al. | Submitted: 2026-03-16 | arXiv: 2603.15329
Categories: cs.RO
Research Background: Assistive robotic devices, like soft lower-limb exoskeletons or exosuits, are widely spreading with the promise of helping people in everyday life. To make such systems adaptive to the variety of users wearing them, it is desirable to endow exosuits with advanced perception systems.
研究背景: 在機器人學習領域,Assistive robotic devices, like soft lower-limb exoskeletons or exosuits, are widely spreading with the promise of helping people in everyday life. To make such systems adaptive to
Technical Approach: This paper presents a perception module based on machine learning that aims at estimating 3 walking modes (i.e., ascending or descending stairs and walking on level ground) of users wearing an exosuit. Our approach provides an estimate for both future and past timesteps that supports control and enables a self-labeling procedure for online model adaptation. Finally, we integrate our system with the exosuit in a closed-loop controller, validating its performance in an online single-subject experiment.
技術方法: 本文提出的方法:This paper presents a perception module based on machine learning that aims at estimating 3 walking modes (i.e., ascending or descending stairs and walking on level ground) of users wearing an exosuit
Key Takeaway: Indeed, we show that our estimate can label data acquired online and refine the model for new users.
核心發現: 核心結果:Indeed, we show that our estimate can label data acquired online and refine the model for new users.
NavGSim: High-Fidelity Gaussian Splatting Simulator for Large-Scale Navigation
Authors: Jiahang Liu, Yuanxing Duan, Jiazhao Zhang et al. | Submitted: 2026-03-16 | arXiv: 2603.15186
Categories: cs.RO
Research Background: Simulating realistic environments for robots is widely recognized as a critical challenge in robot learning, particularly in terms of rendering and physical simulation. This challenge becomes even more pronounced in navigation tasks, where trajectories often extend across multiple rooms or entire floors.
研究背景: 在機器人學習領域,Simulating realistic environments for robots is widely recognized as a critical challenge in robot learning, particularly in terms of rendering and physical simulation. This challe
Technical Approach: In this work, we present NavGSim, a Gaussian Splatting-based simulator designed to generate high-fidelity, large-scale navigation environments. To simulate navigation collisions, we introduce a Gaussian Splatting-based slice technique that directly extracts navigable areas from reconstructed Gaussians.
技術方法: 本文提出的方法:In this work, we present NavGSim, a Gaussian Splatting-based simulator designed to generate high-fidelity, large-scale navigation environments. To simulate navigation collisions, we introduce a Gaussi
Key Takeaway: Our results demonstrate that NavGSim significantly enhances the VLA model’s scene understanding, enabling the policy to handle diverse navigation queries effectively.
核心發現: 核心結果:Our results demonstrate that NavGSim significantly enhances the VLA model’s scene understanding, enabling the policy to handle diverse navigation queries effectively.
What Matters for Scalable and Robust Learning in End-to-End Driving Planners?
Authors: David Holtz, Niklas Hanselmann, Simon Doll et al. | Submitted: 2026-03-16 | arXiv: 2603.15185
Categories: cs.RO, cs.AI, cs.CV
Research Background: End-to-end autonomous driving has gained significant attention for its potential to learn robust behavior in interactive scenarios and scale with data. Popular architectures often build on separate modules for perception and planning connected through latent representations, such as bird’s eye view feature grids, to maintain end-to-end differentiability.
研究背景: 在機器人學習領域,End-to-end autonomous driving has gained significant attention for its potential to learn robust behavior in interactive scenarios and scale with data. Popular architectures often
Technical Approach: In this paper, we systematically re-examine the impact of common architectural patterns on closed-loop performance: (1) high-resolution perceptual representations, (2) disentangled trajectory representations, and (3) generative planning. Building on these insights, we introduce BevAD, a novel lightweight and highly scalable end-to-end driving architecture.
技術方法: 本文提出的方法:In this paper, we systematically re-examine the impact of common architectural patterns on closed-loop performance: (1) high-resolution perceptual representations, (2) disentangled trajectory represen
Key Takeaway: BevAD achieves 72.7% success rate on the Bench2Drive benchmark and demonstrates strong data-scaling behavior using pure imitation learning.
核心發現: 核心結果:BevAD achieves 72.7% success rate on the Bench2Drive benchmark and demonstrates strong data-scaling behavior using pure imitation learning.
ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulation
Authors: Yang Li, Zhaxizhuoma, Hongru Jiang et al. | Submitted: 2026-03-16 | arXiv: 2603.15169
Categories: cs.RO
Research Background: Embodied intelligence for contact-rich manipulation has predominantly relied on position control, while explicit awareness and regulation of interaction forces remain under-explored, limiting stability, precision, and robustness in real-world tasks. We propose ForceVLA2, an end-to-end vision-language-action framework that equips robots with hybrid force-position control and explicit force awareness.
研究背景: 在機器人學習領域,Embodied intelligence for contact-rich manipulation has predominantly relied on position control, while explicit awareness and regulation of interaction forces remain under-explore
Technical Approach: We propose ForceVLA2, an end-to-end vision-language-action framework that equips robots with hybrid force-position control and explicit force awareness.
技術方法: 本文提出的方法:We propose ForceVLA2, an end-to-end vision-language-action framework that equips robots with hybrid force-position control and explicit force awareness.
Key Takeaway: Extensive experiments show that ForceVLA2 substantially improves success rates and reliability in contact-rich manipulation, outperforming pi0 and pi0.5 by 48.0% and 35.0%, respectively, across the 5 tasks, and mitigating common failure modes such as arm overload and unstable contact, thereby actively advancing force-aware interactive physical intelligence in VLAs.
核心發現: 核心結果:Extensive experiments show that ForceVLA2 substantially improves success rates and reliability in contact-rich manipulation, outperforming pi0 and pi0.5 by 48.0% and 35.0%, respectively, across the 5
Master Micro Residual Correction with Adaptive Tactile Fusion and Force-Mixed Control for Contact-Rich Manipulation
Authors: Xingting Li, Yifan Xie, Han Liu et al. | Submitted: 2026-03-16 | arXiv: 2603.15152
Categories: cs.RO
Research Background: Robotic contact-rich and fine-grained manipulation remains a significant challenge due to complex interaction dynamics and the competing requirements of multi-timescale control. While current visual imitation learning methods excel at long-horizon planning, they often fail to perceive critical interaction cues like friction variations or incipient slip, and struggle to balance global task coherence with local reactive feedback.
研究背景: 在機器人學習領域,Robotic contact-rich and fine-grained manipulation remains a significant challenge due to complex interaction dynamics and the competing requirements of multi-timescale control. Wh
Technical Approach: To address these challenges, we propose M2-ResiPolicy, a novel Master-Micro residual control architecture that synergizes high-level action guidance with low-level correction.
技術方法: 本文提出的方法:To address these challenges, we propose M2-ResiPolicy, a novel Master-Micro residual control architecture that synergizes high-level action guidance with low-level correction.
Key Takeaway: Experiments across several demanding tasks including fragile object grasping and precision insertion, demonstrate that M2-ResiPolicy significantly outperforms standard Diffusion Policy (DP) and state-of-the-art Reactive Diffusion Policy (RDP), achieving a 93% damage-free success rate in chip grasping and superior force regulation stability.
核心發現: 核心結果:Experiments across several demanding tasks including fragile object grasping and precision insertion, demonstrate that M2-ResiPolicy significantly outperforms standard Diffusion Policy (DP) and state-
AeroGrab: A Unified Framework for Aerial Grasping in Cluttered Environments
Authors: Shivansh Pratap Singh, Naveen Sudheer Nair, Samaksh Ujjawal et al. | Submitted: 2026-03-16 | arXiv: 2603.15097
Categories: cs.RO
Research Background: Reliable aerial grasping in cluttered environments remains challenging due to occlusions and collision risks. Existing aerial manipulation pipelines largely rely on centroid-based grasping and lack integration between the grasp pose generation models, active exploration, and language-level task specification, resulting in the absence of a complete end-to-end system.
研究背景: 在機器人學習領域,Reliable aerial grasping in cluttered environments remains challenging due to occlusions and collision risks. Existing aerial manipulation pipelines largely rely on centroid-based
Technical Approach: In this work, we present an integrated pipeline for reliable aerial grasping in cluttered environments.
技術方法: 本文提出的方法:In this work, we present an integrated pipeline for reliable aerial grasping in cluttered environments.
Key Takeaway: Experiments in cluttered real-world scenarios demonstrate robust and reliable grasp execution, highlighting the effectiveness of combining active perception with feasibility-aware grasp selection for aerial manipulation.
核心發現: 核心結果:Experiments in cluttered real-world scenarios demonstrate robust and reliable grasp execution, highlighting the effectiveness of combining active perception with feasibility-aware grasp selection for
HALO:Closing Sim-to-Real Gap for Heavy-loaded Humanoid Agile Motion Skills via Differentiable Simulation
Authors: Xingyi Wang, Chenyun Zhang, Weiji Xie et al. | Submitted: 2026-03-16 | arXiv: 2603.15084
Categories: cs.RO
Research Background: Humanoid robots deployed in real-world scenarios often need to carry unknown payloads, which introduce significant mismatch and degrade the effectiveness of simulation-to-reality reinforcement learning methods. To address this challenge, we propose a two-stage gradient-based system identification framework built on the differentiable simulator MuJoCo XLA.
研究背景: 在機器人學習領域,Humanoid robots deployed in real-world scenarios often need to carry unknown payloads, which introduce significant mismatch and degrade the effectiveness of simulation-to-reality r
Technical Approach: To address this challenge, we propose a two-stage gradient-based system identification framework built on the differentiable simulator MuJoCo XLA. By explicitly reducing structured model bias prior to policy training, our approach enables zero-shot transfer of reinforcement learning policies to hardware under heavy-load conditions.
技術方法: 本文提出的方法:To address this challenge, we propose a two-stage gradient-based system identification framework built on the differentiable simulator MuJoCo XLA. By explicitly reducing structured model bias prior to
Key Takeaway: Extensive simulation and real-world experiments demonstrate more precise parameter identification, improved motion tracking accuracy, and substantially enhanced agility and robustness compared to existing baselines.
核心發現: 核心結果:Extensive simulation and real-world experiments demonstrate more precise parameter identification, improved motion tracking accuracy, and substantially enhanced agility and robustness compared to exis
Learning from Mistakes: Post-Training for Driving VLA with Takeover Data
Authors: Yinfeng Gao, Deqing Liu, Qichao Zhang et al. | Submitted: 2026-03-16 | arXiv: 2603.14972
Categories: cs.RO
Research Background: Current Vision-Language-Action (VLA) paradigms in end-to-end autonomous driving rely on offline training from static datasets, leaving them vulnerable to distribution shift. Recent post-training methods use takeover data to mitigate this by augmenting the dataset with high-quality expert takeover samples, yet they suffer from two key limitations: supervision restricted to the period after the takeover moments leads to policies with limited safety margins, and passive preference optimization lacks active exploration for optimal performance.
研究背景: 在機器人學習領域,Current Vision-Language-Action (VLA) paradigms in end-to-end autonomous driving rely on offline training from static datasets, leaving them vulnerable to distribution shift. Recent
Technical Approach: In this paper, we propose TakeVLA, a novel VLA post-training framework that overcomes these shortcomings through two complementary innovations. First, we introduce pre-takeover language supervision, which allows the VLA to learn from mistakes proactively. Second, we propose Scenario Dreaming, a reinforcement fine-tuning paradigm that operates in reconstruceted takeover scenarios, encouraging active exploration beyond mere preference fitting.
技術方法: 本文提出的方法:In this paper, we propose TakeVLA, a novel VLA post-training framework that overcomes these shortcomings through two complementary innovations. First, we introduce pre-takeover language supervision, w
Key Takeaway: Experiments on the Bench2Drive benchmark demonstrate that TakeVLA achieves state-of-the-art closed-loop performance, surpassing the strong VLA baseline SimLingo by 4.93 in driving score, with an enhanced safety margin as evidenced by an 11.76% increase in average TTC.
核心發現: 核心結果:Experiments on the Bench2Drive benchmark demonstrate that TakeVLA achieves state-of-the-art closed-loop performance, surpassing the strong VLA baseline SimLingo by 4.93 in driving score, with an enhan
PerlAD: Towards Enhanced Closed-loop End-to-end Autonomous Driving with Pseudo-simulation-based Reinforcement Learning
Authors: Yinfeng Gao, Qichao Zhang, Deqing Liu et al. | Submitted: 2026-03-16 | arXiv: 2603.14908
Categories: cs.RO, cs.CV
Research Background: End-to-end autonomous driving policies based on Imitation Learning (IL) often struggle in closed-loop execution due to the misalignment between inadequate open-loop training objectives and real driving requirements. While Reinforcement Learning (RL) offers a solution by directly optimizing driving goals via reward signals, the rendering-based training environments introduce the rendering gap and are inefficient due to high computational costs.
研究背景: 在機器人學習領域,End-to-end autonomous driving policies based on Imitation Learning (IL) often struggle in closed-loop execution due to the misalignment between inadequate open-loop training object
Technical Approach: To overcome these challenges, we present a novel Pseudo-simulation-based RL method for closed-loop end-to-end autonomous driving, PerlAD.
技術方法: 本文提出的方法:To overcome these challenges, we present a novel Pseudo-simulation-based RL method for closed-loop end-to-end autonomous driving, PerlAD.
Key Takeaway: Additional evaluations on the DOS benchmark further confirm its reliability in handling safety-critical occlusion scenarios.
核心發現: 核心結果:Additional evaluations on the DOS benchmark further confirm its reliability in handling safety-critical occlusion scenarios.
SpatialPoint: Spatial-aware Point Prediction for Embodied Localization
Authors: Qiming Zhu, Zhirui Fang, Tianming Zhang et al. | Submitted: 2026-03-16 | arXiv: 2603.26690
Categories: cs.RO, cs.AI, cs.CV
Research Background: Embodied intelligence fundamentally requires a capability to determine where to act in 3D space. We formalize this requirement as embodied localization — the problem of predicting executable 3D points conditioned on visual observations and language instructions.
研究背景: 在機器人學習領域,Embodied intelligence fundamentally requires a capability to determine where to act in 3D space. We formalize this requirement as embodied localization — the problem of predicting
Technical Approach: To address this gap, we propose SpatialPoint, a spatial-aware vision-language framework with careful design that integrates structured depth into a vision-language model (VLM) and generates camera-frame 3D coordinates.
技術方法: 本文提出的方法:To address this gap, we propose SpatialPoint, a spatial-aware vision-language framework with careful design that integrates structured depth into a vision-language model (VLM) and generates camera-fra
Key Takeaway: Extensive experiments demonstrate that incorporating depth into VLMs significantly improves embodied localization performance.
核心發現: 核心結果:Extensive experiments demonstrate that incorporating depth into VLMs significantly improves embodied localization performance.
Ego to World: Collaborative Spatial Reasoning in Embodied Systems via Reinforcement Learning
Authors: Heng Zhou, Li Kang, Yiran Qin et al. | Submitted: 2026-03-16 | arXiv: 2603.14811
Categories: cs.RO, cs.CV
Research Background: Understanding the world from distributed, partial viewpoints is a fundamental challenge for embodied multi-agent systems. Each agent perceives the environment through an ego-centric view that is often limited by occlusion and ambiguity.
研究背景: 在機器人學習領域,Understanding the world from distributed, partial viewpoints is a fundamental challenge for embodied multi-agent systems. Each agent perceives the environment through an ego-centri
Technical Approach: To study this problem, we introduce the Ego-to-World (E2W) benchmark, which evaluates a vision-language model’s ability to fuse heterogeneous viewpoints across three tasks: (i) global counting, (ii) relational location reasoning, and (iii) action-oriented grasping that requires predicting view-specific image coordinates. To address this setting, we propose CoRL, a two-stage framework that combines Chain-of-Thought supervised fine-tuning with reinforcement learning using Group-Relative Policy Optimization.
技術方法: 本文提出的方法:To study this problem, we introduce the Ego-to-World (E2W) benchmark, which evaluates a vision-language model’s ability to fuse heterogeneous viewpoints across three tasks: (i) global counting, (ii) r
Key Takeaway: Experiments on E2W show that CoRL consistently surpasses strong proprietary and open-source baselines on both reasoning and perception-grounding metrics, while ablations further confirm the necessity of each CVSR component.
核心發現: 核心結果:Experiments on E2W show that CoRL consistently surpasses strong proprietary and open-source baselines on both reasoning and perception-grounding metrics, while ablations further confirm the necessity
Dynamic Properties and Motion Reproducibility of a Compact Pneumatically Actuated Humanoid Upper Body for Data-Driven Control
Authors: Hiroshi Atsuta, Hisashi Ishihara, Minoru Asada | Submitted: 2026-03-16 | arXiv: 2603.14787
Categories: cs.RO
Research Background: Pneumatically-actuated anthropomorphic robots with high degrees of freedom (DOF) offer significant potential for physical human-robot interaction. However, precise control of pneumatic actuators is challenging due to their inherent nonlinearities.
研究背景: 在機器人學習領域,Pneumatically-actuated anthropomorphic robots with high degrees of freedom (DOF) offer significant potential for physical human-robot interaction. However, precise control of pneum
Technical Approach: This paper presents the development of a compact 13-DOF upper-body humanoid robot.
技術方法: 本文提出的方法:This paper presents the development of a compact 13-DOF upper-body humanoid robot.
Key Takeaway: Comparative evaluations with a traditional PID controller demonstrate superior trajectory tracking performance, highlighting the potential of data-driven approaches for controlling complex, high-DOF pneumatic robots.
核心發現: 核心結果:Comparative evaluations with a traditional PID controller demonstrate superior trajectory tracking performance, highlighting the potential of data-driven approaches for controlling complex, high-DOF p
Fast SAM 3D Body: Accelerating SAM 3D Body for Real-Time Full-Body Human Mesh Recovery
Authors: Timing Yang, Sicheng He, Hongyi Jing et al. | Submitted: 2026-03-16 | arXiv: 2603.15603
Categories: cs.CV
Research Background: SAM 3D Body (3DB) achieves state-of-the-art accuracy in monocular 3D human mesh recovery, yet its inference latency of several seconds per image precludes real-time application. We present Fast SAM 3D Body, a training-free acceleration framework that reformulates the 3DB inference pathway to achieve interactive rates.
研究背景: 在機器人學習領域,SAM 3D Body (3DB) achieves state-of-the-art accuracy in monocular 3D human mesh recovery, yet its inference latency of several seconds per image precludes real-time application. We
Technical Approach: We present Fast SAM 3D Body, a training-free acceleration framework that reformulates the 3DB inference pathway to achieve interactive rates. Overall, our framework delivers up to a 10.9x end-to-end speedup while maintaining on-par reconstruction fidelity, even surpassing 3DB on benchmarks such as LSPET.
技術方法: 本文提出的方法:We present Fast SAM 3D Body, a training-free acceleration framework that reformulates the 3DB inference pathway to achieve interactive rates. Overall, our framework delivers up to a 10.9x end-to-end s
Key Takeaway: We demonstrate its utility by deploying Fast SAM 3D Body in a vision-only teleoperation system that-unlike methods reliant on wearable IMUs-enables real-time humanoid control and the direct collection of manipulation policies from a single RGB stream.
核心發現: 核心結果:We demonstrate its utility by deploying Fast SAM 3D Body in a vision-only teleoperation system that-unlike methods reliant on wearable IMUs-enables real-time humanoid control and the direct collection
RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulation
Authors: Linfei Li, Lin Zhang, Ying Shen | Submitted: 2026-03-16 | arXiv: 2603.14880
Categories: cs.CV
Research Background: Visual-language grounding aims to establish semantic correspondences between natural language and visual entities, enabling models to accurately identify and localize target objects based on textual instructions. Existing VLG approaches focus on coarse-grained, object-level localization, while traditional robotic grasping methods rely predominantly on geometric cues and lack language guidance, which limits their applicability in language-driven manipulation scenarios.
研究背景: 在機器人學習領域,Visual-language grounding aims to establish semantic correspondences between natural language and visual entities, enabling models to accurately identify and localize target object
Technical Approach: To address these limitations, we propose the RealVLG framework, which integrates the RealVLG-11B dataset and the RealVLG-R1 model to unify real-world visual-language grounding and grasping tasks.
技術方法: 本文提出的方法:To address these limitations, we propose the RealVLG framework, which integrates the RealVLG-11B dataset and the RealVLG-R1 model to unify real-world visual-language grounding and grasping tasks.
Key Takeaway: Experimental results demonstrate that RealVLG supports zero-shot perception and manipulation in real-world unseen environments, establishing a unified semantic-visual multimodal benchmark that provides a comprehensive data and evaluation platform for language-driven robotic perception and grasping policy learning.
核心發現: 核心結果:Experimental results demonstrate that RealVLG supports zero-shot perception and manipulation in real-world unseen environments, establishing a unified semantic-visual multimodal benchmark that provide
TrajMamba: An Ego-Motion-Guided Mamba Model for Pedestrian Trajectory Prediction from an Egocentric Perspective
Authors: Yusheng Peng, Gaofeng Zhang, Liping Zheng | Submitted: 2026-03-16 | arXiv: 2603.14739
Categories: cs.CV, cs.AI
Research Background: Future trajectory prediction of a tracked pedestrian from an egocentric perspective is a key task in areas such as autonomous driving and robot navigation. The challenge of this task lies in the complex dynamic relative motion between the ego-camera and the tracked pedestrian.
研究背景: 在機器人學習領域,Future trajectory prediction of a tracked pedestrian from an egocentric perspective is a key task in areas such as autonomous driving and robot navigation. The challenge of this ta
Technical Approach: To address this challenge, we propose an ego-motion-guided trajectory prediction network based on the Mamba model.
技術方法: 本文提出的方法:To address this challenge, we propose an ego-motion-guided trajectory prediction network based on the Mamba model.
Key Takeaway: Extensive experiments demonstrate the effectiveness of the proposed model, which achieves state-of-the-art performance on the PIE and JAAD datasets.
核心發現: 核心結果:Extensive experiments demonstrate the effectiveness of the proposed model, which achieves state-of-the-art performance on the PIE and JAAD datasets.
Surface-Constrained Offline Warping with Contact-Aware Online Pose Projection for Safe Robotic Trajectory Execution
Authors: Farong Wang, Sai Swaminathan, Fei Liu | Submitted: 2026-03-17 | arXiv: 2603.26711
Categories: cs.RO, eess.SY
Research Background: Robotic manipulation tasks that require repeated tool motion along curved surfaces frequently arise in surface finishing, inspection, and guided interaction. In practice, nominal motion primitives are often designed independently of the deployment surface and later reused across varying geometries.
研究背景: 在機器人學習領域,Robotic manipulation tasks that require repeated tool motion along curved surfaces frequently arise in surface finishing, inspection, and guided interaction. In practice, nominal m
Technical Approach: We present a two-stage framework that separates geometric embedding from execution-level regulation.
技術方法: 本文提出的方法:We present a two-stage framework that separates geometric embedding from execution-level regulation.
Key Takeaway: These results show that decoupling offline geometric remapping from lightweight online projection enables stable and repeatable surface-embedded trajectory execution under sensor-lite feedbacks.
核心發現: 核心結果:These results show that decoupling offline geometric remapping from lightweight online projection enables stable and repeatable surface-embedded trajectory execution under sensor-lite feedbacks.
SLowRL: Safe Low-Rank Adaptation Reinforcement Learning for Locomotion
Authors: Elham Daneshmand, Shafeef Omar, Glen Berseth et al. | Submitted: 2026-03-17 | arXiv: 2603.17092
Categories: cs.RO
Research Background: Sim-to-real transfer of locomotion policies often leads to performance degradation due to the inevitable sim-to-real gap. Naively fine-tuning these policies directly on hardware is problematic, as it poses risks of mechanical failure and suffers from high sample inefficiency.
研究背景: 在機器人學習領域,Sim-to-real transfer of locomotion policies often leads to performance degradation due to the inevitable sim-to-real gap. Naively fine-tuning these policies directly on hardware is
Technical Approach: In this paper, we address the challenge of safely and efficiently fine-tuning reinforcement learning (RL) policies for dynamic locomotion tasks. In doing so, we introduce SLowRL, a framework that combines Low-Rank Adaptation (LoRA) with training-time safety enforcement via a recovery policy. We evaluate our method both in simulation and on a real Unitree Go2 quadruped robot for jump and trot tasks.
技術方法: 本文提出的方法:In this paper, we address the challenge of safely and efficiently fine-tuning reinforcement learning (RL) policies for dynamic locomotion tasks. In doing so, we introduce SLowRL, a framework that comb
Key Takeaway: These results demonstrate the practicality of safe, efficient fine-tuning for dynamic real-world robotic applications.
核心發現: 核心結果:These results demonstrate the practicality of safe, efficient fine-tuning for dynamic real-world robotic applications.
ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100K
Authors: Kaixuan Wang, Tianxing Chen, Jiawei Liu et al. | Submitted: 2026-03-17 | arXiv: 2603.16866
Categories: cs.RO, cs.AI, cs.GR, cs.LG, cs.SE
Research Background: Learning in simulation provides a useful foundation for scaling robotic manipulation capabilities. However, this paradigm often suffers from a lack of data-generation-ready digital assets, in both scale and diversity.
研究背景: 在機器人學習領域,Learning in simulation provides a useful foundation for scaling robotic manipulation capabilities. However, this paradigm often suffers from a lack of data-generation-ready digital
Technical Approach: In this work, we present ManiTwin, an automated and efficient pipeline for generating data-generation-ready digital object twins.
技術方法: 本文提出的方法:In this work, we present ManiTwin, an automated and efficient pipeline for generating data-generation-ready digital object twins.
Key Takeaway: Experiments demonstrate that ManiTwin provides an efficient asset synthesis and annotation workflow, and that ManiTwin-100K offers high-quality and diverse assets for manipulation data generation, random scene synthesis, and VQA data generation, establishing a strong foundation for scalable simulation data synthesis and policy learning.
核心發現: 核心結果:Experiments demonstrate that ManiTwin provides an efficient asset synthesis and annotation workflow, and that ManiTwin-100K offers high-quality and diverse assets for manipulation data generation, ran
MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation
Authors: Abhay Deshpande, Maya Guru, Rose Hendrix et al. | Submitted: 2026-03-17 | arXiv: 2603.16861
Categories: cs.RO
Research Background: A prevailing view in robot learning is that simulation alone is not enough; effective sim-to-real transfer is widely believed to require at least some real-world data collection or task-specific fine-tuning to bridge the gap between simulated and physical environments. We challenge that assumption.
研究背景: 在機器人學習領域,A prevailing view in robot learning is that simulation alone is not enough; effective sim-to-real transfer is widely believed to require at least some real-world data collection or
Technical Approach: We introduce MolmoBot-Engine, a fully open-source pipeline for procedural data generation across robots, tasks, and diverse simulated environments in MolmoSpaces.
技術方法: 本文提出的方法:We introduce MolmoBot-Engine, a fully open-source pipeline for procedural data generation across robots, tasks, and diverse simulated environments in MolmoSpaces.
Key Takeaway: Our results demonstrate that procedural environment generation combined with diverse articulated assets can produce robust manipulation policies that generalize broadly to the real world.
核心發現: 核心結果:Our results demonstrate that procedural environment generation combined with diverse articulated assets can produce robust manipulation policies that generalize broadly to the real world.
DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models
Authors: Emily Yue-Ting Jia, Weiduo Yuan, Tianheng Shi et al. | Submitted: 2026-03-17 | arXiv: 2603.16860
Categories: cs.RO
Research Background: Robotic manipulation requires sophisticated commonsense reasoning, a capability naturally possessed by large-scale Vision-Language Models (VLMs). While VLMs show promise as zero-shot planners, their lack of grounded physical understanding often leads to compounding errors and low success rates when deployed in complex real-world environments, particularly for challenging tasks like deformable object manipulation.
研究背景: 在機器人學習領域,Robotic manipulation requires sophisticated commonsense reasoning, a capability naturally possessed by large-scale Vision-Language Models (VLMs). While VLMs show promise as zero-sh
Technical Approach: To overcome this bottleneck, we introduce DreamPlan, a novel framework for the reinforcement fine-tuning of VLM planners via video world models.
技術方法: 本文提出的方法:To overcome this bottleneck, we introduce DreamPlan, a novel framework for the reinforcement fine-tuning of VLM planners via video world models.
Key Takeaway: Our results indicate that DreamPlan bridges the gap between semantic reasoning and physical grounding, significantly improving manipulation success rates without the need for large-scale real-world data collection.
核心發現: 核心結果:Our results indicate that DreamPlan bridges the gap between semantic reasoning and physical grounding, significantly improving manipulation success rates without the need for large-scale real-world da
BrickSim: A Physics-Based Simulator for Manipulating Interlocking Brick Assemblies
Authors: Haowei Wen, Ruixuan Liu, Weiyi Piao et al. | Submitted: 2026-03-17 | arXiv: 2603.16853
Categories: cs.RO, cs.GR
Research Background: Interlocking brick assemblies provide a standardized yet challenging testbed for contact-rich and long-horizon robotic manipulation, but existing rigid-body simulators do not faithfully capture snap-fit mechanics. We present BrickSim, the first real-time physics-based simulator for interlocking brick assemblies.
研究背景: 在機器人學習領域,Interlocking brick assemblies provide a standardized yet challenging testbed for contact-rich and long-horizon robotic manipulation, but existing rigid-body simulators do not faith
Technical Approach: We present BrickSim, the first real-time physics-based simulator for interlocking brick assemblies.
技術方法: 本文提出的方法:We present BrickSim, the first real-time physics-based simulator for interlocking brick assemblies.
Key Takeaway: We demonstrate robotic construction of brick assemblies using BrickSim, highlighting its potential as a foundation for research in dexterous, long-horizon robotic manipulation.
核心發現: 核心結果:We demonstrate robotic construction of brick assemblies using BrickSim, highlighting its potential as a foundation for research in dexterous, long-horizon robotic manipulation.
DexGrasp-Zero: A Morphology-Aligned Policy for Zero-Shot Cross-Embodiment Dexterous Grasping
Authors: Yuliang Wu, Yanhan Lin, WengKit Lao et al. | Submitted: 2026-03-17 | arXiv: 2603.16806
Categories: cs.RO, cs.AI
Research Background: To meet the demands of increasingly diverse dexterous hand hardware, it is crucial to develop a policy that enables zero-shot cross-embodiment grasping without redundant re-learning. Cross-embodiment alignment is challenging due to heterogeneous hand kinematics and physical constraints.
研究背景: 在機器人學習領域,To meet the demands of increasingly diverse dexterous hand hardware, it is crucial to develop a policy that enables zero-shot cross-embodiment grasping without redundant re-learnin
Technical Approach: To overcome these limitations, we propose DexGrasp-Zero, a policy that learns universal grasping skills from diverse embodiments, enabling zero-shot transfer to unseen hands. Relying on this graph-based representation, we design a Morphology-Aligned Graph Convolutional Network (MAGCN) to encode the graph for policy learning.
技術方法: 本文提出的方法:To overcome these limitations, we propose DexGrasp-Zero, a policy that learns universal grasping skills from diverse embodiments, enabling zero-shot transfer to unseen hands. Relying on this graph-bas
Key Takeaway: Real-world experiments further evaluate our policy on three robot platforms (LEAP, Inspire, Revo2), achieving an 82% average success rate on unseen objects.
核心發現: 核心結果:Real-world experiments further evaluate our policy on three robot platforms (LEAP, Inspire, Revo2), achieving an 82% average success rate on unseen objects.
vAccSOL: Efficient and Transparent AI Vision Offloading for Mobile Robots
Authors: Adam Zahir, Michele Gucciardom Falk Selker, Anastasios Nanos et al. | Submitted: 2026-03-17 | arXiv: 2603.16685
Categories: cs.RO, cs.CV
Research Background: Mobile robots are increasingly deployed for inspection, patrol, and search-and-rescue operations, relying on computer vision for perception, navigation, and autonomous decision-making. However, executing modern vision workloads onboard is challenging due to limited compute resources and strict energy constraints.
研究背景: 在機器人學習領域,Mobile robots are increasingly deployed for inspection, patrol, and search-and-rescue operations, relying on computer vision for perception, navigation, and autonomous decision-mak
Technical Approach: We present vAccSOL, a framework for efficient and transparent execution of AI-based vision workloads across heterogeneous robotic and edge platforms. vAccSOL integrates two components: SOL, a neural network compiler that generates optimized inference libraries with minimal runtime dependencies, and vAccel, a lightweight execution framework that transparently dispatches inference locally on the robot or to nearby edge infrastructure.
技術方法: 本文提出的方法:We present vAccSOL, a framework for efficient and transparent execution of AI-based vision workloads across heterogeneous robotic and edge platforms. vAccSOL integrates two components: SOL, a neural n
Key Takeaway: Compared to a PyTorch compiler baseline, SOL achieves comparable or better inference performance.
核心發現: 核心結果:Compared to a PyTorch compiler baseline, SOL achieves comparable or better inference performance.
When Should a Robot Think? Resource-Aware Reasoning via Reinforcement Learning for Embodied Robotic Decision-Making
Authors: Jun Liu, Pu Zhao, Zhenglun Kong et al. | Submitted: 2026-03-17 | arXiv: 2603.16673
Categories: cs.RO, cs.AI, cs.LG
Research Background: Embodied robotic systems increasingly rely on large language model (LLM)-based agents to support high-level reasoning, planning, and decision-making during interactions with the environment. However, invoking LLM reasoning introduces substantial computational latency and resource overhead, which can interrupt action execution and reduce system reliability.
研究背景: 在機器人學習領域,Embodied robotic systems increasingly rely on large language model (LLM)-based agents to support high-level reasoning, planning, and decision-making during interactions with the en
Technical Approach: In this work, we propose RARRL (Resource-Aware Reasoning via Reinforcement Learning), a hierarchical framework for resource-aware orchestration of embodied agents.
技術方法: 本文提出的方法:In this work, we propose RARRL (Resource-Aware Reasoning via Reinforcement Learning), a hierarchical framework for resource-aware orchestration of embodied agents.
Key Takeaway: These results demonstrate that adaptive reasoning control is essential for building reliable and efficient embodied robotic agents.
核心發現: 核心結果:These results demonstrate that adaptive reasoning control is essential for building reliable and efficient embodied robotic agents.
Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation
Authors: Mutian Xu, Tianbao Zhang, Tianqi Liu et al. | Submitted: 2026-03-17 | arXiv: 2603.16669
Categories: cs.RO, cs.CV
Research Background: Simulating robot-world interactions is a cornerstone of Embodied AI. Recently, a few works have shown promise in leveraging video generations to transcend the rigid visual/physical constraints of traditional simulators.
研究背景: 在機器人學習領域,Simulating robot-world interactions is a cornerstone of Embodied AI. Recently, a few works have shown promise in leveraging video generations to transcend the rigid visual/physical
Technical Approach: To restore this 4D essence while ensuring the precise robot control, we introduce Kinema4D, a new action-conditioned 4D generative robotic simulator that disentangles the robot-world interaction into: i) Precise 4D representation of robot controls: we drive a URDF-based 3D robot via kinematics, producing a precise 4D robot control trajectory. ii) Generative 4D modeling of environmental reactions: we project the 4D robot trajectory into a pointmap as a spatiotemporal visual signal, controlling the generative model to synthesize complex environments’ reactive dynamics into synchronized RGB/pointmap sequences. Extensive experiments demonstrate that our method effectively simulates physically-plausible, geometry-consistent, and embodiment-agnostic interactions that faithfully mirror diverse real-world dynamics.
技術方法: 本文提出的方法:To restore this 4D essence while ensuring the precise robot control, we introduce Kinema4D, a new action-conditioned 4D generative robotic simulator that disentangles the robot-world interaction into:
Key Takeaway: Extensive experiments demonstrate that our method effectively simulates physically-plausible, geometry-consistent, and embodiment-agnostic interactions that faithfully mirror diverse real-world dynamics.
核心發現: 核心結果:Extensive experiments demonstrate that our method effectively simulates physically-plausible, geometry-consistent, and embodiment-agnostic interactions that faithfully mirror diverse real-world dynami
LIMBERO: A Limbed Climbing Exploration Robot Toward Traveling on Rocky Cliffs
Authors: Kentaro Uno, Masazumi Imai, Kazuki Takada et al. | Submitted: 2026-03-17 | arXiv: 2603.16531
Categories: cs.RO
Research Background: In lunar and planetary exploration, legged robots have attracted significant attention as an alternative to conventional wheeled robots, which struggle to traverse rough and uneven terrain. To enable locomotion over highly irregular and steeply inclined surfaces, limbed climbing robots equipped with grippers on their feet have emerged as a promising solution.
研究背景: 在機器人學習領域,In lunar and planetary exploration, legged robots have attracted significant attention as an alternative to conventional wheeled robots, which struggle to traverse rough and uneven
Technical Approach: In this paper, we present LIMBERO, a 10 kg-class quadrupedal climbing robot that employs spine-type grippers for stable locomotion and climbing on rugged and steep terrain. Furthermore, we develop an efficient algorithm to visualize a geometry-based graspability index on continuous rough terrain.
技術方法: 本文提出的方法:In this paper, we present LIMBERO, a 10 kg-class quadrupedal climbing robot that employs spine-type grippers for stable locomotion and climbing on rugged and steep terrain. Furthermore, we develop an
Key Takeaway: Finally, we integrate these components into LIMBERO and demonstrate its ability to ascend steep rocky surfaces under a 1 G gravity condition, a performance not previously achieved yet for limbed climbing robots of this scale.
核心發現: 核心結果:Finally, we integrate these components into LIMBERO and demonstrate its ability to ascend steep rocky surfaces under a 1 G gravity condition, a performance not previously achieved yet for limbed climb
Rewarding DINO: Predicting Dense Rewards with Vision Foundation Models
Authors: Pierre Krack, Tobias Jülg, Wolfram Burgard et al. | Submitted: 2026-03-17 | arXiv: 2603.16978
Categories: cs.RO, cs.LG
Research Background: Well-designed dense reward functions in robot manipulation not only indicate whether a task is completed but also encode progress along the way. Generally, designing dense rewards is challenging and usually requires access to privileged state information available only in simulation, not in real-world experiments.
研究背景: 在機器人學習領域,Well-designed dense reward functions in robot manipulation not only indicate whether a task is completed but also encode progress along the way. Generally, designing dense rewards
Technical Approach: In this work, we introduce Rewarding DINO, a method for language-conditioned reward modeling that learns actual reward functions rather than specific trajectories.
技術方法: 本文提出的方法:In this work, we introduce Rewarding DINO, a method for language-conditioned reward modeling that learns actual reward functions rather than specific trajectories.
Key Takeaway: Rewarding DINO achieves competitive performance in tasks from the training set and generalizes to new settings in simulation and the real world, indicating that it learns task semantics.
核心發現: 核心結果:Rewarding DINO achieves competitive performance in tasks from the training set and generalizes to new settings in simulation and the real world, indicating that it learns task semantics.
Faulty Coffees: Barriers to Adoption of an In-the-wild Robo-Barista
Authors: Bruce W. Wilson, David A. Robb, Mei Yii Lim et al. | Submitted: 2026-03-17 | arXiv: 2603.16336
Categories: cs.RO
Research Background: We set out to study whether task-based narratives could influence long-term engagement with a service robot. To do so, we deployed a Robo-Barista for five weeks in an over-50’s housing complex in Stockton, England.
研究背景: 在機器人學習領域,We set out to study whether task-based narratives could influence long-term engagement with a service robot. To do so, we deployed a Robo-Barista for five weeks in an over-50’s hou
Technical Approach: Rather than treating these as peripheral issues, we foreground them in this paper.
技術方法: 本文提出的方法:Rather than treating these as peripheral issues, we foreground them in this paper.
Key Takeaway: We reflect on the in-the-wild realities of our experiment and offer lessons for conducting longitudinal Human-Robot Interaction research when studies unravel in practice.
核心發現: 核心結果:We reflect on the in-the-wild realities of our experiment and offer lessons for conducting longitudinal Human-Robot Interaction research when studies unravel in practice.
MG-Grasp: Metric-Scale Geometric 6-DoF Grasping Framework with Sparse RGB Observations
Authors: Kangxu Wang, Siang Chen, Chenxing Jiang et al. | Submitted: 2026-03-17 | arXiv: 2603.16270
Categories: cs.RO
Research Background: Single-view RGB-D grasp detection remains a common choice in 6-DoF robotic grasping systems, which typically requires a depth sensor. While RGB-only 6-DoF grasp methods has been studied recently, their inaccurate geometric representation is not directly suitable for physically reliable robotic manipulation, thereby hindering reliable grasp generation.
研究背景: 在機器人學習領域,Single-view RGB-D grasp detection remains a common choice in 6-DoF robotic grasping systems, which typically requires a depth sensor. While RGB-only 6-DoF grasp methods has been st
Technical Approach: To address these limitations, we propose MG-Grasp, a novel depth-free 6-DoF grasping framework that achieves high-quality object grasping. Leveraging two-view 3D foundation model with camera intrinsic/extrinsic, our method reconstructs metric-scale and multi-view consistent dense point clouds from sparse RGB images and generates stable 6-DoF grasp.
技術方法: 本文提出的方法:To address these limitations, we propose MG-Grasp, a novel depth-free 6-DoF grasping framework that achieves high-quality object grasping. Leveraging two-view 3D foundation model with camera intrinsic
Key Takeaway: Experiments on GraspNet-1Billion dataset and real world demonstrate that MG-Grasp achieves state-of-the-art (SOTA) grasp performance among RGB-based 6-DoF grasping methods.
核心發現: 核心結果:Experiments on GraspNet-1Billion dataset and real world demonstrate that MG-Grasp achieves state-of-the-art (SOTA) grasp performance among RGB-based 6-DoF grasping methods.
Industrial cuVSLAM Benchmark & Integration
Authors: Charbel Abi Hana, Kameel Amareen, Mohamad Mostafa et al. | Submitted: 2026-03-17 | arXiv: 2603.16240
Categories: cs.RO
Research Background: This work presents a comprehensive benchmark evaluation of visual odometry (VO) and visual SLAM (VSLAM) systems for mobile robot navigation in real-world logistical environments. We compare multiple visual odometry approaches across controlled trajectories covering translational, rotational, and mixed motion patterns, as well as a large-scale production facility dataset spanning approximately 1.7 km.
研究背景: 在機器人學習領域,This work presents a comprehensive benchmark evaluation of visual odometry (VO) and visual SLAM (VSLAM) systems for mobile robot navigation in real-world logistical environments. W
Technical Approach: We compare multiple visual odometry approaches across controlled trajectories covering translational, rotational, and mixed motion patterns, as well as a large-scale production facility dataset spanning approximately 1.7 km. Performance is evaluated using Absolute Pose Error (APE) against ground truth from a Vicon motion capture system and a LiDAR-based SLAM reference. Our results show that a hybrid stack combining the cuVSLAM front-end with a custom SLAM back-end achieves the strongest mapping accuracy, motivating a deeper integration of cuVSLAM as the core VO component in our robotics stack.
技術方法: 本文提出的方法:We compare multiple visual odometry approaches across controlled trajectories covering translational, rotational, and mixed motion patterns, as well as a large-scale production facility dataset spanni
Key Takeaway: Our results show that a hybrid stack combining the cuVSLAM front-end with a custom SLAM back-end achieves the strongest mapping accuracy, motivating a deeper integration of cuVSLAM as the core VO component in our robotics stack.
核心發現: 核心結果:Our results show that a hybrid stack combining the cuVSLAM front-end with a custom SLAM back-end achieves the strongest mapping accuracy, motivating a deeper integration of cuVSLAM as the core VO comp
S-VAM: Shortcut Video-Action Model by Self-Distilling Geometric and Semantic Foresight
Authors: Haodong Yan, Zhide Zhong, Jiaguan Zhu et al. | Submitted: 2026-03-17 | arXiv: 2603.16195
Categories: cs.CV, cs.RO
Research Background: Video action models (VAMs) have emerged as a promising paradigm for robot learning, owing to their powerful visual foresight for complex manipulation tasks. However, current VAMs, typically relying on either slow multi-step video generation or noisy one-step feature extraction, cannot simultaneously guarantee real-time inference and high-fidelity foresight.
研究背景: 在機器人學習領域,Video action models (VAMs) have emerged as a promising paradigm for robot learning, owing to their powerful visual foresight for complex manipulation tasks. However, current VAMs,
Technical Approach: To address this limitation, we propose S-VAM, a shortcut video-action model that foresees coherent geometric and semantic representations via a single forward pass. To enable this efficient shortcut, we introduce a novel self-distillation strategy that condenses structured generative priors of multi-step denoising into one-step inference.
技術方法: 本文提出的方法:To address this limitation, we propose S-VAM, a shortcut video-action model that foresees coherent geometric and semantic representations via a single forward pass. To enable this efficient shortcut,
Key Takeaway: Extensive experiments in simulation and the real world demonstrate that our S-VAM outperforms state-of-the-art methods, enabling efficient and precise manipulation in complex environments.
核心發現: 核心結果:Extensive experiments in simulation and the real world demonstrate that our S-VAM outperforms state-of-the-art methods, enabling efficient and precise manipulation in complex environments.
Task-Specified Compliance Bounds for Humanoids via Lipschitz-Constrained Policies
Authors: Zewen He, Yoshihiko Nakamura | Submitted: 2026-03-17 | arXiv: 2603.16180
Categories: cs.RO
Research Background: Reinforcement learning (RL) has demonstrated substantial potential for humanoid bipedal locomotion and the control of complex motions. To cope with oscillations and impacts induced by environmental interactions, compliant control is widely regarded as an effective remedy.
研究背景: 在機器人學習領域,Reinforcement learning (RL) has demonstrated substantial potential for humanoid bipedal locomotion and the control of complex motions. To cope with oscillations and impacts induced
Technical Approach: In this study, we propose an anisotropic Lipschitz-constrained policy (ALCP) that maps a task-space stiffness upper bound to a state-dependent Lipschitz-style constraint on the policy Jacobian.
技術方法: 本文提出的方法:In this study, we propose an anisotropic Lipschitz-constrained policy (ALCP) that maps a task-space stiffness upper bound to a state-dependent Lipschitz-style constraint on the policy Jacobian.
Key Takeaway: Experiments on humanoid robots show that ALCP improves locomotion stability and impact robustness, while reducing oscillations and energy usage.
核心發現: 核心結果:Experiments on humanoid robots show that ALCP improves locomotion stability and impact robustness, while reducing oscillations and energy usage.
SignNav: Leveraging Signage for Semantic Visual Navigation in Large-Scale Indoor Environments
Authors: Jian Sun, Yuming Huang, He Li et al. | Submitted: 2026-03-17 | arXiv: 2603.16166
Categories: cs.RO, cs.CV
Research Background: Humans routinely leverage semantic hints provided by signage to navigate to destinations within novel Large-Scale Indoor (LSI) environments, such as hospitals and airport terminals. However, this capability remains underexplored within the field of embodied navigation.
研究背景: 在機器人學習領域,Humans routinely leverage semantic hints provided by signage to navigate to destinations within novel Large-Scale Indoor (LSI) environments, such as hospitals and airport terminals
Technical Approach: This paper introduces a novel embodied navigation task, SignNav, which requires the agent to interpret semantic hint from signage and reason about the subsequent action based on current observation. To address these challenges, we propose the Spatial-Temporal Aware Transformer (START) model for end-to-end decision-making. Leveraging a two-stage training strategy with Dataset Aggregation (DAgger), our approach achieves state-of-the-art performance, recording an 80% Success Rate (SR) and 0.74 NDTW on val-unseen split.
技術方法: 本文提出的方法:This paper introduces a novel embodied navigation task, SignNav, which requires the agent to interpret semantic hint from signage and reason about the subsequent action based on current observation. T
Key Takeaway: Real-world deployment further demonstrates the practicality of our method in physical environment without pre-built map.
核心發現: 核心結果:Real-world deployment further demonstrates the practicality of our method in physical environment without pre-built map.
Towards the Vision-Sound-Language-Action Paradigm: The HEAR Framework for Sound-Centric Manipulation
Authors: Chang Nie, Tianchen Deng, Guangming Wang et al. | Submitted: 2026-03-17 | arXiv: 2603.16086
Categories: cs.RO, cs.AI, cs.CV, cs.SD
Research Background: While recent Vision-Language-Action (VLA) models have begun to incorporate audio, they typically treat sound as static pre-execution prompts or focus exclusively on human speech. This leaves a significant gap in real-time, sound-centric manipulation where fleeting environmental acoustics provide critical state verification during task execution.
研究背景: 在機器人學習領域,While recent Vision-Language-Action (VLA) models have begun to incorporate audio, they typically treat sound as static pre-execution prompts or focus exclusively on human speech. T
Technical Approach: As an instantiation, we introduce HEAR, a VSLA framework integrating four components: (i) a streaming Historizer to maintain a compact, causal audio context across execution gaps; (ii) an Envisioner adapted from omni foundation models to reason over multi-sensory inputs; (iii) an Advancer, formulated as an audio world model, to learn temporal dynamics by predicting near-future audio codes; and (iv) a flow-matching Realizer policy to generate smooth action chunks.
技術方法: 本文提出的方法:As an instantiation, we introduce HEAR, a VSLA framework integrating four components: (i) a streaming Historizer to maintain a compact, causal audio context across execution gaps; (ii) an Envisioner a
Key Takeaway: Our results suggest that robust sound-centric manipulation necessitates causal persistence and explicit temporal learning.
核心發現: 核心結果:Our results suggest that robust sound-centric manipulation necessitates causal persistence and explicit temporal learning.
Large Reward Models: Generalizable Online Robot Reward Generation with Vision-Language Models
Authors: Yanru Wu, Weiduo Yuan, Ang Qi et al. | Submitted: 2026-03-17 | arXiv: 2603.16065
Categories: cs.RO, cs.AI
Research Background: Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing generalizable reward functions. In this paper, we propose a framework for online policy refinement by adapting foundation VLMs into online reward generators.
研究背景: 在機器人學習領域,Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing gener
Technical Approach: In this paper, we propose a framework for online policy refinement by adapting foundation VLMs into online reward generators. We develop a robust, scalable reward model based on a state-of-the-art VLM, trained on a large-scale, multi-source dataset encompassing real-world robot trajectories, human-object interactions, and diverse simulated environments. Unlike prior approaches that evaluate entire trajectories post-hoc, our method leverages the VLM to formulate a multifaceted reward signal comprising process, completion, and temporal contrastive rewards based on current visual observations.
技術方法: 本文提出的方法:In this paper, we propose a framework for online policy refinement by adapting foundation VLMs into online reward generators. We develop a robust, scalable reward model based on a state-of-the-art VLM
Key Takeaway: Experimental results demonstrate that our method significantly improves the success rate of the initial IL policy within just 30 RL iterations, demonstrating remarkable sample efficiency.
核心發現: 核心結果:Experimental results demonstrate that our method significantly improves the success rate of the initial IL policy within just 30 RL iterations, demonstrating remarkable sample efficiency.
The Era of End-to-End Autonomy: Transitioning from Rule-Based Driving to Large Driving Models
Authors: Eduardo Nebot, Julie Stephany Berrio Perez | Submitted: 2026-03-17 | arXiv: 2603.16050
Categories: cs.RO, cs.CV, eess.IV
Research Background: Autonomous driving is undergoing a shift from modular rule based pipelines toward end to end (E2E) learning systems. This paper examines this transition by tracing the evolution from classical sense perceive plan control architectures to large driving models (LDMs) capable of mapping raw sensor input directly to driving actions.
研究背景: 在機器人學習領域,Autonomous driving is undergoing a shift from modular rule based pipelines toward end to end (E2E) learning systems. This paper examines this transition by tracing the evolution fr
Technical Approach: This paper examines this transition by tracing the evolution from classical sense perceive plan control architectures to large driving models (LDMs) capable of mapping raw sensor input directly to driving actions.
技術方法: 本文提出的方法:This paper examines this transition by tracing the evolution from classical sense perceive plan control architectures to large driving models (LDMs) capable of mapping raw sensor input directly to dri
Key Takeaway: We also discuss how similar architectural advances may extend beyond autonomous vehicles (AV) to other embodied AI systems, including humanoid robotics.
核心發現: 核心結果:We also discuss how similar architectural advances may extend beyond autonomous vehicles (AV) to other embodied AI systems, including humanoid robotics.
Fast-WAM: Do World Action Models Need Test-time Future Imagination?
Authors: Tianyuan Yuan, Zibin Dong, Yicheng Liu et al. | Submitted: 2026-03-17 | arXiv: 2603.16666
Categories: cs.CV, cs.AI
Research Background: World Action Models (WAMs) have emerged as a promising alternative to Vision-Language-Action (VLA) models for embodied control because they explicitly model how visual observations may evolve under action. Most existing WAMs follow an imagine-then-execute paradigm, incurring substantial test-time latency from iterative video denoising, yet it remains unclear whether explicit future imagination is actually necessary for strong action performance.
研究背景: 在機器人學習領域,World Action Models (WAMs) have emerged as a promising alternative to Vision-Language-Action (VLA) models for embodied control because they explicitly model how visual observations
Technical Approach: In this paper, we ask whether WAMs need explicit future imagination at test time, or whether their benefit comes primarily from video modeling during training.
技術方法: 本文提出的方法:In this paper, we ask whether WAMs need explicit future imagination at test time, or whether their benefit comes primarily from video modeling during training.
Key Takeaway: These results suggest that the main value of video prediction in WAMs may lie in improving world representations during training rather than generating future observations at test time.
核心發現: 核心結果:These results suggest that the main value of video prediction in WAMs may lie in improving world representations during training rather than generating future observations at test time.
Segmentation-Based Attention Entropy: Detecting and Mitigating Object Hallucinations in Large Vision-Language Models
Authors: Jiale Song, Jiaxin Luo, Xue-song Tang et al. | Submitted: 2026-03-17 | arXiv: 2603.16558
Categories: cs.CV, cs.MM
Research Background: Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliability. Most existing studies focus on the text modality, attributing hallucinations to overly strong language priors and insufficient visual grounding.
研究背景: 在機器人學習領域,Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliability. Most existing studies focu
Technical Approach: Building on this observation, we propose Segmentation-based Attention Entropy (SAE), which leverages semantic segmentation to quantify visual attention uncertainty in an object-level semantic space. We evaluate our approach on public benchmarks and in real embodied multimodal scenarios with quadruped robots.
技術方法: 本文提出的方法:Building on this observation, we propose Segmentation-based Attention Entropy (SAE), which leverages semantic segmentation to quantify visual attention uncertainty in an object-level semantic space. W
Key Takeaway: Experimental results show that SAE substantially reduces object hallucinations without any additional training cost, thereby enabling more trustworthy LVLM-driven perception and decision-making.
核心發現: 核心結果:Experimental results show that SAE substantially reduces object hallucinations without any additional training cost, thereby enabling more trustworthy LVLM-driven perception and decision-making.
ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control
Authors: Haozhe Jia, Jianfei Song, Yuan Zhang et al. | Submitted: 2026-03-17 | arXiv: 2603.16188
Categories: cs.CV
Research Background: We present ECHO, an edge—cloud framework for language-driven whole-body control of humanoid robots. A cloud-hosted diffusion-based text-to-motion generator synthesizes motion references from natural language instructions, while an edge-deployed reinforcement-learning tracker executes them in closed loop on the robot.
研究背景: 在機器人學習領域,We present ECHO, an edge—cloud framework for language-driven whole-body control of humanoid robots. A cloud-hosted diffusion-based text-to-motion generator synthesizes motion refe
Technical Approach: We present ECHO, an edge—cloud framework for language-driven whole-body control of humanoid robots.
技術方法: 本文提出的方法:We present ECHO, an edge—cloud framework for language-driven whole-body control of humanoid robots.
Key Takeaway: Real-world experiments on a Unitree G1 humanoid demonstrate stable execution of diverse text commands with zero hardware fine-tuning.
核心發現: 核心結果:Real-world experiments on a Unitree G1 humanoid demonstrate stable execution of diverse text commands with zero hardware fine-tuning.
ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics
Authors: Gaotian Wang, Kejia Ren, Andrew S. Morgan et al. | Submitted: 2026-03-18 | arXiv: 2603.18336
Categories: cs.RO
Research Background: Dynamics models, whether simulators or learned world models, have long been central to robotic manipulation, but most focus on minimizing prediction error rather than confronting a more fundamental challenge: real-world manipulation is inherently uncertain. We argue that robust manipulation under uncertainty is fundamentally an integration problem: uncertainties must be represented, propagated, and constrained within the planning loop, not merely suppressed during training.
研究背景: 在機器人學習領域,Dynamics models, whether simulators or learned world models, have long been central to robotic manipulation, but most focus on minimizing prediction error rather than confronting a
Technical Approach: We present and open-source ManiDreams, a modular framework for uncertainty-aware manipulation planning over intuitive physics models.
技術方法: 本文提出的方法:We present and open-source ManiDreams, a modular framework for uncertainty-aware manipulation planning over intuitive physics models.
Key Takeaway: Runnable examples on pushing, picking, catching, and real-world deployment demonstrate flexibility across different policies, optimizers, physics backends, and executors.
核心發現: 核心結果:Runnable examples on pushing, picking, catching, and real-world deployment demonstrate flexibility across different policies, optimizers, physics backends, and executors.
Proprioceptive-only State Estimation for Legged Robots with Set-Coverage Measurements of Learned Dynamics
Authors: Abhijeet M. Kulkarni, Ioannis Poulakakis, Guoquan Huang | Submitted: 2026-03-18 | arXiv: 2603.18308
Categories: cs.RO
Research Background: Proprioceptive-only state estimation is attractive for legged robots since it is computationally cheaper and is unaffected by perceptually degraded conditions. The history of joint-level measurements contains rich information that can be used to infer the dynamics of the system and subsequently produce navigational measurements.
研究背景: 在機器人學習領域,Proprioceptive-only state estimation is attractive for legged robots since it is computationally cheaper and is unaffected by perceptually degraded conditions. The history of joint
Technical Approach: In this work, we propose a proprioceptive-only state estimation framework for legged robots that characterizes the measurement noise using set-coverage statements that do not assume any distribution. We develop a practical and computationally inexpensive method to use these set-coverage measurements with a Gaussian filter in a systematic way.
技術方法: 本文提出的方法:In this work, we propose a proprioceptive-only state estimation framework for legged robots that characterizes the measurement noise using set-coverage statements that do not assume any distribution.
Key Takeaway: Comparison with the Gaussian baselines shows that our proposed method remains consistent and is not prone to drift under real noise scenarios.
核心發現: 核心結果:Comparison with the Gaussian baselines shows that our proposed method remains consistent and is not prone to drift under real noise scenarios.
GoalVLM: VLM-driven Object Goal Navigation for Multi-Agent System
Authors: MoniJesu James, Amir Atef Habel, Aleksey Fedoseev et al. | Submitted: 2026-03-18 | arXiv: 2603.18210
Categories: cs.RO
Research Background: Object-goal navigation has traditionally been limited to ground robots with closed-set object vocabularies. Existing multi-agent approaches depend on precomputed probabilistic graphs tied to fixed category sets, precluding generalization to novel goals at test time.
研究背景: 在機器人學習領域,Object-goal navigation has traditionally been limited to ground robots with closed-set object vocabularies. Existing multi-agent approaches depend on precomputed probabilistic grap
Technical Approach: We present GoalVLM, a cooperative multi-agent framework for zero-shot, open-vocabulary object navigation.
技術方法: 本文提出的方法:We present GoalVLM, a cooperative multi-agent framework for zero-shot, open-vocabulary object navigation.
Key Takeaway: GoalVLM with N=2 agents achieves 55.8% subtask SR and 18.3% SPL, competitive with state-of-the-art methods while requiring no task-specific training.
核心發現: 核心結果:GoalVLM with N=2 agents achieves 55.8% subtask SR and 18.3% SPL, competitive with state-of-the-art methods while requiring no task-specific training.
RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoids
Authors: Xichen Yuan, Zhe Li, Bofan Lyu et al. | Submitted: 2026-03-18 | arXiv: 2603.17927
Categories: cs.RO
Research Background: While generative models have become effective at producing human-like motions from text, transferring these motions to humanoid robots for physical execution remains challenging. Existing pipelines are often limited by retargeting, where kinematic quality is undermined by physical infeasibility, contact-transition errors, and the high cost of real-world dynamical data.
研究背景: 在機器人學習領域,While generative models have become effective at producing human-like motions from text, transferring these motions to humanoid robots for physical execution remains challenging. E
Technical Approach: We present a unified latent-driven framework that bridges natural language and whole-body humanoid locomotion through a retarget-free, physics-optimized pipeline. Rather than treating generation and control as separate stages, our key insight is to couple them bidirectionally under physical constraints.We introduce a Physical Plausibility Optimization (PP-Opt) module as the coupling interface. By coupling diffusion-based motion generation with physical plausibility optimization, our framework provides a practical path toward deployable text-guided humanoid intelligence.
技術方法: 本文提出的方法:We present a unified latent-driven framework that bridges natural language and whole-body humanoid locomotion through a retarget-free, physics-optimized pipeline. Rather than treating generation and c
Key Takeaway: Across IsaacLab and MuJoCo, the implicit latent-driven pipeline consistently outperforms conventional explicit retargeting baselines in both precision and stability.
核心發現: 核心結果:Across IsaacLab and MuJoCo, the implicit latent-driven pipeline consistently outperforms conventional explicit retargeting baselines in both precision and stability.
Generative Control as Optimization: Time Unconditional Flow Matching for Adaptive and Robust Robotic Control
Authors: Zunzhe Zhang, Runhan Huang, Yicheng Liu et al. | Submitted: 2026-03-18 | arXiv: 2603.17834
Categories: cs.RO, cs.AI
Research Background: Diffusion models and flow matching have become a cornerstone of robotic imitation learning, yet they suffer from a structural inefficiency where inference is often bound to a fixed integration schedule that is agnostic to state complexity. This paradigm forces the policy to expend the same computational budget on trivial motions as it does on complex tasks.
研究背景: 在機器人學習領域,Diffusion models and flow matching have become a cornerstone of robotic imitation learning, yet they suffer from a structural inefficiency where inference is often bound to a fixed
Technical Approach: We introduce Generative Control as Optimization (GeCO), a time-unconditional framework that transforms action synthesis from trajectory integration into iterative optimization.
技術方法: 本文提出的方法:We introduce Generative Control as Optimization (GeCO), a time-unconditional framework that transforms action synthesis from trajectory integration into iterative optimization.
Key Takeaway: As a plug-and-play replacement for standard flow-matching heads, GeCO improves success rates and efficiency with an optimization-native mechanism for safe deployment.
核心發現: 核心結果:As a plug-and-play replacement for standard flow-matching heads, GeCO improves success rates and efficiency with an optimization-native mechanism for safe deployment.
Consistency-Driven Dual LSTM Models for Kinematic Control of a Wearable Soft Robotic Arm
Authors: Xingyu Chen, Yi Xiong, Li Wen | Submitted: 2026-03-18 | arXiv: 2603.17672
Categories: cs.RO
Research Background: In this paper, we introduce a consistency-driven dual LSTM framework for accurately learning both the forward and inverse kinematics of a pneumatically actuated soft robotic arm integrated into a wearable device. This approach effectively captures the nonlinear and hysteretic behaviors of soft pneumatic actuators while addressing the one-to-many mapping challenge between actuation inputs and end-effector positions.
研究背景: 在機器人學習領域,In this paper, we introduce a consistency-driven dual LSTM framework for accurately learning both the forward and inverse kinematics of a pneumatically actuated soft robotic arm in
Technical Approach: In this paper, we introduce a consistency-driven dual LSTM framework for accurately learning both the forward and inverse kinematics of a pneumatically actuated soft robotic arm integrated into a wearable device. Extensive experiments-including trajectory tracking, ablation studies, and wearable demonstrations-confirm the effectiveness of our method.
技術方法: 本文提出的方法:In this paper, we introduce a consistency-driven dual LSTM framework for accurately learning both the forward and inverse kinematics of a pneumatically actuated soft robotic arm integrated into a wear
Key Takeaway: Moreover, the wearable soft robotic arm demonstrates strong human-robot collaboration capabilities and adaptability in everyday tasks such as object handover, obstacle-aware pick-and-place, and drawer operation.
核心發現: 核心結果:Moreover, the wearable soft robotic arm demonstrates strong human-robot collaboration capabilities and adaptability in everyday tasks such as object handover, obstacle-aware pick-and-place, and drawer
REAL: Robust Extreme Agility via Spatio-Temporal Policy Learning and Physics-Guided Filtering
Authors: Jialong Liu, Dehan Shen, Yanbo Wen et al. | Submitted: 2026-03-18 | arXiv: 2603.17653
Categories: cs.RO
Research Background: Extreme legged parkour demands rapid terrain assessment and precise foot placement under highly dynamic conditions. While recent learning-based systems achieve impressive agility, they remain fundamentally fragile to perceptual degradation, where even brief visual noise or latency can cause catastrophic failure.
研究背景: 在機器人學習領域,Extreme legged parkour demands rapid terrain assessment and precise foot placement under highly dynamic conditions. While recent learning-based systems achieve impressive agility,
Technical Approach: To overcome this, we propose Robust Extreme Agility Learning (REAL), an end-to-end framework for reliable parkour under sensory corruption.
技術方法: 本文提出的方法:To overcome this, we propose Robust Extreme Agility Learning (REAL), an end-to-end framework for reliable parkour under sensory corruption.
Key Takeaway: While recent learning-based systems achieve impressive agility, they remain fundamentally fragile to perceptual degradation, where even brief visual noise or latency can cause catastrophic failure.
核心發現: 核心結果:While recent learning-based systems achieve impressive agility, they remain fundamentally fragile to perceptual degradation, where even brief visual noise or latency can cause catastrophic failure.
OmniVLN: Omnidirectional 3D Perception and Token-Efficient LLM Reasoning for Visual-Language Navigation across Air and Ground Platforms
Authors: Zhongyuang Liu, Min He, Shaonan Yu et al. | Submitted: 2026-03-18 | arXiv: 2603.17351
Categories: cs.RO
Research Background: Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real indoor environments because narrow field-of-view sensing exposes only a partial local scene at each step, often forcing repeated rotations, delaying target discovery, and producing fragmented spatial understanding; meanwhile, directly prompting LLMs with dense 3D maps or exhaustive object lists quickly exceeds the context budget.
研究背景: 在機器人學習領域,Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliab
Technical Approach: We present OmniVLN, a zero-shot visual-language navigation framework that couples omnidirectional 3D perception with token-efficient hierarchical reasoning for both aerial and ground robots.
技術方法: 本文提出的方法:We present OmniVLN, a zero-shot visual-language navigation framework that couples omnidirectional 3D perception with token-efficient hierarchical reasoning for both aerial and ground robots.
Key Takeaway: Experiments show that the proposed hierarchical interface improves spatial referring accuracy from 77.27% to 93.18%, reduces cumulative prompt tokens by up to 61.7% in cluttered multi-room settings, and improves navigation success by up to 11.68% over a flat-list baseline.
核心發現: 核心結果:Experiments show that the proposed hierarchical interface improves spatial referring accuracy from 77.27% to 93.18%, reduces cumulative prompt tokens by up to 61.7% in cluttered multi-room settings
DexEXO: A Wearability-First Dexterous Exoskeleton for Operator-Agnostic Demonstration and Learning
Authors: Alvin Zhu, Mingzhang Zhu, Beom Jun Kim et al. | Submitted: 2026-03-18 | arXiv: 2603.17323
Categories: cs.RO
Research Background: Scaling dexterous robot learning is constrained by the difficulty of collecting high-quality demonstrations across diverse operators. Existing wearable interfaces often trade comfort and cross-user adaptability for kinematic fidelity, while embodiment mismatch between demonstration and deployment requires visual post-processing before policy training.
研究背景: 在機器人學習領域,Scaling dexterous robot learning is constrained by the difficulty of collecting high-quality demonstrations across diverse operators. Existing wearable interfaces often trade comfo
Technical Approach: We present DexEXO, a wearability-first hand exoskeleton that aligns visual appearance, contact geometry, and kinematics at the hardware level.
技術方法: 本文提出的方法:We present DexEXO, a wearability-first hand exoskeleton that aligns visual appearance, contact geometry, and kinematics at the hardware level.
Key Takeaway: These results show that prioritizing wearability and hardware-level embodiment alignment reduces both human and algorithmic bottlenecks without sacrificing task performance.
核心發現: 核心結果:These results show that prioritizing wearability and hardware-level embodiment alignment reduces both human and algorithmic bottlenecks without sacrificing task performance.
Recurrent Reasoning with Vision-Language Models for Estimating Long-Horizon Embodied Task Progress
Authors: Yuelin Zhang, Sijie Cheng, Chen Li et al. | Submitted: 2026-03-18 | arXiv: 2603.17312
Categories: cs.CV, cs.AI
Research Background: Accurately estimating task progress is critical for embodied agents to plan and execute long-horizon, multi-step tasks. Despite promising advances, existing Vision-Language Models (VLMs) based methods primarily leverage their video understanding capabilities, while neglecting their complex reasoning potential.
研究背景: 在機器人學習領域,Accurately estimating task progress is critical for embodied agents to plan and execute long-horizon, multi-step tasks. Despite promising advances, existing Vision-Language Models
Technical Approach: To address these challenges, we propose the Recurrent Reasoning Vision-Language Model (VLM).
技術方法: 本文提出的方法:To address these challenges, we propose the Recurrent Reasoning Vision-Language Model (VLM).
Key Takeaway: Extensive experiments on progress estimation and downstream applications, including progress-enhanced policy learning, reward modeling for reinforcement learning, and proactive assistance, demonstrate that VLM achieves strong performance and generalization, achieving a new state-of-the-art in long-horizon task progress estimation.
核心發現: 核心結果:Extensive experiments on progress estimation and downstream applications, including progress-enhanced policy learning, reward modeling for reinforcement learning, and proactive assistance, demonstrate
SOFTMAP: Sim2Real Soft Robot Forward Modeling via Topological Mesh Alignment and Physics Prior
Authors: Ziyong Ma, Uksang Yoo, Jonathan Francis et al. | Submitted: 2026-03-19 | arXiv: 2603.19384
Categories: cs.RO
Research Background: While soft robot manipulators offer compelling advantages over rigid counterparts, including inherent compliance, safe human-robot interaction, and the ability to conform to complex geometries, accurate forward modeling from low-dimensional actuation commands remains an open challenge due to nonlinear material phenomena such as hysteresis and manufacturing variability. We present SOFTMAP, a sim-to-real learning framework for real-time 3D forward modeling of tendon-actuated soft finger manipulators.
研究背景: 在機器人學習領域,While soft robot manipulators offer compelling advantages over rigid counterparts, including inherent compliance, safe human-robot interaction, and the ability to conform to comple
Technical Approach: We present SOFTMAP, a sim-to-real learning framework for real-time 3D forward modeling of tendon-actuated soft finger manipulators.
技術方法: 本文提出的方法:We present SOFTMAP, a sim-to-real learning framework for real-time 3D forward modeling of tendon-actuated soft finger manipulators.
Key Takeaway: Our results show that SOFTMAP provides a data-efficient approach for 3D forward modeling and control of soft manipulators.
核心發現: 核心結果:Our results show that SOFTMAP provides a data-efficient approach for 3D forward modeling and control of soft manipulators.
Fire as a Service: Augmenting Robot Simulators with Thermally and Visually Accurate Fire Dynamics
Authors: Anton R. Wagner, Madhan Balaji Rao, Helge Wrede et al. | Submitted: 2026-03-19 | arXiv: 2603.19063
Categories: cs.RO, cs.GR
Research Background: Most existing robot simulators prioritize rigid-body dynamics and photorealistic rendering, but largely neglect the thermally and optically complex phenomena that characterize real-world fire environments. For robots envisioned as future firefighters, this limitation hinders both reliable capability evaluation and the generation of representative training data prior to deployment in hazardous scenarios.
研究背景: 在機器人學習領域,Most existing robot simulators prioritize rigid-body dynamics and photorealistic rendering, but largely neglect the thermally and optically complex phenomena that characterize real
Technical Approach: To address these challenges, we introduce Fire as a Service (FaaS), a novel, asynchronous co-simulation framework that augments existing robot simulators with high-fidelity and computationally efficient fire simulations. We demonstrate that our framework can be integrated with diverse robot simulators to generate physically accurate fire behavior, benchmark thermal hazards encountered by robotic platforms, and collect realistic multimodal perceptual data.
技術方法: 本文提出的方法:To address these challenges, we introduce Fire as a Service (FaaS), a novel, asynchronous co-simulation framework that augments existing robot simulators with high-fidelity and computationally efficie
Key Takeaway: We demonstrate that our framework can be integrated with diverse robot simulators to generate physically accurate fire behavior, benchmark thermal hazards encountered by robotic platforms, and collect realistic multimodal perceptual data.
核心發現: 核心結果:We demonstrate that our framework can be integrated with diverse robot simulators to generate physically accurate fire behavior, benchmark thermal hazards encountered by robotic platforms, and collect
ATG-MoE: Autoregressive trajectory generation with mixture-of-experts for assembly skill learning
Authors: Weihang Huang, Chaoran Zhang, Xiaoxin Deng et al. | Submitted: 2026-03-19 | arXiv: 2603.19029
Categories: cs.RO
Research Background: Flexible manufacturing requires robot systems that can adapt to constantly changing tasks, objects, and environments. However, traditional robot programming is labor-intensive and inflexible, while existing learning-based assembly methods often suffer from weak positional generalization, complex multi-stage designs, and limited multi-skill integration capability.
研究背景: 在機器人學習領域,Flexible manufacturing requires robot systems that can adapt to constantly changing tasks, objects, and environments. However, traditional robot programming is labor-intensive and
Technical Approach: To address these issues, this paper proposes ATG-MoE, an end-to-end autoregressive trajectory generation method with mixture of experts for assembly skill learning from demonstration.
技術方法: 本文提出的方法:To address these issues, this paper proposes ATG-MoE, an end-to-end autoregressive trajectory generation method with mixture of experts for assembly skill learning from demonstration.
Key Takeaway: Real-world experiments further verify its practicality for multi-skill industrial assembly.
核心發現: 核心結果:Real-world experiments further verify its practicality for multi-skill industrial assembly.
V-Dreamer: Automating Robotic Simulation and Trajectory Synthesis via Video Generation Priors
Authors: Songjia He, Zixuan Chen, Hongyu Ding et al. | Submitted: 2026-03-19 | arXiv: 2603.18811
Categories: cs.RO
Research Background: Training generalist robots demands large-scale, diverse manipulation data, yet real-world collection is prohibitively expensive, and existing simulators are often constrained by fixed asset libraries and manual heuristics. To bridge this gap, we present V-Dreamer, a fully automated framework that generates open-vocabulary, simulation-ready manipulation environments and executable expert trajectories directly from natural language instructions.
研究背景: 在機器人學習領域,Training generalist robots demands large-scale, diverse manipulation data, yet real-world collection is prohibitively expensive, and existing simulators are often constrained by fi
Technical Approach: To bridge this gap, we present V-Dreamer, a fully automated framework that generates open-vocabulary, simulation-ready manipulation environments and executable expert trajectories directly from natural language instructions. Crucially, for behavior synthesis, we leverage video generation models as rich motion priors.
技術方法: 本文提出的方法:To bridge this gap, we present V-Dreamer, a fully automated framework that generates open-vocabulary, simulation-ready manipulation environments and executable expert trajectories directly from natura
Key Takeaway: Extensive evaluations on tabletop manipulation tasks using the Piper robotic arm demonstrate that our policies robustly generalize to unseen objects in simulation and achieve effective sim-to-real transfer, successfully manipulating novel real-world objects.
核心發現: 核心結果:Extensive evaluations on tabletop manipulation tasks using the Piper robotic arm demonstrate that our policies robustly generalize to unseen objects in simulation and achieve effective sim-to-real tra
Empathetic Motion Generation for Humanoid Educational Robots via Reasoning-Guided Vision—Language—Motion Diffusion Architecture
Authors: Fuze Sun, Lingyu Li, Lekan Dai et al. | Submitted: 2026-03-19 | arXiv: 2603.18771
Categories: cs.RO
Research Background: This article suggests a reasoning-guided vision-language-motion diffusion framework (RG-VLMD) for generating instruction-aware co-speech gestures for humanoid robots in educational scenarios. The system integrates multi-modal affective estimation, pedagogical reasoning, and teaching-act-conditioned motion synthesis to enable adaptive and semantically consistent robot behavior.
研究背景: 在機器人學習領域,This article suggests a reasoning-guided vision-language-motion diffusion framework (RG-VLMD) for generating instruction-aware co-speech gestures for humanoid robots in educational
Technical Approach: The system integrates multi-modal affective estimation, pedagogical reasoning, and teaching-act-conditioned motion synthesis to enable adaptive and semantically consistent robot behavior. A gated mixture-of-experts model predicts Valence/Arousal from input text, visual, and acoustic features, which then mapped to discrete teaching-act categories through an affect-driven policy.These signals condition a diffusion-based motion generator using clip-level intent and frame-level instructional schedules via additive latent restriction with auxiliary action-group supervision. Compared to a baseline diffusion model, our proposed method produces more structured and distinctive motion patterns, as verified by motion statics and pairwise distance analysis.
技術方法: 本文提出的方法:The system integrates multi-modal affective estimation, pedagogical reasoning, and teaching-act-conditioned motion synthesis to enable adaptive and semantically consistent robot behavior. A gated mixt
Key Takeaway: The results reveal that reasoning-guided instructional conditioning improves gesture controllability and pedagogical expressiveness in educational human-robot interaction.
核心發現: 核心結果:The results reveal that reasoning-guided instructional conditioning improves gesture controllability and pedagogical expressiveness in educational human-robot interaction.
Robotic Agentic Platform for Intelligent Electric Vehicle Disassembly
Authors: Zachary Allen, Max Conway, Lyle Antieau et al. | Submitted: 2026-03-19 | arXiv: 2603.18520
Categories: cs.RO
Research Background: Electric vehicles (EV) create an urgent need for scalable battery recycling, yet disassembly of EV battery packs remains largely manual due to high design variability. We present our Robotic Agentic Platform for Intelligent Disassembly (RAPID), designed to investigate perception-driven manipulation, flexible automation, and AI-assisted robot programming in realistic recycling scenarios.
研究背景: 在機器人學習領域,Electric vehicles (EV) create an urgent need for scalable battery recycling, yet disassembly of EV battery packs remains largely manual due to high design variability. We present o
Technical Approach: We present our Robotic Agentic Platform for Intelligent Disassembly (RAPID), designed to investigate perception-driven manipulation, flexible automation, and AI-assisted robot programming in realistic recycling scenarios. To support flexible interaction, we introduce agentic AI specifications for robotic disassembly tasks, allowing LLM agents to translate high-level instructions into robot actions through structured tool interfaces and ROS services.
技術方法: 本文提出的方法:We present our Robotic Agentic Platform for Intelligent Disassembly (RAPID), designed to investigate perception-driven manipulation, flexible automation, and AI-assisted robot programming in realistic
Key Takeaway: Tool-based interfaces achieve 100% task completion, while automatic ROS service discovery shows 43.3% failure rates, highlighting the need for structured robot APIs for reliable LLM-driven control.
核心發現: 核心結果:Tool-based interfaces achieve 100% task completion, while automatic ROS service discovery shows 43.3% failure rates, highlighting the need for structured robot APIs for reliable LLM-driven control.
SutureFormer: Learning Surgical Trajectories via Goal-conditioned Offline RL in Pixel Space
Authors: Huanrong Liu, Chunlin Tian, Tongyu Jia et al. | Submitted: 2026-03-19 | arXiv: 2603.26720
Categories: cs.RO, cs.AI
Research Background: Predicting surgical needle trajectories from endoscopic video is critical for robot-assisted suturing, enabling anticipatory planning, real-time guidance, and safer motion execution. Existing methods that directly learn motion distributions from visual observations tend to overlook the sequential dependency among adjacent motion steps.
研究背景: 在機器人學習領域,Predicting surgical needle trajectories from endoscopic video is critical for robot-assisted suturing, enabling anticipatory planning, real-time guidance, and safer motion executio
Technical Approach: To address these challenges, we formulate image-based needle trajectory prediction as a sequential decision-making problem, in which the needle tip is treated as an agent that moves step by step in pixel space. From this perspective, we propose SutureFormer, a goal-conditioned offline reinforcement learning framework that leverages sparse annotations to dense reward signals via cubic spline interpolation, encouraging the policy to exploit limited expert guidance while exploring plausible future motion paths.
技術方法: 本文提出的方法:To address these challenges, we formulate image-based needle trajectory prediction as a sequential decision-making problem, in which the needle tip is treated as an agent that moves step by step in pi
Key Takeaway: Experiments on a new kidney wound suturing dataset containing 1,158 trajectories from 50 patients show that SutureFormer reduces Average Displacement Error by 58.6% compared with the strongest baseline, demonstrating the effectiveness of modeling needle trajectory prediction as pixel-level sequential action learning.
核心發現: 核心結果:Experiments on a new kidney wound suturing dataset containing 1,158 trajectories from 50 patients show that SutureFormer reduces Average Displacement Error by 58.6% compared with the strongest baselin
Contact Status Recognition and Slip Detection with a Bio-inspired Tactile Hand
Authors: Chengxiao He, Wenhui Yang, Hongliang Zhao et al. | Submitted: 2026-03-19 | arXiv: 2603.18370
Categories: cs.RO
Research Background: Stable and reliable grasp is critical to robotic manipulations especially for fragile and glazed objects, where the grasp force requires precise control as too large force possibly damages the objects while small force leads to slip and fall-off. Although it is assumed the objects to manipulate is grasped firmly in advance, slip detection and timely prevention are necessary for a robot in unstructured and universal environments.
研究背景: 在機器人學習領域,Stable and reliable grasp is critical to robotic manipulations especially for fragile and glazed objects, where the grasp force requires precise control as too large force possibly
Technical Approach: Although it is assumed the objects to manipulate is grasped firmly in advance, slip detection and timely prevention are necessary for a robot in unstructured and universal environments. In this work, we addressed this issue by utilizing multimodal tactile feedback from a five-fingered bio-inspired hand. Motivated by human hands, the tactile sensing elements were distributed and embedded into the soft skin of robotic hand, forming 24 tactile channels in total.
技術方法: 本文提出的方法:Although it is assumed the objects to manipulate is grasped firmly in advance, slip detection and timely prevention are necessary for a robot in unstructured and universal environments. In this work,
Key Takeaway: When applied to four new unseen materials, a high accuracy of 91.95% was still achieved, which further validated the generalization of our proposed method.
核心發現: 核心結果:When applied to four new unseen materials, a high accuracy of 91.95% was still achieved, which further validated the generalization of our proposed method.
MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction
Authors: Haitian Li, Haozhe Xie, Junxiang Xu et al. | Submitted: 2026-03-19 | arXiv: 2603.19231
Categories: cs.CV
Research Background: Reconstructing articulated 3D objects from a single image requires jointly inferring object geometry, part structure, and motion parameters from limited visual evidence. A key difficulty lies in the entanglement between motion cues and object structure, which makes direct articulation regression unstable.
研究背景: 在機器人學習領域,Reconstructing articulated 3D objects from a single image requires jointly inferring object geometry, part structure, and motion parameters from limited visual evidence. A key diff
Technical Approach: We present MonoArt, a unified framework grounded in progressive structural reasoning.
技術方法: 本文提出的方法:We present MonoArt, a unified framework grounded in progressive structural reasoning.
Key Takeaway: Extensive experiments on PartNet-Mobility demonstrate that OM achieves state-of-the-art performance in both reconstruction accuracy and inference speed.
核心發現: 核心結果:Extensive experiments on PartNet-Mobility demonstrate that OM achieves state-of-the-art performance in both reconstruction accuracy and inference speed.
GHOST: Fast Category-agnostic Hand-Object Interaction Reconstruction from RGB Videos using Gaussian Splatting
Authors: Ahmed Tawfik Aboukhadra, Marcel Rogge, Nadia Robertini et al. | Submitted: 2026-03-19 | arXiv: 2603.18912
Categories: cs.CV
Research Background: Understanding realistic hand-object interactions from monocular RGB videos is essential for AR/VR, robotics, and embodied AI. Existing methods rely on category-specific templates or heavy computation, yet still produce physically inconsistent hand-object alignment in 3D.
研究背景: 在機器人學習領域,Understanding realistic hand-object interactions from monocular RGB videos is essential for AR/VR, robotics, and embodied AI. Existing methods rely on category-specific templates o
Technical Approach: We introduce GHOST (Gaussian Hand-Object Splatting), a fast, category-agnostic framework for reconstructing dynamic hand-object interactions using 2D Gaussian Splatting.
技術方法: 本文提出的方法:We introduce GHOST (Gaussian Hand-Object Splatting), a fast, category-agnostic framework for reconstructing dynamic hand-object interactions using 2D Gaussian Splatting.
Key Takeaway: Extensive experiments on ARCTIC, HO3D, and in-the-wild datasets demonstrate state-of-the-art accuracy in 3D reconstruction and 2D rendering quality, establishing GHOST as an efficient and robust solution for realistic hand-object interaction modeling.
核心發現: 核心結果:Extensive experiments on ARCTIC, HO3D, and in-the-wild datasets demonstrate state-of-the-art accuracy in 3D reconstruction and 2D rendering quality, establishing GHOST as an efficient and robust solut
MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
Authors: Youngwan Lee, Soojin Jang, Yoorhim Cho et al. | Submitted: 2026-03-19 | arXiv: 2603.18892
Categories: cs.CV, cs.AI
Research Background: Spatial reasoning is foundational for Vision-Language Models (VLMs), particularly when deployed as Vision-Language-Action (VLA) agents in physical environments. However, existing benchmarks predominantly focus on elementary, single-hop relations, neglecting the multi-hop compositional reasoning and precise visual grounding essential for real-world scenarios.
研究背景: 在機器人學習領域,Spatial reasoning is foundational for Vision-Language Models (VLMs), particularly when deployed as Vision-Language-Action (VLA) agents in physical environments. However, existing b
Technical Approach: To address this, we introduce MultihopSpatial, offering three key contributions: (1) A comprehensive benchmark designed for multi-hop and compositional spatial reasoning, featuring 1- to 3-hop complex queries across diverse spatial perspectives.
技術方法: 本文提出的方法:To address this, we introduce MultihopSpatial, offering three key contributions: (1) A comprehensive benchmark designed for multi-hop and compositional spatial reasoning, featuring 1- to 3-hop complex
Key Takeaway: Finally, we demonstrate that reinforcement learning post-training on our corpus enhances both intrinsic VLM spatial reasoning and downstream embodied manipulation performance.
核心發現: 核心結果:Finally, we demonstrate that reinforcement learning post-training on our corpus enhances both intrinsic VLM spatial reasoning and downstream embodied manipulation performance.
Memory Over Maps: 3D Object Localization Without Reconstruction
Authors: Rui Zhou, Xander Yap, Jianwen Cao et al. | Submitted: 2026-03-20 | arXiv: 2603.20530
Categories: cs.RO, cs.CV
Research Background: Target localization is a prerequisite for embodied tasks such as navigation and manipulation. Conventional approaches rely on constructing explicit 3D scene representations to enable target localization, such as point clouds, voxel grids, or scene graphs.
研究背景: 在機器人學習領域,Target localization is a prerequisite for embodied tasks such as navigation and manipulation. Conventional approaches rely on constructing explicit 3D scene representations to enab
Technical Approach: At query time, our method retrieves candidate views, re-ranks them with a vision-language model, and constructs a sparse, on-demand 3D estimate of the queried target through depth backprojection and multi-view fusion. Despite requiring no task-specific training, our approach achieves strong performance across multiple benchmarks, demonstrating that direct reasoning over image-based scene memory can effectively replace dense 3D reconstruction for object-centric robot navigation.
技術方法: 本文提出的方法:At query time, our method retrieves candidate views, re-ranks them with a vision-language model, and constructs a sparse, on-demand 3D estimate of the queried target through depth backprojection and m
Key Takeaway: Despite requiring no task-specific training, our approach achieves strong performance across multiple benchmarks, demonstrating that direct reasoning over image-based scene memory can effectively replace dense 3D reconstruction for object-centric robot navigation.
核心發現: 核心結果:Despite requiring no task-specific training, our approach achieves strong performance across multiple benchmarks, demonstrating that direct reasoning over image-based scene memory can effectively repl
Not an Obstacle for Dog, but a Hazard for Human: A Co-Ego Navigation System for Guide Dog Robots
Authors: Ruiping Liu, Jingqi Zhang, Junwei Zheng et al. | Submitted: 2026-03-20 | arXiv: 2603.20121
Categories: cs.RO
Research Background: Guide dogs offer independence to Blind and Low-Vision (BLV) individuals, yet their limited availability leaves the vast majority of BLV users without access. Quadruped robotic guide dogs present a promising alternative, but existing systems rely solely on the robot’s ground-level sensors for navigation, overlooking a critical class of hazards: obstacles that are transparent to the robot yet dangerous at human body height, such as bent branches.
研究背景: 在機器人學習領域,Guide dogs offer independence to Blind and Low-Vision (BLV) individuals, yet their limited availability leaves the vast majority of BLV users without access. Quadruped robotic guid
Technical Approach: Quadruped robotic guide dogs present a promising alternative, but existing systems rely solely on the robot’s ground-level sensors for navigation, overlooking a critical class of hazards: obstacles that are transparent to the robot yet dangerous at human body height, such as bent branches. We term this the viewpoint asymmetry problem and present the first system to explicitly address it. Our Co-Ego system adopts a dual-branch obstacle avoidance framework that integrates the robot-centric ground sensing with the user’s elevated egocentric perspective to ensure comprehensive navigation safety.
技術方法: 本文提出的方法:Quadruped robotic guide dogs present a promising alternative, but existing systems rely solely on the robot’s ground-level sensors for navigation, overlooking a critical class of hazards: obstacles th
Key Takeaway: Results demonstrate that cross-view fusion significantly reduces collision times and cognitive load, verifying the necessity of viewpoint complementarity for safe robotic guide dog navigation.
核心發現: 核心結果:Results demonstrate that cross-view fusion significantly reduces collision times and cognitive load, verifying the necessity of viewpoint complementarity for safe robotic guide dog navigation.
Sense4HRI: A ROS 2 HRI Framework for Physiological Sensor Integration and Synchronized Logging
Authors: Manuel Scheibl, Julian Leichert, Sinem Görmez et al. | Submitted: 2026-03-20 | arXiv: 2603.19914
Categories: cs.HC, cs.RO
Research Background: Physiological signals are increasingly relevant to estimate the mental states of users in human-robot interaction (HRI), yet ROS 2-based HRI frameworks still lack reusable support to integrate such data streams in a standardized way. Therefore, we propose Sense4HRI, an adapted framework for human-robot interaction in ROS 2 that integrates physiological measurements and derived user-state indicators.
研究背景: 在機器人學習領域,Physiological signals are increasingly relevant to estimate the mental states of users in human-robot interaction (HRI), yet ROS 2-based HRI frameworks still lack reusable support
Technical Approach: Therefore, we propose Sense4HRI, an adapted framework for human-robot interaction in ROS 2 that integrates physiological measurements and derived user-state indicators.
技術方法: 本文提出的方法:Therefore, we propose Sense4HRI, an adapted framework for human-robot interaction in ROS 2 that integrates physiological measurements and derived user-state indicators.
Key Takeaway: In addition, it introduces reusable interfaces for timestamped physiological time-series data and supports synchronized logging of physiological signals together with experiment context, enabling interoperable and traceable multimodal analysis within ROS 2-based HRI systems.
核心發現: 核心結果:In addition, it introduces reusable interfaces for timestamped physiological time-series data and supports synchronized logging of physiological signals together with experiment context, enabling inte
Why Cognitive Robotics Matters: Lessons from OntoAgent and LLM Deployment in HARMONIC for Safety-Critical Robot Teaming
Authors: Sanjay Oruganti, Sergei Nirenburg, Marjorie McShane et al. | Submitted: 2026-03-20 | arXiv: 2603.26730
Categories: cs.RO
Research Background: Deploying embodied AI agents in the physical world demands cognitive capabilities for long-horizon planning that execute reliably, deterministically, and transparently. We present HARMONIC, a cognitive-robotic architecture that pairs OntoAgent, a content-centric cognitive architecture providing metacognitive self-monitoring, domain-grounded diagnosis, and consequence-based action selection over ontologically structured knowledge, with a modular reactive tactical layer.
研究背景: 在機器人學習領域,Deploying embodied AI agents in the physical world demands cognitive capabilities for long-horizon planning that execute reliably, deterministically, and transparently. We present
Technical Approach: We present HARMONIC, a cognitive-robotic architecture that pairs OntoAgent, a content-centric cognitive architecture providing metacognitive self-monitoring, domain-grounded diagnosis, and consequence-based action selection over ontologically structured knowledge, with a modular reactive tactical layer.
技術方法: 本文提出的方法:We present HARMONIC, a cognitive-robotic architecture that pairs OntoAgent, a content-centric cognitive architecture providing metacognitive self-monitoring, domain-grounded diagnosis, and consequence
Key Takeaway: Results reveal that LLMs do not consistently assess their own knowledge state before acting, causing downstream failures in diagnostic reasoning and action selection.
核心發現: 核心結果:Results reveal that LLMs do not consistently assess their own knowledge state before acting, causing downstream failures in diagnostic reasoning and action selection.
Morphology-Consistent Humanoid Interaction through Robot-Centric Video Synthesis
Authors: Weisheng Xu, Jian Li, Yi Gu et al. | Submitted: 2026-03-20 | arXiv: 2603.19709
Categories: cs.RO
Research Background: Equipping humanoid robots with versatile interaction skills typically requires either extensive policy training or explicit human-to-robot motion retargeting. However, learning-based policies face prohibitive data collection costs.
研究背景: 在機器人學習領域,Equipping humanoid robots with versatile interaction skills typically requires either extensive policy training or explicit human-to-robot motion retargeting. However, learning-bas
Technical Approach: In this work, we propose Dream2Act, a robot-centric framework enabling zero-shot interaction through generative video synthesis. Given a third-person image of the robot and target object, our framework leverages video generation models to envision the robot completing the task with morphology-consistent motion.
技術方法: 本文提出的方法:In this work, we propose Dream2Act, a robot-centric framework enabling zero-shot interaction through generative video synthesis. Given a third-person image of the robot and target object, our framewor
Key Takeaway: Dream2Act achieves a 37.5% overall success rate, compared to 0% for conventional retargeting.
核心發現: 核心結果:Dream2Act achieves a 37.5% overall success rate, compared to 0% for conventional retargeting.
Legged Autonomous Surface Science In Analogue Environments (LASSIE): Making Every Robotic Step Count in Planetary Exploration
Authors: Cristina G. Wilson, Marion Nachon, Shipeng Liu et al. | Submitted: 2026-03-20 | arXiv: 2603.19661
Categories: cs.RO
Research Background: The ability to efficiently and effectively explore planetary surfaces is currently limited by the capability of wheeled rovers to traverse challenging terrains, and by pre-programmed data acquisition plans with limited in-situ flexibility. In this paper, we present two novel approaches to address these limitations: (i) high-mobility legged robots that use direct surface interactions to collect rich information about the terrain’s mechanics to guide exploration; (ii) human-inspired data acquisition algorithms that enable robots to reason about scientific hypotheses and adapt exploration priorities based on incoming ground-sensing measurements.
研究背景: 在機器人學習領域,The ability to efficiently and effectively explore planetary surfaces is currently limited by the capability of wheeled rovers to traverse challenging terrains, and by pre-programm
Technical Approach: In this paper, we present two novel approaches to address these limitations: (i) high-mobility legged robots that use direct surface interactions to collect rich information about the terrain’s mechanics to guide exploration; (ii) human-inspired data acquisition algorithms that enable robots to reason about scientific hypotheses and adapt exploration priorities based on incoming ground-sensing measurements. We successfully verify our approach through lab work and field deployments in two planetary analog environments. Our approach therefore enables exploration of a wider range of planetary environments and new substrate investigation opportunities through integrated human-robot systems that support maximum scientific return.
技術方法: 本文提出的方法:In this paper, we present two novel approaches to address these limitations: (i) high-mobility legged robots that use direct surface interactions to collect rich information about the terrain’s mechan
Key Takeaway: We then demonstrate how human-inspired algorithms turn terrain-sensing robots into teammates, by supporting more flexible and adaptive data collection decisions with human scientists.
核心發現: 核心結果:We then demonstrate how human-inspired algorithms turn terrain-sensing robots into teammates, by supporting more flexible and adaptive data collection decisions with human scientists.
ContractionPPO: Certified Reinforcement Learning via Differentiable Contraction Layers
Authors: Vrushabh Zinage, Narek Harutyunyan, Eric Verheyden et al. | Submitted: 2026-03-20 | arXiv: 2603.19632
Categories: cs.RO, eess.SY
Research Background: Legged locomotion in unstructured environments demands not only high-performance control policies but also formal guarantees to ensure robustness under perturbations. Control methods often require carefully designed reference trajectories, which are challenging to construct in high-dimensional, contact-rich systems such as quadruped robots.
研究背景: 在機器人學習領域,Legged locomotion in unstructured environments demands not only high-performance control policies but also formal guarantees to ensure robustness under perturbations. Control metho
Technical Approach: We present ContractionPPO, a framework for certified robust planning and control of legged robots by augmenting Proximal Policy Optimization (PPO) RL with a state-dependent contraction metric layer.
技術方法: 本文提出的方法:We present ContractionPPO, a framework for certified robust planning and control of legged robots by augmenting Proximal Policy Optimization (PPO) RL with a state-dependent contraction metric layer.
Key Takeaway: Our hardware experiments on quadruped locomotion demonstrate that ContractionPPO enables robust, certifiably stable control even under strong external perturbations.
核心發現: 核心結果:Our hardware experiments on quadruped locomotion demonstrate that ContractionPPO enables robust, certifiably stable control even under strong external perturbations.
Zero Shot Deformation Reconstruction for Soft Robots Using a Flexible Sensor Array and Cage Based 3D Gaussian Modeling
Authors: Linrui Shou, Zilang Chen, Wenjia Xu et al. | Submitted: 2026-03-20 | arXiv: 2603.19543
Categories: cs.RO
Research Background: We present a zero-shot deformation reconstruction framework for soft robots that operates without any visual supervision at inference time. In this work, zero-shot deformation reconstruction is defined as the ability to infer object-wide deformations on previously unseen soft robots without collecting object-specific deformation data or performing any retraining during deployment.
研究背景: 在機器人學習領域,We present a zero-shot deformation reconstruction framework for soft robots that operates without any visual supervision at inference time. In this work, zero-shot deformation reco
Technical Approach: We present a zero-shot deformation reconstruction framework for soft robots that operates without any visual supervision at inference time. Our method assumes access to a static geometric proxy of the undeformed object, which can be obtained from a STL model.
技術方法: 本文提出的方法:We present a zero-shot deformation reconstruction framework for soft robots that operates without any visual supervision at inference time. Our method assumes access to a static geometric proxy of the
Key Takeaway: It achieves 0.67 IoU, 0.65 SSIM, and 3.48 mm Chamfer distance, demonstrating strong zero-shot generalization through explicit coupling of tactile sensing and structured geometric deformation.
核心發現: 核心結果:It achieves 0.67 IoU, 0.65 SSIM, and 3.48 mm Chamfer distance, demonstrating strong zero-shot generalization through explicit coupling of tactile sensing and structured geometric deformation.
CAMA: Exploring Collusive Adversarial Attacks in c-MARL
Authors: Men Niu, Xinxin Fan, Quanliang Jing et al. | Submitted: 2026-03-20 | arXiv: 2603.20390
Categories: cs.LG, cs.AI
Research Background: Cooperative multi-agent reinforcement learning (c-MARL) has been widely deployed in real-world applications, such as social robots, embodied intelligence, UAV swarms, etc. Nevertheless, many adversarial attacks still exist to threaten various c-MARL systems.
研究背景: 在機器人學習領域,Cooperative multi-agent reinforcement learning (c-MARL) has been widely deployed in real-world applications, such as social robots, embodied intelligence, UAV swarms, etc. Neverthe
Technical Approach: To address these limitations, we in this paper attempt to study collusive adversarial attacks through strategically organizing a set of malicious agents into three collusive attack modes: Collective Malicious Agents, Disguised Malicious Agents, and Spied Malicious Agents.
技術方法: 本文提出的方法:To address these limitations, we in this paper attempt to study collusive adversarial attacks through strategically organizing a set of malicious agents into three collusive attack modes: Collective M
Key Takeaway: Finally, multi-facet experiments on four SMAC II maps are performed, and experimental results showcase the three collusive attacks have an additive adversarial synergy, strengthening attack outcome while maintaining high stealthiness and stability over long horizons.
核心發現: 核心結果:Finally, multi-facet experiments on four SMAC II maps are performed, and experimental results showcase the three collusive attacks have an additive adversarial synergy, strengthening attack outcome wh
Does Peer Observation Help? Vision-Sharing Collaboration for Vision-Language Navigation
Authors: Qunchao Jin, Yiliao Song, Qi Wu | Submitted: 2026-03-21 | arXiv: 2603.20804
Categories: cs.CV, cs.RO
Research Background: Vision-Language Navigation (VLN) systems are fundamentally constrained by partial observability, as an agent can only accumulate knowledge from locations it has personally visited. As multiple robots increasingly coexist in shared environments, a natural question arises: can agents navigating the same space benefit from each other’s observations?
研究背景: 在機器人學習領域,Vision-Language Navigation (VLN) systems are fundamentally constrained by partial observability, as an agent can only accumulate knowledge from locations it has personally visited.
Technical Approach: In this work, we introduce Co-VLN, a minimalist, model-agnostic framework for systematically investigating whether and how peer observations from concurrently navigating agents can benefit VLN. We validate our framework on the R2R benchmark under two representative paradigms (the learning-based DUET and the zero-shot MapGPT), and conduct extensive analytical experiments to systematically reveal the underlying dynamics of peer observation sharing in VLN.
技術方法: 本文提出的方法:In this work, we introduce Co-VLN, a minimalist, model-agnostic framework for systematically investigating whether and how peer observations from concurrently navigating agents can benefit VLN. We val
Key Takeaway: Results demonstrate that vision-sharing enabled model yields substantial performance improvements across both paradigms, establishing a strong foundation for future research in collaborative embodied navigation.
核心發現: 核心結果:Results demonstrate that vision-sharing enabled model yields substantial performance improvements across both paradigms, establishing a strong foundation for future research in collaborative embodied
Bayesian Active Object Recognition and 6D Pose Estimation from Multimodal Contact Sensing
Authors: Haodong Zheng, Gabriele M. Caddeo, Andrei C. Jalba et al. | Submitted: 2026-03-22 | arXiv: 2603.21410
Categories: cs.RO
Research Background: We present an active tactile exploration framework for joint object recognition and 6D pose estimation. The proposed method integrates wrist force/torque sensing, GelSight tactile sensing, and free-space constraints within a Bayesian inference framework that maintains a belief over object class and pose during active tactile exploration.
研究背景: 在機器人學習領域,We present an active tactile exploration framework for joint object recognition and 6D pose estimation. The proposed method integrates wrist force/torque sensing, GelSight tactile
Technical Approach: We present an active tactile exploration framework for joint object recognition and 6D pose estimation.
技術方法: 本文提出的方法:We present an active tactile exploration framework for joint object recognition and 6D pose estimation.
Key Takeaway: Results show that incorporating tactile and free-space information substantially improves recognition and pose estimation accuracy and stability, while reducing the number of action cycles compared with force/torque-only baselines.
核心發現: 核心結果:Results show that incorporating tactile and free-space information substantially improves recognition and pose estimation accuracy and stability, while reducing the number of action cycles compared wi
GAPG: Geometry Aware Push-Grasping Synergy for Goal-Oriented Manipulation in Clutter
Authors: Lijingze Xiao, Jinhong Du, Yang Cong et al. | Submitted: 2026-03-22 | arXiv: 2603.21195
Categories: cs.RO
Research Background: Grasping target objects is a fundamental skill for robotic manipulation, but in cluttered environments with stacked or occluded objects, a single-step grasp is often insufficient. To address this, previous work has introduced pushing as an auxiliary action to create graspable space.
研究背景: 在機器人學習領域,Grasping target objects is a fundamental skill for robotic manipulation, but in cluttered environments with stacked or occluded objects, a single-step grasp is often insufficient.
Technical Approach: To this end, we propose a geometry-aware push-grasp synergy framework that leverages point cloud data to integrate grasp and push evaluation. By jointly reasoning about geometry in both grasping and pushing, our framework achieves safer, more efficient, and more reliable manipulation in cluttered settings. Our method is extensively tested in simulation and real-world environments in various scenarios.
技術方法: 本文提出的方法:To this end, we propose a geometry-aware push-grasp synergy framework that leverages point cloud data to integrate grasp and push evaluation. By jointly reasoning about geometry in both grasping and p
Key Takeaway: Experimental results demonstrate that our model generalizes well to real-world scenes and unseen objects.
核心發現: 核心結果:Experimental results demonstrate that our model generalizes well to real-world scenes and unseen objects.
Affordance-Guided Enveloping Grasp Demonstration Toward Non-destructive Disassembly of Pinch-Infeasible Mating Parts
Authors: Masaki Tsutsumi, Takuya Kiyokawa, Gen Sako et al. | Submitted: 2026-03-22 | arXiv: 2603.21143
Categories: cs.RO
Research Background: Robotic disassembly of complex mating components often renders pinch grasping infeasible, necessitating multi-fingered enveloping grasps. However, visual occlusions and geometric constraints complicate teaching appropriate grasp motions when relying solely on 2D camera feeds.
研究背景: 在機器人學習領域,Robotic disassembly of complex mating components often renders pinch grasping infeasible, necessitating multi-fingered enveloping grasps. However, visual occlusions and geometric c
Technical Approach: To address this, we propose an affordance-guided teleoperation method that pre-generates enveloping grasp candidates via physics simulation.
技術方法: 本文提出的方法:To address this, we propose an affordance-guided teleoperation method that pre-generates enveloping grasp candidates via physics simulation.
Key Takeaway: Real-robot experiments validate that AT-based visual augmentation enables operators to effectively select and teach enveloping grasp strategies for real-world disassembly, even under severe visual and geometric constraints.
核心發現: 核心結果:Real-robot experiments validate that AT-based visual augmentation enables operators to effectively select and teach enveloping grasp strategies for real-world disassembly, even under severe visual and
Training-Free Adaptive 360-degree Video Streaming via Semantic Potential Fields
Authors: Aizierjiang Aiersilan, Zhangfei Yang | Submitted: 2026-03-22 | arXiv: 2603.20999
Categories: cs.NI, cs.CV, cs.MM, cs.RO, eess.IV
Research Background: Adaptive 360° video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless channels. While Deep Reinforcement Learning (DRL) methods achieve high Quality of Experience (QoE), their lack of interpretability and dependence on offline training limit deployment in safety-critical systems.
研究背景: 在機器人學習領域,Adaptive 360° video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless cha
Technical Approach: We propose OrbitStream, a training-free framework that formulates viewport prediction as a Gravitational Viewport Prediction (GVP) problem, where semantic objects generate potential fields that attract operator gaze, and employs a Saturation-Based Proportional-Derivative (PD) Controller for buffer regulation.
技術方法: 本文提出的方法:We propose OrbitStream, a training-free framework that formulates viewport prediction as a Gravitational Viewport Prediction (GVP) problem, where semantic objects generate potential fields that attrac
Key Takeaway: BOLA-E’s 2.80), outperforming FastMPC (1.84), with 1.01 ms decision latency and minimal rebuffering.
核心發現: 核心結果:BOLA-E’s 2.80), outperforming FastMPC (1.84), with 1.01 ms decision latency and minimal rebuffering.
Geometrically Plausible Object Pose Refinement using Differentiable Simulation
Authors: Anil Zeybek, Rhys Newbury, Snehal Dikhale et al. | Submitted: 2026-03-22 | arXiv: 2603.20992
Categories: cs.RO
Research Background: State-of-the-art object pose estimation methods are prone to generating geometrically infeasible pose hypotheses. This problem is prevalent in dexterous manipulation, where estimated poses often intersect with the robotic hand or are not lying on a support surface.
研究背景: 在機器人學習領域,State-of-the-art object pose estimation methods are prone to generating geometrically infeasible pose hypotheses. This problem is prevalent in dexterous manipulation, where estimat
Technical Approach: We propose a multi-modal pose refinement approach that combines differentiable physics simulation, differentiable rendering and visuo-tactile sensing to optimize object poses for both spatial accuracy and physical consistency. Simulated experiments show that our approach reduces the intersection volume error between the object and robotic hand by 73% when the initial estimate is accurate and by over 87% under high initial uncertainty, significantly outperforming standard ICP-based baselines.
技術方法: 本文提出的方法:We propose a multi-modal pose refinement approach that combines differentiable physics simulation, differentiable rendering and visuo-tactile sensing to optimize object poses for both spatial accuracy
Key Takeaway: Furthermore, the improvement in geometric plausibility is accompanied by a concurrent reduction in translation and orientation errors.
核心發現: 核心結果:Furthermore, the improvement in geometric plausibility is accompanied by a concurrent reduction in translation and orientation errors.
Perception-Aware Autonomous Exploration in Feature-Limited Environments
Authors: Moji Shi, Rajitha de Silva, Hang Yu et al. | Submitted: 2026-03-16 | arXiv: 2603.15605
Categories: cs.RO
Research Background: Autonomous exploration in unknown environments typically relies on onboard state estimation for localisation and mapping. Existing exploration methods primarily maximise coverage efficiency, but often overlook that visual-inertial odometry (VIO) performance strongly depends on the availability of robust visual features.
研究背景: 在機器人學習領域,Autonomous exploration in unknown environments typically relies on onboard state estimation for localisation and mapping. Existing exploration methods primarily maximise coverage e
Technical Approach: We propose a hierarchical perception-aware exploration framework for a stereo-equipped unmanned aerial vehicle (UAV) that explicitly couples exploration progress with feature observability. Our approach (i) associates each candidate frontier with an expected feature quality using a global feature map, and prioritises visually informative subgoals, and (ii) optimises a continuous yaw trajectory along the planned motion to maintain stable feature tracks. We evaluate our method in simulation across environments with varying texture levels and in real-world indoor experiments with largely textureless walls.
技術方法: 本文提出的方法:We propose a hierarchical perception-aware exploration framework for a stereo-equipped unmanned aerial vehicle (UAV) that explicitly couples exploration progress with feature observability. Our approa
Key Takeaway: Compared to baselines that ignore feature quality and/or do not optimise continuous yaw, our method maintains more reliable feature tracking, reduces odometry drift, and achieves on average 30% higher coverage before the odometry error exceeds specified thresholds.
核心發現: 核心結果:Compared to baselines that ignore feature quality and/or do not optimise continuous yaw, our method maintains more reliable feature tracking, reduces odometry drift, and achieves on average 30% highe
EAAE: Energy-Aware Autonomous Exploration for UAVs in Unknown 3D Environments
Authors: Jacob Elskamp, Moji Shi, Leonard Bauersfeld et al. | Submitted: 2026-03-16 | arXiv: 2603.15604
Categories: cs.RO
Research Background: Battery-powered multirotor unmanned aerial vehicles (UAVs) can rapidly map unknown environments, but mission performance is often limited by energy rather than geometry alone. Standard exploration policies that optimise for coverage or time can therefore waste energy through manoeuvre-heavy trajectories.
研究背景: 在機器人學習領域,Battery-powered multirotor unmanned aerial vehicles (UAVs) can rapidly map unknown environments, but mission performance is often limited by energy rather than geometry alone. Stan
Technical Approach: In this paper, we address energy-aware autonomous 3D exploration for multirotor UAVs in initially unknown environments. We propose Energy-Aware Autonomous Exploration (EAAE), a modular frontier-based framework that makes energy an explicit decision variable during frontier selection.
技術方法: 本文提出的方法:In this paper, we address energy-aware autonomous 3D exploration for multirotor UAVs in initially unknown environments. We propose Energy-Aware Autonomous Exploration (EAAE), a modular frontier-based
Key Takeaway: We evaluate EAAE in a full exploration pipeline with a rotor-speed-based power model across simulated 3D environments of increasing complexity.
核心發現: 核心結果:We evaluate EAAE in a full exploration pipeline with a rotor-speed-based power model across simulated 3D environments of increasing complexity.
S2Act: Simple Spiking Actor
Authors: Ugur Akcal, Seung Hyun Kim, Mikihisa Yuasa et al. | Submitted: 2026-03-16 | arXiv: 2603.15725
Categories: cs.MA, cs.ET, cs.LG, cs.RO
Research Background: Spiking neural networks (SNNs) and biologically-inspired learning mechanisms are attractive in mobile robotics, where the size and performance of onboard neural network policies are constrained by power and computational budgets. Existing SNN approaches, such as population coding, reward modulation, and hybrid artificial neural network (ANN)-SNN architectures, have shown promising results; however, they face challenges in complex, highly stochastic environments due to SNN sensitivity to hyperparameters and inconsistent gradient signals.
研究背景: 在機器人學習領域,Spiking neural networks (SNNs) and biologically-inspired learning mechanisms are attractive in mobile robotics, where the size and performance of onboard neural network policies ar
Technical Approach: To address these challenges, we propose simple spiking actor (S2Act), a computationally lightweight framework that deploys an RL policy using an SNN in three steps: (1) architect an actor-critic model based on an approximated network of rate-based spiking neurons, (2) train the network with gradients using compatible activation functions, and (3) transfer the trained weights into physical parameters of rate-based leaky integrate-and-fire (LIF) neurons for inference and deployment. We demonstrate our method in two multi-agent stochastic environments (capture-the-flag and parking) that capture the complexity of multi-robot interactions, and deploy our trained policies on physical TurtleBot platforms using Intel’s Loihi neuromorphic hardware.
技術方法: 本文提出的方法:To address these challenges, we propose simple spiking actor (S2Act), a computationally lightweight framework that deploys an RL policy using an SNN in three steps: (1) architect an actor-critic model
Key Takeaway: Our experimental results show that S2Act outperforms relevant baselines in task performance and real-time inference in nearly all considered scenarios, highlighting its potential for rapid prototyping and efficient real-world deployment of SNN-based RL policies.
核心發現: 核心結果:Our experimental results show that S2Act outperforms relevant baselines in task performance and real-time inference in nearly all considered scenarios, highlighting its potential for rapid prototyping
Optimal control of differentially flat underactuated planar robots in the perspective of oscillation mitigation
Authors: Stefano Lovato, Michele Tonan, Matteo Bottin et al. | Submitted: 2026-03-16 | arXiv: 2603.15528
Categories: cs.RO
Research Background: Underactuated robots are characterized by a larger number of degrees of freedom than actuators and if they are designed with a specific mass distribution, they can be controlled by means of differential flatness theory. This structural property enables the development of lightweight and cost-effective robotic systems with enhanced dexterity.
研究背景: 在機器人學習領域,Underactuated robots are characterized by a larger number of degrees of freedom than actuators and if they are designed with a specific mass distribution, they can be controlled by
Technical Approach: In this paper, the possibility of using optimal control along with differential flatness control is investigated to improve the tracking of the planned trajectories.
技術方法: 本文提出的方法:In this paper, the possibility of using optimal control along with differential flatness control is investigated to improve the tracking of the planned trajectories.
Key Takeaway: Results highlight that optimal control can be used to plan the flat variables considering different (quadratic) performance indices: control effort, i.e. motor torque, and potential energy of the considered underactuated joint.
核心發現: 核心結果:Results highlight that optimal control can be used to plan the flat variables considering different (quadratic) performance indices: control effort, i.e. motor torque, and potential energy of the cons
On the Derivation of Tightly-Coupled LiDAR-Inertial Odometry with VoxelMap
Authors: Zhihao Zhan | Submitted: 2026-03-16 | arXiv: 2603.15471
Categories: cs.RO, eess.SP
Research Background: This note presents a concise mathematical formulation of tightly-coupled LiDAR-Inertial Odometry within an iterated error-state Kalman filter framework using a VoxelMap representation. Rather than proposing a new algorithm, it provides a clear and self-contained derivation that unifies the geometric modeling and probabilistic state estimation through consistent notation and explicit formulations.
研究背景: 在機器人學習領域,This note presents a concise mathematical formulation of tightly-coupled LiDAR-Inertial Odometry within an iterated error-state Kalman filter framework using a VoxelMap representat
Technical Approach: Rather than proposing a new algorithm, it provides a clear and self-contained derivation that unifies the geometric modeling and probabilistic state estimation through consistent notation and explicit formulations.
技術方法: 本文提出的方法:Rather than proposing a new algorithm, it provides a clear and self-contained derivation that unifies the geometric modeling and probabilistic state estimation through consistent notation and explicit
Key Takeaway: The document is intended to serve both as a technical reference and as an accessible entry point for a foundational understanding of the system architecture and estimation principles.
核心發現: 核心結果:The document is intended to serve both as a technical reference and as an accessible entry point for a foundational understanding of the system architecture and estimation principles.
Topological Motion Planning Diffusion: Generative Tangle-Free Path Planning for Tethered Robots in Obstacle-Rich Environments
Authors: Yifu Tian, Xinhang Xu, Thien-Minh Nguyen et al. | Submitted: 2026-03-16 | arXiv: 2603.26696
Categories: cs.RO
Research Background: In extreme environments such as underwater exploration and post-disaster rescue, tethered robots require continuous navigation while avoiding cable entanglement. Traditional planners struggle in these lifelong planning scenarios due to topological unawareness, while topology-augmented graph-search methods face computational bottlenecks in obstacle-rich environments where the number of candidate topological classes increases.
研究背景: 在機器人學習領域,In extreme environments such as underwater exploration and post-disaster rescue, tethered robots require continuous navigation while avoiding cable entanglement. Traditional planne
Technical Approach: To address these challenges, we propose Topological Motion Planning Diffusion (TMPD), a novel generative planning framework that integrates lifelong topological memory.
技術方法: 本文提出的方法:To address these challenges, we propose Topological Motion Planning Diffusion (TMPD), a novel generative planning framework that integrates lifelong topological memory.
Key Takeaway: Benchmarking in obstacle-rich simulated environments demonstrates that TMPD achieves a collision-free reach of 100% and a tangle-free rate of 97.0%, outperforming traditional topological search and purely kinematic diffusion baselines in both geometric smoothness and computational efficiency.
核心發現: 核心結果:Benchmarking in obstacle-rich simulated environments demonstrates that TMPD achieves a collision-free reach of 100% and a tangle-free rate of 97.0%, outperforming traditional topological search and pu
Formalisms for Robotic Mission Specification and Execution: A Comparative Analysis
Authors: Gianluca Filippone, Sara Pettinari, Patrizio Pelliccione | Submitted: 2026-03-16 | arXiv: 2603.15427
Categories: cs.SE, cs.RO
Research Background: Robots are increasingly deployed across diverse domains and designed for multi-purpose operation. As robotic systems grow in complexity and operate in dynamic environments, the need for structured, expressive, and scalable mission-specification approaches becomes critical, with mission specifications often defined in the field by domain experts rather than robotics specialists.
研究背景: 在機器人學習領域,Robots are increasingly deployed across diverse domains and designed for multi-purpose operation. As robotic systems grow in complexity and operate in dynamic environments, the nee
Technical Approach: This paper presents a systematic analysis of these four formalisms with respect to their suitability for robot mission specification.
技術方法: 本文提出的方法:This paper presents a systematic analysis of these four formalisms with respect to their suitability for robot mission specification.
Key Takeaway: The results aim to support practitioners and researchers in selecting appropriate modeling approaches for designing robust and adaptable robot and multi-robot missions.
核心發現: 核心結果:The results aim to support practitioners and researchers in selecting appropriate modeling approaches for designing robust and adaptable robot and multi-robot missions.
NavThinker: Action-Conditioned World Models for Coupled Prediction and Planning in Social Navigation
Authors: Tianshuai Hu, Zeying Gong, Lingdong Kong et al. | Submitted: 2026-03-16 | arXiv: 2603.15359
Categories: cs.RO
Research Background: Social navigation requires robots to act safely in dynamic human environments. Effective behavior demands thinking ahead: reasoning about how the scene and pedestrians evolve under different robot actions rather than reacting to current observations alone.
研究背景: 在機器人學習領域,Social navigation requires robots to act safely in dynamic human environments. Effective behavior demands thinking ahead: reasoning about how the scene and pedestrians evolve under
Technical Approach: To address this challenge, we propose NavThinker, a future-aware framework that couples an action-conditioned world model with on-policy reinforcement learning.
技術方法: 本文提出的方法:To address this challenge, we propose NavThinker, a future-aware framework that couples an action-conditioned world model with on-policy reinforcement learning.
Key Takeaway: Experiments on single- and multi-robot Social-HM3D show state-of-the-art navigation success, with zero-shot transfer to Social-MP3D and real-world deployment on a Unitree Go2, validating generalization and practical applicability.
核心發現: 核心結果:Experiments on single- and multi-robot Social-HM3D show state-of-the-art navigation success, with zero-shot transfer to Social-MP3D and real-world deployment on a Unitree Go2, validating generalizatio
BodyGuards: Escorting by Multiple Robots in Unknown Environment under Limited Communication
Authors: Zhuoli Tian, Yanze Bao, Meng Guo | Submitted: 2026-03-16 | arXiv: 2603.15108
Categories: cs.RO
Research Background: Multi-robot systems are increasingly deployed in high-risk missions such as reconnaissance, disaster response, and subterranean operations. Protecting a human operator while navigating unknown and adversarial environments remains a critical challenge, especially when the communication among the operator and robots is restricted.
研究背景: 在機器人學習領域,Multi-robot systems are increasingly deployed in high-risk missions such as reconnaissance, disaster response, and subterranean operations. Protecting a human operator while naviga
Technical Approach: Protecting a human operator while navigating unknown and adversarial environments remains a critical challenge, especially when the communication among the operator and robots is restricted. Unlike existing collaborative exploration methods that aim for complete coverage, this work focuses on task-oriented exploration to minimize the navigation time of the operator to reach its goal while ensuring safety under adversarial threats. A novel escorting framework BodyGuards, is proposed to explicitly integrate seamlessly collaborative exploration, inter-robot-operator communication and escorting.
技術方法: 本文提出的方法:Protecting a human operator while navigating unknown and adversarial environments remains a critical challenge, especially when the communication among the operator and robots is restricted. Unlike ex
Key Takeaway: Extensive human-in-the-loop simulations and hardware experiments demonstrate that the method significantly reduces operator risk and mission time, outperforming baselines in adversarial and constrained environments.
核心發現: 核心結果:Extensive human-in-the-loop simulations and hardware experiments demonstrate that the method significantly reduces operator risk and mission time, outperforming baselines in adversarial and constraine
CycleRL: Sim-to-Real Deep Reinforcement Learning for Robust Autonomous Bicycle Control
Authors: Gelu Liu, Teng Wang, Zhijie Wu et al. | Submitted: 2026-03-16 | arXiv: 2603.15013
Categories: cs.RO
Research Background: Autonomous bicycles offer a promising agile solution for urban mobility and last-mile logistics. However, conventional control strategies often struggle with underactuated nonlinear dynamics, suffering from sensitivity to model mismatches and limited adaptability to real-world uncertainties.
研究背景: 在機器人學習領域,Autonomous bicycles offer a promising agile solution for urban mobility and last-mile logistics. However, conventional control strategies often struggle with underactuated nonlinea
Technical Approach: To address this, we develop CycleRL, a comprehensive sim-to-real framework for robust autonomous bicycle control. Our approach establishes a direct perception-to-action mapping within the high-fidelity NVIDIA Isaac Sim environment, leveraging Proximal Policy Optimization (PPO) to optimize the control policy.
技術方法: 本文提出的方法:To address this, we develop CycleRL, a comprehensive sim-to-real framework for robust autonomous bicycle control. Our approach establishes a direct perception-to-action mapping within the high-fidelit
Key Takeaway: These quantitative results, coupled with successful hardware deployment, validate DRL as an effective paradigm for autonomous bicycle control, offering superior adaptability over traditional methods.
核心發現: 核心結果:These quantitative results, coupled with successful hardware deployment, validate DRL as an effective paradigm for autonomous bicycle control, offering superior adaptability over traditional methods.
Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM3
Authors: Hürkan Şahin, Huy Xuan Pham, Van Huyen Dang et al. | Submitted: 2026-03-16 | arXiv: 2603.14998
Categories: cs.CV, cs.RO
Research Background: Autonomous navigation in GPS-denied and visually degraded environments remains challenging for unmanned aerial vehicles (UAVs). To this end, we investigate the use of a monocular thermal camera as a standalone sensor on a UAV platform for real-time depth estimation and simultaneous localization and mapping (SLAM).
研究背景: 在機器人學習領域,Autonomous navigation in GPS-denied and visually degraded environments remains challenging for unmanned aerial vehicles (UAVs). To this end, we investigate the use of a monocular t
Technical Approach: To this end, we investigate the use of a monocular thermal camera as a standalone sensor on a UAV platform for real-time depth estimation and simultaneous localization and mapping (SLAM). To extract depth information from thermal images, we propose a novel pipeline employing a lightweight supervised network with recurrent blocks (RBs) integrated to capture temporal dependencies, enabling more robust predictions. On the radiometric VIVID++ (indoor-dark) dataset, our method achieves an absolute relative error of approximately 0.06, compared to baselines exceeding 0.11.
技術方法: 本文提出的方法:To this end, we investigate the use of a monocular thermal camera as a standalone sensor on a UAV platform for real-time depth estimation and simultaneous localization and mapping (SLAM). To extract d
Key Takeaway: On the radiometric VIVID++ (indoor-dark) dataset, our method achieves an absolute relative error of approximately 0.06, compared to baselines exceeding 0.11.
核心發現: 核心結果:On the radiometric VIVID++ (indoor-dark) dataset, our method achieves an absolute relative error of approximately 0.06, compared to baselines exceeding 0.11.
Intelligent Control of Differential Drive Robots Subject to Unmodeled Dynamics with EKF-based State Estimation
Authors: Amos Alwala, Yuchen Hu, Gabriel da Silva Lima et al. | Submitted: 2026-03-16 | arXiv: 2603.14940
Categories: eess.SY, cs.LG, cs.RO
Research Background: Reliable control and state estimation of differential drive robots (DDR) operating in dynamic and uncertain environments remains a challenge, particularly when system dynamics are partially unknown and sensor measurements are prone to degradation. This work introduces a unified control and state estimation framework that combines a Lyapunov-based nonlinear controller and Adaptive Neural Networks (ANN) with Extended Kalman Filter (EKF)-based multi-sensor fusion.
研究背景: 在機器人學習領域,Reliable control and state estimation of differential drive robots (DDR) operating in dynamic and uncertain environments remains a challenge, particularly when system dynamics are
Technical Approach: This work introduces a unified control and state estimation framework that combines a Lyapunov-based nonlinear controller and Adaptive Neural Networks (ANN) with Extended Kalman Filter (EKF)-based multi-sensor fusion. The proposed controller leverages the universal approximation property of neural networks to model unknown nonlinearities in real time. An online adaptation scheme updates the weights of the radial basis function (RBF), the architecture chosen for the ANN.
技術方法: 本文提出的方法:This work introduces a unified control and state estimation framework that combines a Lyapunov-based nonlinear controller and Adaptive Neural Networks (ANN) with Extended Kalman Filter (EKF)-based mul
Key Takeaway: Gazebo simulations and real-world experiments are done using DDR, demonstrating the effectiveness of the approach in terms of improved velocity tracking performance with reduction in linear and angular velocity errors up to and in comparison to the baseline FBL.
核心發現: 核心結果:Gazebo simulations and real-world experiments are done using DDR, demonstrating the effectiveness of the approach in terms of improved velocity tracking performance with reduction in linear and angula
Transformers As Generalizable Optimal Controllers
Authors: Turki Bin Mohaya, Maitham F. AL-Sunni, John M. Dolan et al. | Submitted: 2026-03-16 | arXiv: 2603.14910
Categories: eess.SY, cs.RO
Research Background: We study whether optimal state-feedback laws for a family of heterogeneous Multiple-Input, Multiple-Output (MIMO) Linear Time-Invariant (LTI) systems can be captured by a single learned controller. We train one transformer policy on LQR-generated trajectories from systems with different state and input dimensions, using a shared representation with standardization, padding, dimension encoding, and masked loss.
研究背景: 在機器人學習領域,We study whether optimal state-feedback laws for a family of heterogeneous Multiple-Input, Multiple-Output (MIMO) Linear Time-Invariant (LTI) systems can be captured by a single le
Technical Approach: We train one transformer policy on LQR-generated trajectories from systems with different state and input dimensions, using a shared representation with standardization, padding, dimension encoding, and masked loss. The policy maps recent state history to control actions without requiring plant matrices at inference time. Across a broad set of systems, it achieves empirically small sub-optimality relative to Linear Quadratic Regulator (LQR), remains stabilizing under moderate parameter perturbations, and benefits from lightweight fine-tuning on unseen systems.
技術方法: 本文提出的方法:We train one transformer policy on LQR-generated trajectories from systems with different state and input dimensions, using a shared representation with standardization, padding, dimension encoding, a
Key Takeaway: These results support transformer policies as practical approximators of near-optimal feedback laws over structured linear-system families.
核心發現: 核心結果:These results support transformer policies as practical approximators of near-optimal feedback laws over structured linear-system families.
ViSA: Visited-State Augmentation for Generalized Goal-Space Contrastive Reinforcement Learning
Authors: Issa Nakamura, Tomoya Yamanokuchi, Yuki Kadokawa et al. | Submitted: 2026-03-16 | arXiv: 2603.14887
Categories: cs.RO
Research Background: Goal-Conditioned Reinforcement Learning (GCRL) is a framework for learning a policy that can reach arbitrarily given goals. In particular, Contrastive Reinforcement Learning (CRL) provides a framework for policy updates using an approximation of the value function estimated via contrastive learning, achieving higher sample efficiency compared to conventional methods.
研究背景: 在機器人學習領域,Goal-Conditioned Reinforcement Learning (GCRL) is a framework for learning a policy that can reach arbitrarily given goals. In particular, Contrastive Reinforcement Learning (CRL)
Technical Approach: To address this issue, we propose a novel data augmentation approach for CRL called ViSA (Visited-State Augmentation).
技術方法: 本文提出的方法:To address this issue, we propose a novel data augmentation approach for CRL called ViSA (Visited-State Augmentation).
Key Takeaway: We evaluate ViSA in simulation and real-world robotic tasks and show improved goal-space generalization, which permits accurate value estimation for hard-to-visit goals.
核心發現: 核心結果:We evaluate ViSA in simulation and real-world robotic tasks and show improved goal-space generalization, which permits accurate value estimation for hard-to-visit goals.
Surgical Robot, Path Planning, Joint Space, Riemannian Manifolds
Authors: Yoshiki Yamamoto, Maina Sogabe, Shunichi Hirahara et al. | Submitted: 2026-03-16 | arXiv: 2603.14852
Categories: cs.RO, eess.SY
Research Background: Robotic surgery for minimally invasive surgery can reduce the surgeon’s workload by autonomously guiding robotic forceps. Movement of the robot is restricted around a fixed insertion port.
研究背景: 在機器人學習領域,Robotic surgery for minimally invasive surgery can reduce the surgeon’s workload by autonomously guiding robotic forceps. Movement of the robot is restricted around a fixed inserti
Technical Approach: Also, the surface of the abdominal cavity is non-concave, making it computationally expensive to find the desired path.In this work, to solve these problems, we propose a method for path planning in joint space by transforming the position into a Riemannian manifold.
技術方法: 本文提出的方法:Also, the surface of the abdominal cavity is non-concave, making it computationally expensive to find the desired path.In this work, to solve these problems, we propose a method for path planning in j
Key Takeaway: Experimental results demonstrated that the proposed method reduces the range of joint angle movement compared to calculations in position space.
核心發現: 核心結果:Experimental results demonstrated that the proposed method reduces the range of joint angle movement compared to calculations in position space.
LiDAR-EVS: Enhance Extrapolated View Synthesis for 3D Gaussian Splatting with Pseudo-LiDAR Supervision
Authors: Yiming Huang, Xin Kang, Sipeng Zhang et al. | Submitted: 2026-03-16 | arXiv: 2603.14763
Categories: cs.RO, cs.CV
Research Background: 3D Gaussian Splatting (3DGS) has emerged as a powerful technique for real-time LiDAR and camera synthesis in autonomous driving simulation. However, simulating LiDAR with 3DGS remains challenging for extrapolated views beyond the training trajectory, as existing methods are typically trained on single-traversal sensor scans, suffer from severe overfitting and poor generalization to novel ego-vehicle paths.
研究背景: 在機器人學習領域,3D Gaussian Splatting (3DGS) has emerged as a powerful technique for real-time LiDAR and camera synthesis in autonomous driving simulation. However, simulating LiDAR with 3DGS rema
Technical Approach: To enable reliable simulation of LiDAR along unseen driving trajectories without external multi-pass data, we present LiDAR-EVS, a lightweight framework for robust extrapolated-view LiDAR simulation in autonomous driving. Our framework comprises two key components: (1) pseudo extrapolated-view point cloud supervision with multi-frame LiDAR fusion, view transformation, occlusion curling, and intensity adjustment; (2) spatially-constrained dropout regularization that promotes robustness to diverse trajectory variations encountered in real-world driving.
技術方法: 本文提出的方法:To enable reliable simulation of LiDAR along unseen driving trajectories without external multi-pass data, we present LiDAR-EVS, a lightweight framework for robust extrapolated-view LiDAR simulation i
Key Takeaway: Extensive experiments demonstrate that LiDAR-EVS achieves SOTA performance on extrapolated-view LiDAR synthesis across three datasets, making it a promising tool for data-driven simulation, closed-loop evaluation, and synthetic data generation in autonomous driving systems.
核心發現: 核心結果:Extensive experiments demonstrate that LiDAR-EVS achieves SOTA performance on extrapolated-view LiDAR synthesis across three datasets, making it a promising tool for data-driven simulation, closed-loo
Dual Quaternion Based Contact Modeling for Fast and Smooth Collision Recovery of Quadrotors
Authors: Valentin Gaucher, Wenlong Zhang | Submitted: 2026-03-16 | arXiv: 2603.14698
Categories: cs.RO
Research Background: Unmanned aerial vehicles (UAVs) operating in cluttered environments require efficient and accurate impact modeling to maintain stability post collisions, however classical impulse contact models decouple the normal and tangential components. This letter presents a dual quaternion impulse reset map directly on the SE(3) manifold.
研究背景: 在機器人學習領域,Unmanned aerial vehicles (UAVs) operating in cluttered environments require efficient and accurate impact modeling to maintain stability post collisions, however classical impulse
Technical Approach: This letter presents a dual quaternion impulse reset map directly on the SE(3) manifold. By operating on the unified spatial twist (unified linear and angular velocities), the proposed formulation retains the cross-coupling between normal and tangential impulse components in a single closed-form expression, and recovers the classical decoupled Newton impulse model as a special case. A recovery controller is designed that couples linear and angular momentum to enforce kinetic energy dissipation across impacts.
技術方法: 本文提出的方法:This letter presents a dual quaternion impulse reset map directly on the SE(3) manifold. By operating on the unified spatial twist (unified linear and angular velocities), the proposed formulation ret
Key Takeaway: Hardware-in-the-loop benchmarks demonstrate a 24% reduction in execution latency compared to an optimized matrix-based implementation, and a 20% reduction relative to a position-plus-quaternion (PQ) formulation.
核心發現: 核心結果:Hardware-in-the-loop benchmarks demonstrate a 24% reduction in execution latency compared to an optimized matrix-based implementation, and a 20% reduction relative to a position-plus-quaternion (PQ)
Joint Optimization of Storage and Loading for High-Performance 3D Point Cloud Data Processing
Authors: Ke Wang, Yanfei Cao, Xiangzhi Tao et al. | Submitted: 2026-03-16 | arXiv: 2603.16945
Categories: cs.CV, cs.AI
Research Background: With the rapid development of computer vision and deep learning, significant advancements have been made in 3D vision, partic- ularly in autonomous driving, robotic perception, and augmented reality. 3D point cloud data, as a crucial representation of 3D information, has gained widespread attention. However, the vast scale and complexity of point cloud data present significant chal- lenges for loading and processing and traditional algorithms struggle to handle large-scale datasets.The diversity of storage formats for point cloud datasets (e.g., PLY, XYZ, BIN) adds complexity to data handling and results in inefficiencies in data preparation.
研究背景: 在機器人學習領域,With the rapid development of computer vision and deep learning, significant advancements have been made in 3D vision, partic- ularly in autonomous driving, robotic perception, and
Technical Approach: To overcome these challenges, we propose the .PcRecord format, a unified data storage solution designed to reduce the storage occupation and accelerate the processing of point cloud data. By leveraging a multi-stage parallel pipeline architecture, our system optimizes the use of computational resources, significantly improving processing speed and efficiency. This paper details the im- plementation of this system and demonstrates its effectiveness in addressing the challenges of handling large-scale point cloud datasets.On average, our system achieves performance improvements of 6.61x (ModelNet40), 2.69x (S3DIS), 2.23x (ShapeNet), 3.09x (Kitti), 8.07x (SUN RGB-D), and 5.67x (ScanNet) with GPU and 6.9x, 1.88x, 1.29x, 2.28x, 25.4x, and 19.3x with Ascend.
技術方法: 本文提出的方法:To overcome these challenges, we propose the .PcRecord format, a unified data storage solution designed to reduce the storage occupation and accelerate the processing of point cloud data. By leveragin
Key Takeaway: This paper details the im- plementation of this system and demonstrates its effectiveness in addressing the challenges of handling large-scale point cloud datasets.On average, our system achieves performance improvements of 6.61x (ModelNet40), 2.69x (S3DIS), 2.23x (ShapeNet), 3.09x (Kitti), 8.07x (SUN RGB-D), and 5.67x (ScanNet) with GPU and 6.9x, 1.88x, 1.29x, 2.28x, 25.4x, and 19.3x with Ascend.
核心發現: 核心結果:This paper details the im- plementation of this system and demonstrates its effectiveness in addressing the challenges of handling large-scale point cloud datasets.On average, our system achieves perf
Reference-Free Omnidirectional Stereo Matching via Multi-View Consistency Maximization
Authors: Lehuai Xu, Weiming Zhang, Yang Li et al. | Submitted: 2026-03-16 | arXiv: 2603.15019
Categories: cs.CV
Research Background: Reliable omnidirectional depth estimation from multi-fisheye stereo matching is pivotal to many applications, such as embodied robotics. Existing approaches either rely on spherical sweeping with heuristic fusion strategies to build the cost columns or perform reference-centric stereo matching based on rectified views.
研究背景: 在機器人學習領域,Reliable omnidirectional depth estimation from multi-fisheye stereo matching is pivotal to many applications, such as embodied robotics. Existing approaches either rely on spherica
Technical Approach: In this paper, we shift to a new perspective and propose a novel reference-free framework, dubbed FreeOmniMVS, via multi-view consistency maximization. Specifically, to achieve global coherence, we introduce a novel View-pair Correlation Transformer (VCT) that explicitly models pairwise correlation volumes across all camera view pairs, allowing us to drop unreliable pairs caused by occlusion or out-of-focus observations. To realize scalable and visibility-aware consensus, we propose a lightweight attention mechanism that adaptively fuses the correlation vectors, eliminating the need for a designated reference view and allowing all cameras to contribute equally to the stereo matching process.
技術方法: 本文提出的方法:In this paper, we shift to a new perspective and propose a novel reference-free framework, dubbed FreeOmniMVS, via multi-view consistency maximization. Specifically, to achieve global coherence, we in
Key Takeaway: Extensive experiments on diverse benchmark datasets demonstrate the superiority of our method for globally consistent, visibility-aware, and scale-aware omnidirectional depth estimation.
核心發現: 核心結果:Extensive experiments on diverse benchmark datasets demonstrate the superiority of our method for globally consistent, visibility-aware, and scale-aware omnidirectional depth estimation.
FastLoop: Parallel Loop Closing with GPU-Acceleration in Visual SLAM
Authors: Soudabeh Mohammadhashemi, Shishir Gopinath, Kimia Khabiri et al. | Submitted: 2026-03-17 | arXiv: 2603.17201
Categories: cs.RO
Research Background: Visual SLAM systems combine visual tracking with global loop closure to maintain a consistent map and accurate localization. Loop closure is a computationally expensive process as we need to search across the whole map for matches.
研究背景: 在機器人學習領域,Visual SLAM systems combine visual tracking with global loop closure to maintain a consistent map and accurate localization. Loop closure is a computationally expensive process as
Technical Approach: This paper presents FastLoop, a GPU-accelerated loop closing module to alleviate this computational complexity.
技術方法: 本文提出的方法:This paper presents FastLoop, a GPU-accelerated loop closing module to alleviate this computational complexity.
Key Takeaway: Experimental results show that FastLoop achieves an average speedup of 1.4x and 1.3x on the EuRoC dataset and 3.0x and 2.4x on the TUM-VI dataset for the loop closing module on desktop and embedded platforms, respectively, while maintaining the accuracy of the original system.
核心發現: 核心結果:Experimental results show that FastLoop achieves an average speedup of 1.4x and 1.3x on the EuRoC dataset and 3.0x and 2.4x on the TUM-VI dataset for the loop closing module on desktop and embedded pl
SLAM Adversarial Lab: An Extensible Framework for Visual SLAM Robustness Evaluation under Adverse Conditions
Authors: Mohamed Hefny, Karthik Dantu, Steven Y. Ko | Submitted: 2026-03-17 | arXiv: 2603.17165
Categories: cs.RO, cs.CV
Research Background: We present SAL (SLAM Adversarial Lab), a modular framework for evaluating visual SLAM systems under adversarial conditions such as fog and rain. SAL represents each adversarial condition as a perturbation that transforms an existing dataset into an adversarial dataset.
研究背景: 在機器人學習領域,We present SAL (SLAM Adversarial Lab), a modular framework for evaluating visual SLAM systems under adversarial conditions such as fog and rain. SAL represents each adversarial con
Technical Approach: We present SAL (SLAM Adversarial Lab), a modular framework for evaluating visual SLAM systems under adversarial conditions such as fog and rain.
技術方法: 本文提出的方法:We present SAL (SLAM Adversarial Lab), a modular framework for evaluating visual SLAM systems under adversarial conditions such as fog and rain.
Key Takeaway: To showcase the capabilities of SAL, our evaluation integrates seven SLAM algorithms and evaluates them across three datasets under weather, camera, and video transport perturbations.
核心發現: 核心結果:To showcase the capabilities of SAL, our evaluation integrates seven SLAM algorithms and evaluates them across three datasets under weather, camera, and video transport perturbations.
Shielded Reinforcement Learning Under Dynamic Temporal Logic Constraints
Authors: Sadık Bera Yüksel, Ali Tevfik Buyukkocak, Derya Aksaray | Submitted: 2026-03-17 | arXiv: 2603.17152
Categories: cs.RO, cs.LG
Research Background: Reinforcement Learning (RL) has shown promise in various robotics applications, yet its deployment on real systems is still limited due to safety and operational constraints. The safe RL field has gained considerable attention in recent years, which focuses on imposing safety constraints throughout the learning process.
研究背景: 在機器人學習領域,Reinforcement Learning (RL) has shown promise in various robotics applications, yet its deployment on real systems is still limited due to safety and operational constraints. The s
Technical Approach: In this paper, we propose a framework that leverages sequential control barrier functions and model-free RL to ensure that the given STL tasks are satisfied throughout the learning process. Our method extends beyond traditional safety constraints by enforcing rich STL specifications, which can involve visits to dynamic targets with unknown trajectories. We also demonstrate the effectiveness of our framework through various simulations.
技術方法: 本文提出的方法:In this paper, we propose a framework that leverages sequential control barrier functions and model-free RL to ensure that the given STL tasks are satisfied throughout the learning process. Our method
Key Takeaway: We also demonstrate the effectiveness of our framework through various simulations.
核心發現: 核心結果:We also demonstrate the effectiveness of our framework through various simulations.
Neural Aided Adaptive Innovation-Based Invariant Kalman Filter
Authors: Barak Diker, Itzik Klein | Submitted: 2026-03-17 | arXiv: 2603.26709
Categories: eess.SY, cs.RO, eess.SP
Research Background: Autonomous platforms require accurate positioning to complete their tasks. To this end, a Kalman filter-based algorithms, such as the extended Kalman filter or invariant Kalman filter, utilizing inertial and external sensor fusion are applied.
研究背景: 在機器人學習領域,Autonomous platforms require accurate positioning to complete their tasks. To this end, a Kalman filter-based algorithms, such as the extended Kalman filter or invariant Kalman fil
Technical Approach: To this end, a Kalman filter-based algorithms, such as the extended Kalman filter or invariant Kalman filter, utilizing inertial and external sensor fusion are applied. To this end, we derive a novel theoretical extension of classical innovation-based process noise adaptation formulated directly within the Lie-group framework.
技術方法: 本文提出的方法:To this end, a Kalman filter-based algorithms, such as the extended Kalman filter or invariant Kalman filter, utilizing inertial and external sensor fusion are applied. To this end, we derive a novel
Key Takeaway: These results validate our sim2real pipeline and further confirm that geometric invariance significantly enhances learning-based adaptation and that adaptive noise estimation in the tangent Lie space offers a powerful mechanism for improving navigation accuracy in nonlinear autonomous platforms.
核心發現: 核心結果:These results validate our sim2real pipeline and further confirm that geometric invariance significantly enhances learning-based adaptation and that adaptive noise estimation in the tangent Lie space
TrackDeform3D: Markerless and Autonomous 3D Keypoint Tracking and Dataset Collection for Deformable Objects
Authors: Yeheng Zong, Yizhou Chen, Alexander Bowler et al. | Submitted: 2026-03-17 | arXiv: 2603.17068
Categories: cs.CV, cs.RO
Research Background: Structured 3D representations such as keypoints and meshes offer compact, expressive descriptions of deformable objects, jointly capturing geometric and topological information useful for downstream tasks such as dynamics modeling and motion planning. However, robustly extracting such representations remains challenging, as current perception methods struggle to handle complex deformations.
研究背景: 在機器人學習領域,Structured 3D representations such as keypoints and meshes offer compact, expressive descriptions of deformable objects, jointly capturing geometric and topological information use
Technical Approach: To address these challenges, this paper presents an affordable and autonomous framework for collecting 3D datasets of deformable objects using only RGB-D cameras. Using this framework, this paper presents a high-quality, large-scale dataset consisting of 6 deformable objects, totaling 110 minutes of trajectory data.
技術方法: 本文提出的方法:To address these challenges, this paper presents an affordable and autonomous framework for collecting 3D datasets of deformable objects using only RGB-D cameras. Using this framework, this paper pres
Key Takeaway: TrackDeform3D is evaluated against several state-of-the-art tracking methods across diverse object categories and demonstrates consistent improvements in both geometric and tracking accuracy.
核心發現: 核心結果:TrackDeform3D is evaluated against several state-of-the-art tracking methods across diverse object categories and demonstrates consistent improvements in both geometric and tracking accuracy.
MessyKitchens: Contact-rich object-level 3D scene reconstruction
Authors: Junaid Ahmed Ansari, Ran Ding, Fabio Pizzati et al. | Submitted: 2026-03-17 | arXiv: 2603.16868
Categories: cs.CV, cs.AI, cs.RO
Research Background: Monocular 3D scene reconstruction has recently seen significant progress. Powered by the modern neural architectures and large-scale data, recent methods achieve high performance in depth estimation from a single image.
研究背景: 在機器人學習領域,Monocular 3D scene reconstruction has recently seen significant progress. Powered by the modern neural architectures and large-scale data, recent methods achieve high performance i
Technical Approach: First, we introduceMessyKitchens, a new dataset with real-world scenes featuring cluttered environments and providing high-fidelity object-level ground truth in terms of 3D object shapes, poses and accurate object contacts. Second, we build on the recent SAM 3D approach for single-object reconstruction and extend it with Multi-Object Decoder (MOD) for joint object-level scene reconstruction.
技術方法: 本文提出的方法:First, we introduceMessyKitchens, a new dataset with real-world scenes featuring cluttered environments and providing high-fidelity object-level ground truth in terms of 3D object shapes, poses and ac
Key Takeaway: We also compare our multi-object reconstruction approach on three datasets and demonstrate consistent and significant improvements of MOD over the state of the art.
核心發現: 核心結果:We also compare our multi-object reconstruction approach on three datasets and demonstrate consistent and significant improvements of MOD over the state of the art.
Routing and Control for Marine Oil-Spill Cleanup with a Boom-Towing Vessel Fleet
Authors: Snir Carmeli, Adir Morgan, Kiril Solovey | Submitted: 2026-03-17 | arXiv: 2603.16626
Categories: cs.RO, cs.MA
Research Background: Marine oil spills damage ecosystems, contaminate coastlines, and disrupt food webs, while imposing substantial economic losses on fisheries and coastal communities. Prior work has demonstrated the feasibility of containing and cleaning individual spills using a duo of autonomous surface vehicles (ASVs) equipped with a towed boom and skimmers.
研究背景: 在機器人學習領域,Marine oil spills damage ecosystems, contaminate coastlines, and disrupt food webs, while imposing substantial economic losses on fisheries and coastal communities. Prior work has
Technical Approach: In this work, we propose an integrated multi-robot framework for coordinated oil-spill confinement and cleanup using autonomous ASV duos. We formulate multi-spill response as a risk-weighted minimum-latency problem, where spill-specific risk factors and service times jointly determine cumulative environmental damage. To solve this problem, we develop a hybrid optimization approach combining mixed-integer linear programming, and a tailored warm-start heuristic, enabling near-optimal routing plans for scenarios with tens of spills within minutes on commodity hardware.
技術方法: 本文提出的方法:In this work, we propose an integrated multi-robot framework for coordinated oil-spill confinement and cleanup using autonomous ASV duos. We formulate multi-spill response as a risk-weighted minimum-l
Key Takeaway: Simulation results under coupled vessel-boom dynamics demonstrate accurate path tracking for both controllers.
核心發現: 核心結果:Simulation results under coupled vessel-boom dynamics demonstrate accurate path tracking for both controllers.
Kamino: GPU-based Massively Parallel Simulation of Multi-Body Systems with Challenging Topologies
Authors: Vassilios Tsounis, Guirec Maloisel, Christian Schumacher et al. | Submitted: 2026-03-17 | arXiv: 2603.16536
Categories: cs.RO
Research Background: We present Kamino, a GPU-based physics solver for massively parallel simulations of heterogeneous highly-coupled mechanical systems. Implemented in Python using NVIDIA Warp and integrated into the Newton framework, it enables the application of data-driven methods, such as large-scale reinforcement learning, to complex robotic systems that exhibit strongly coupled kinematic and dynamic constraints such as kinematic loops.
研究背景: 在機器人學習領域,We present Kamino, a GPU-based physics solver for massively parallel simulations of heterogeneous highly-coupled mechanical systems. Implemented in Python using NVIDIA Warp and int
Technical Approach: We present Kamino, a GPU-based physics solver for massively parallel simulations of heterogeneous highly-coupled mechanical systems.
技術方法: 本文提出的方法:We present Kamino, a GPU-based physics solver for massively parallel simulations of heterogeneous highly-coupled mechanical systems.
Key Takeaway: We demonstrate RL policy training on DR Legs, a biped with six nested kinematic loops, generating a feasible walking policy while simulating 4096 parallel environments on a single GPU.
核心發現: 核心結果:We demonstrate RL policy training on DR Legs, a biped with six nested kinematic loops, generating a feasible walking policy while simulating 4096 parallel environments on a single GPU.
Coverage First Next Best View for Inspection of Cluttered Pipe Networks Using Mobile Manipulators
Authors: Joshua Raymond Bettles, Jiaxu Wu, Bruno Vilhena Adorno et al. | Submitted: 2026-03-17 | arXiv: 2603.16471
Categories: cs.RO
Research Background: Robotic inspection of radioactive areas enables operators to be removed from hazardous environments; however, planning and operating in confined, cluttered environments remain challenging. These systems must autonomously reconstruct the unknown environment and cover its surfaces, whilst estimating and avoiding collisions with objects in the environment.
研究背景: 在機器人學習領域,Robotic inspection of radioactive areas enables operators to be removed from hazardous environments; however, planning and operating in confined, cluttered environments remain chal
Technical Approach: In this paper, we propose a new planning approach based on next-best-view that enables simultaneous exploration and exploitation of the environment by reformulating the coverage path planning problem in terms of information gain.
技術方法: 本文提出的方法:In this paper, we propose a new planning approach based on next-best-view that enables simultaneous exploration and exploitation of the environment by reformulating the coverage path planning problem
Key Takeaway: These experiments demonstrate that the system can autonomously plan and execute inspection and coverage paths to reconstruct and fully cover the simplified pipe network.
核心發現: 核心結果:These experiments demonstrate that the system can autonomously plan and execute inspection and coverage paths to reconstruct and fully cover the simplified pipe network.
Onboard MuJoCo-based Model Predictive Control for Shipboard Crane with Double-Pendulum Sway Suppression
Authors: Oscar Pang, Lisa Coiffard, Paul Templier et al. | Submitted: 2026-03-17 | arXiv: 2603.16407
Categories: cs.RO
Research Background: Transferring heavy payloads in maritime settings relies on efficient crane operation, limited by hazardous double-pendulum payload sway. This sway motion is further exacerbated in offshore environments by external perturbations from wind and ocean waves.
研究背景: 在機器人學習領域,Transferring heavy payloads in maritime settings relies on efficient crane operation, limited by hazardous double-pendulum payload sway. This sway motion is further exacerbated in
Technical Approach: Furthermore, our system demonstrates robustness even when subjected to unmodeled physical discrepancies like the introduction of a second payload.
技術方法: 本文提出的方法:Furthermore, our system demonstrates robustness even when subjected to unmodeled physical discrepancies like the introduction of a second payload.
Key Takeaway: Furthermore, our system demonstrates robustness even when subjected to unmodeled physical discrepancies like the introduction of a second payload.
核心發現: 核心結果:Furthermore, our system demonstrates robustness even when subjected to unmodeled physical discrepancies like the introduction of a second payload.
Controlling Fish Schools via Reinforcement Learning of Virtual Fish Movement
Authors: Yusuke Nishii, Hiroaki Kawashima | Submitted: 2026-03-17 | arXiv: 2603.16384
Categories: cs.RO, cs.LG, q-bio.PE
Research Background: This study investigates a method to guide and control fish schools using virtual fish trained with reinforcement learning. We utilize 2D virtual fish displayed on a screen to overcome technical challenges such as durability and movement constraints inherent in physical robotic agents.
研究背景: 在機器人學習領域,This study investigates a method to guide and control fish schools using virtual fish trained with reinforcement learning. We utilize 2D virtual fish displayed on a screen to overc
Technical Approach: We utilize 2D virtual fish displayed on a screen to overcome technical challenges such as durability and movement constraints inherent in physical robotic agents. To address the lack of detailed behavioral models for real fish, we adopt a model-free reinforcement learning approach. First, simulation results show that reinforcement learning can acquire effective movement policies even when simulated real fish frequently ignore the virtual stimulus.
技術方法: 本文提出的方法:We utilize 2D virtual fish displayed on a screen to overcome technical challenges such as durability and movement constraints inherent in physical robotic agents. To address the lack of detailed behav
Key Takeaway: Statistical analysis reveals that the proposed method significantly outperforms baseline conditions, including the absence of stimulus and a heuristic “stay-at-edge” strategy.
核心發現: 核心結果:Statistical analysis reveals that the proposed method significantly outperforms baseline conditions, including the absence of stimulus and a heuristic “stay-at-edge” strategy.
Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: the eAP Dataset
Authors: Jinghang Li, Shichao Li, Qing Lian et al. | Submitted: 2026-03-17 | arXiv: 2603.16303
Categories: cs.RO
Research Background: Recent visual autonomous perception systems achieve remarkable performances with deep representation learning. However, they fail in scenarios with challenging illumination.While event cameras can mitigate this problem, there is a lack of a large-scale dataset to develop event-enhanced deep visual perception models in autonomous driving scenes.
研究背景: 在機器人學習領域,Recent visual autonomous perception systems achieve remarkable performances with deep representation learning. However, they fail in scenarios with challenging illumination.While e
Technical Approach: To address the gap, we present the eAP (event-enhanced Autonomous Perception) dataset, the largest dataset with event cameras for autonomous perception.
技術方法: 本文提出的方法:To address the gap, we present the eAP (event-enhanced Autonomous Perception) dataset, the largest dataset with event cameras for autonomous perception.
Key Takeaway: We show how a geometryaware representation learning framework leads to the best eventbased object TTC estimation network that operates at 200 FPS.
核心發現: 核心結果:We show how a geometryaware representation learning framework leads to the best eventbased object TTC estimation network that operates at 200 FPS.
Agile Interception of a Flying Target using Competitive Reinforcement Learning
Authors: Timothée Gavin, Simon Lacroix, Murat Bronz | Submitted: 2026-03-17 | arXiv: 2603.16279
Categories: cs.RO, stat.ML
Research Background: This article presents a solution to intercept an agile drone by another agile drone carrying a catching net. We formulate the interception as a Competitive Reinforcement Learning problem, where the interceptor and the target drone are controlled by separate policies trained with Proximal Policy Optimization (PPO).
研究背景: 在機器人學習領域,This article presents a solution to intercept an agile drone by another agile drone carrying a catching net. We formulate the interception as a Competitive Reinforcement Learning p
Technical Approach: We formulate the interception as a Competitive Reinforcement Learning problem, where the interceptor and the target drone are controlled by separate policies trained with Proximal Policy Optimization (PPO). We introduce a high-fidelity simulation environment that integrates a realistic quadrotor dynamics model and a low-level control architecture implemented in JAX, which allows for fast parallelized execution on GPUs.
技術方法: 本文提出的方法:We formulate the interception as a Competitive Reinforcement Learning problem, where the interceptor and the target drone are controlled by separate policies trained with Proximal Policy Optimization
Key Takeaway: Finally, we demonstrate the performance of the trained policies in a scaled real-world scenario using agile drones inside an indoor flight arena.
核心發現: 核心結果:Finally, we demonstrate the performance of the trained policies in a scaled real-world scenario using agile drones inside an indoor flight arena.
Featurized Occupation Measures for Structured Global Search in Numerical Optimal Control
Authors: Qi Wei, Jianfeng Tao, Haoyang Tan et al. | Submitted: 2026-03-17 | arXiv: 2603.16231
Categories: math.OC, cs.RO, eess.SY
Research Background: Numerical optimal control has long been split between globally structured but dimensionally intractable Hamilton—Jacobi—Bellman (HJB) methods and scalable but local trajectory optimization. We introduce Featurized Occupation Measures (FOM), a finite-dimensional primal—dual interface for coupling numerical optimal control solvers with explicit HJB subsolutions: the certificate guides the primal search, while primal residuals tighten the certificate in a primal-dual language.
研究背景: 在機器人學習領域,Numerical optimal control has long been split between globally structured but dimensionally intractable Hamilton—Jacobi—Bellman (HJB) methods and scalable but local trajectory op
Technical Approach: We introduce Featurized Occupation Measures (FOM), a finite-dimensional primal—dual interface for coupling numerical optimal control solvers with explicit HJB subsolutions: the certificate guides the primal search, while primal residuals tighten the certificate in a primal-dual language.
技術方法: 本文提出的方法:We introduce Featurized Occupation Measures (FOM), a finite-dimensional primal—dual interface for coupling numerical optimal control solvers with explicit HJB subsolutions: the certificate guides the
Key Takeaway: On a static obstacle-avoidance benchmark, certificates of increasing tightness guide a sample-based optimizer toward global optima, confirming that even a coarse certificate carries useful global information.
核心發現: 核心結果:On a static obstacle-avoidance benchmark, certificates of increasing tightness guide a sample-based optimizer toward global optima, confirming that even a coarse certificate carries useful global info
PA-LVIO: Real-Time LiDAR-Visual-Inertial Odometry and Mapping with Pose-Only Bundle Adjustment
Authors: Hailiang Tang, Tisheng Zhang, Liqiang Wang et al. | Submitted: 2026-03-17 | arXiv: 2603.16228
Categories: cs.RO
Research Background: Real-time LiDAR-visual-inertial odometry and mapping is crucial for navigation and planning tasks in intelligent transportation systems. This study presents a pose-only bundle adjustment (PA) LiDAR-visual-inertial odometry (LVIO), named PA-LVIO, to meet the urgent need for real-time navigation and mapping.
研究背景: 在機器人學習領域,Real-time LiDAR-visual-inertial odometry and mapping is crucial for navigation and planning tasks in intelligent transportation systems. This study presents a pose-only bundle adju
Technical Approach: This study presents a pose-only bundle adjustment (PA) LiDAR-visual-inertial odometry (LVIO), named PA-LVIO, to meet the urgent need for real-time navigation and mapping. The proposed PA framework for LiDAR and visual measurements is highly accurate and efficient, and it can derive reliable frame-to-frame constraints within multiple frames. A marginalization-free and frame-to-map (F2M) LiDAR measurement model is integrated into the state estimator to eliminate odometry drifts.
技術方法: 本文提出的方法:This study presents a pose-only bundle adjustment (PA) LiDAR-visual-inertial odometry (LVIO), named PA-LVIO, to meet the urgent need for real-time navigation and mapping. The proposed PA framework for
Key Takeaway: Sufficient results demonstrate that the proposed PA-LVIO yields superior or comparable performance to state-of-the-art LVIO methods, in terms of the odometry accuracy and mapping quality.
核心發現: 核心結果:Sufficient results demonstrate that the proposed PA-LVIO yields superior or comparable performance to state-of-the-art LVIO methods, in terms of the odometry accuracy and mapping quality.
PanguMotion: Continuous Driving Motion Forecasting with Pangu Transformers
Authors: Quanhao Ren, Yicheng Li, Nan Song | Submitted: 2026-03-17 | arXiv: 2603.16196
Categories: cs.RO
Research Background: Motion forecasting is a core task in autonomous driving systems, aiming to accurately predict the future trajectories of surrounding agents to ensure driving safety. Existing methods typically process discrete driving scenes independently, neglecting the temporal continuity and historical context correlations inherent in real-world driving environments.
研究背景: 在機器人學習領域,Motion forecasting is a core task in autonomous driving systems, aiming to accurately predict the future trajectories of surrounding agents to ensure driving safety. Existing metho
Technical Approach: This paper proposes PanguMotion, a motion forecasting framework for continuous driving scenarios that integrates Transformer blocks from the Pangu-1B large language model as feature enhancement modules into autonomous driving motion prediction architectures.
技術方法: 本文提出的方法:This paper proposes PanguMotion, a motion forecasting framework for continuous driving scenarios that integrates Transformer blocks from the Pangu-1B large language model as feature enhancement module
Key Takeaway: We conduct experiments on the Argoverse 2 datasets processed by the RealMotion data reorganization strategy, transforming each independent scene into a continuous sequence to mimic real-world driving scenarios.
核心發現: 核心結果:We conduct experiments on the Argoverse 2 datasets processed by the RealMotion data reorganization strategy, transforming each independent scene into a continuous sequence to mimic real-world driving
SE(3)-LIO: Smooth IMU Propagation With Jointly Distributed Poses on SE(3) Manifold for Accurate and Robust LiDAR-Inertial Odometry
Authors: Gunhee Shin, Seungjae Lee, Jei Kong et al. | Submitted: 2026-03-17 | arXiv: 2603.16118
Categories: cs.RO
Research Background: In estimating odometry accurately, an inertial measurement unit (IMU) is widely used owing to its high-rate measurements, which can be utilized to obtain motion information through IMU propagation. In this paper, we address the limitations of existing IMU propagation methods in terms of motion prediction and motion compensation.
研究背景: 在機器人學習領域,In estimating odometry accurately, an inertial measurement unit (IMU) is widely used owing to its high-rate measurements, which can be utilized to obtain motion information through
Technical Approach: In this paper, we address the limitations of existing IMU propagation methods in terms of motion prediction and motion compensation. To this end, we propose a LiDAR-inertial odometry (LIO), referred to as SE(3)-LIO, that integrates the proposed IMU propagation and uncertainty-aware motion compensation (UAMC).
技術方法: 本文提出的方法:In this paper, we address the limitations of existing IMU propagation methods in terms of motion prediction and motion compensation. To this end, we propose a LiDAR-inertial odometry (LIO), referred t
Key Takeaway: Our source code and additional material are available at: https://se3-lio.github.io/.
核心發現: 核心結果:Our source code and additional material are available at: https://se3-lio.github.io/.
Ultrafast Sampling-based Kinodynamic Planning via Differential Flatness
Authors: Thai Duong, Clayton W. Ramsey, Zachary Kingston et al. | Submitted: 2026-03-17 | arXiv: 2603.16059
Categories: cs.RO
Research Background: Motion planning under dynamics constraints, i.e, kinodynamic planning, enables safe robot operation by generating dynamically feasible trajectories that the robot can accurately track. For high-DOF robots such as manipulators, sampling-based motion planners are commonly used, especially for complex tasks in cluttered environments.
研究背景: 在機器人學習領域,Motion planning under dynamics constraints, i.e, kinodynamic planning, enables safe robot operation by generating dynamically feasible trajectories that the robot can accurately tr
Technical Approach: This paper develops FLASK, a fast parallelized sampling-based kinodynamic motion planning framework for a broad class of differentially flat robot systems, including manipulators, ground and aerial vehicles, and more. Our framework is fast, exact, and compatible with any sampling-based motion planner, while offering theoretical guarantees on probabilistic exhaustibility and asymptotic optimality based on the closed-form BVP solutions. We extensively verify the effectiveness of our approach in both simulated benchmarks and real experiments with cluttered and dynamic environments, requiring mere microseconds to milliseconds of planning time.
技術方法: 本文提出的方法:This paper develops FLASK, a fast parallelized sampling-based kinodynamic motion planning framework for a broad class of differentially flat robot systems, including manipulators, ground and aerial ve
Key Takeaway: We extensively verify the effectiveness of our approach in both simulated benchmarks and real experiments with cluttered and dynamic environments, requiring mere microseconds to milliseconds of planning time.
核心發現: 核心結果:We extensively verify the effectiveness of our approach in both simulated benchmarks and real experiments with cluttered and dynamic environments, requiring mere microseconds to milliseconds of planni
Geometry-Aligned LLM Fine-Tuning for Sequential Narrow-Opening Planning
Authors: Al Jaber Mahmud, Xuan Wang | Submitted: 2026-03-17 | arXiv: 2603.16028
Categories: cs.RO
Research Background: We study rigid-body motion planning through multiple sequential narrow openings, which requires long-horizon geometric reasoning because the configuration used to traverse an early opening constrains the set of reachable configurations for subsequent ones. To achieve this, we propose a geometry-aligned large language model (LLM) fine-tuning framework that generates fixed-length, machine-readable waypoint sequences that are both geometrically feasible and coordinated across openings.
研究背景: 在機器人學習領域,We study rigid-body motion planning through multiple sequential narrow openings, which requires long-horizon geometric reasoning because the configuration used to traverse an early
Technical Approach: To achieve this, we propose a geometry-aligned large language model (LLM) fine-tuning framework that generates fixed-length, machine-readable waypoint sequences that are both geometrically feasible and coordinated across openings. Our approach uses a bi-level training pipeline. Our method achieves the highest success rate in both in-distribution and out-of-distribution environments and qualitatively exhibits long-horizon geometric reasoning by selecting exit poses that facilitate entry into subsequent openings.
技術方法: 本文提出的方法:To achieve this, we propose a geometry-aligned large language model (LLM) fine-tuning framework that generates fixed-length, machine-readable waypoint sequences that are both geometrically feasible an
Key Takeaway: Our method achieves the highest success rate in both in-distribution and out-of-distribution environments and qualitatively exhibits long-horizon geometric reasoning by selecting exit poses that facilitate entry into subsequent openings.
核心發現: 核心結果:Our method achieves the highest success rate in both in-distribution and out-of-distribution environments and qualitatively exhibits long-horizon geometric reasoning by selecting exit poses that facil
DesertFormer: Transformer-Based Semantic Segmentation for Off-Road Desert Terrain Classification in Autonomous Navigation Systems
Authors: Yasaswini Chebolu | Submitted: 2026-03-17 | arXiv: 2603.17056
Categories: cs.CV, cs.LG
Research Background: Reliable terrain perception is a fundamental requirement for autonomous navigation in unstructured, off-road environments. Desert landscapes present unique challenges due to low chromatic contrast between terrain categories, extreme lighting variability, and sparse vegetation that defy the assumptions of standard road-scene segmentation models.
研究背景: 在機器人學習領域,Reliable terrain perception is a fundamental requirement for autonomous navigation in unstructured, off-road environments. Desert landscapes present unique challenges due to low ch
Technical Approach: We present DesertFormer, a semantic segmentation pipeline for off-road desert terrain analysis based on SegFormer B2 with a hierarchical Mix Transformer (MiT-B2) backbone.
技術方法: 本文提出的方法:We present DesertFormer, a semantic segmentation pipeline for off-road desert terrain analysis based on SegFormer B2 with a hierarchical Mix Transformer (MiT-B2) backbone.
Key Takeaway: Trained on a purpose-built dataset of 4,176 annotated off-road images at 512x512 resolution, DesertFormer achieves a mean Intersection-over-Union (mIoU) of 64.4% and pixel accuracy of 86.1%, representing a +24.2% absolute improvement over a DeepLabV3 MobileNetV2 baseline (41.0% mIoU).
核心發現: 核心結果:Trained on a purpose-built dataset of 4,176 annotated off-road images at 512x512 resolution, DesertFormer achieves a mean Intersection-over-Union (mIoU) of 64.4% and pixel accuracy of 86.1%, represent
Communication-Aware Multi-Agent Reinforcement Learning for Decentralized Cooperative UAV Deployment
Authors: Enguang Fan, Yifan Chen, Zihan Shan et al. | Submitted: 2026-03-17 | arXiv: 2603.16141
Categories: cs.MA, cs.LG, cs.NI
Research Background: Autonomous Unmanned Aerial Vehicle (UAV) swarms are increasingly used as rapidly deployable aerial relays and sensing platforms, yet practical deployments must operate under partial observability and intermittent peer-to-peer links. We present a graph-based multi-agent reinforcement learning framework trained under centralized training with decentralized execution (CTDE): a centralized critic and global state are available only during training, while each UAV executes a shared policy using local observations and messages from nearby neighbors.
研究背景: 在機器人學習領域,Autonomous Unmanned Aerial Vehicle (UAV) swarms are increasingly used as rapidly deployable aerial relays and sensing platforms, yet practical deployments must operate under partia
Technical Approach: We present a graph-based multi-agent reinforcement learning framework trained under centralized training with decentralized execution (CTDE): a centralized critic and global state are available only during training, while each UAV executes a shared policy using local observations and messages from nearby neighbors.
技術方法: 本文提出的方法:We present a graph-based multi-agent reinforcement learning framework trained under centralized training with decentralized execution (CTDE): a centralized critic and global state are available only d
Key Takeaway: In the adversarial setting, the same framework transfers without architectural changes and improves win rate over non-communicating baselines.
核心發現: 核心結果:In the adversarial setting, the same framework transfers without architectural changes and improves win rate over non-communicating baselines.
When the City Teaches the Car: Label-Free 3D Perception from Infrastructure
Authors: Zhen Xu, Jinsu Yoo, Cristian Bautista et al. | Submitted: 2026-03-17 | arXiv: 2603.16742
Categories: cs.CV
Research Background: Building robust 3D perception for self-driving still relies heavily on large-scale data collection and manual annotation, yet this paradigm becomes impractical as deployment expands across diverse cities and regions. Meanwhile, modern cities are increasingly instrumented with roadside units (RSUs), static sensors deployed along roads and at intersections to monitor traffic.
研究背景: 在機器人學習領域,Building robust 3D perception for self-driving still relies heavily on large-scale data collection and manual annotation, yet this paradigm becomes impractical as deployment expand
Technical Approach: We propose infrastructure-taught, label-free 3D perception, a paradigm in which RSUs act as stationary, unsupervised teachers for ego vehicles.
技術方法: 本文提出的方法:We propose infrastructure-taught, label-free 3D perception, a paradigm in which RSUs act as stationary, unsupervised teachers for ego vehicles.
Key Takeaway: Together, these results suggest that city infrastructure itself can potentially provide a scalable supervisory signal for autonomous vehicles, positioning infrastructure-taught learning as a promising orthogonal paradigm for reducing annotation cost in 3D perception.
核心發現: 核心結果:Together, these results suggest that city infrastructure itself can potentially provide a scalable supervisory signal for autonomous vehicles, positioning infrastructure-taught learning as a promising
DriveFix: Spatio-Temporally Coherent Driving Scene Restoration
Authors: Heyu Si, Brandon James Denis, Muyang Sun et al. | Submitted: 2026-03-17 | arXiv: 2603.16306
Categories: cs.CV
Research Background: Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these methods often process frames independently or in a view-by-view manner, leading to a critical lack of spatio-temporal synergy.
研究背景: 在機器人學習領域,Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these me
Technical Approach: We propose DriveFix, a novel multi-view restoration framework that ensures spatio-temporal coherence for driving scenes. Our approach employs an interleaved diffusion transformer architecture with specialized blocks to explicitly model both temporal dependencies and cross-camera spatial consistency.
技術方法: 本文提出的方法:We propose DriveFix, a novel multi-view restoration framework that ensures spatio-temporal coherence for driving scenes. Our approach employs an interleaved diffusion transformer architecture with spe
Key Takeaway: Extensive evaluations on the Waymo, nuScenes, and PandaSet datasets demonstrate that DriveFix achieves state-of-the-art performance in both reconstruction and novel view synthesis, marking a substantial step toward robust 4D world modeling for real-world deployment.
核心發現: 核心結果:Extensive evaluations on the Waymo, nuScenes, and PandaSet datasets demonstrate that DriveFix achieves state-of-the-art performance in both reconstruction and novel view synthesis, marking a substanti
DriveVLM-RL: Neuroscience-Inspired Reinforcement Learning with Vision-Language Models for Safe and Deployable Autonomous Driving
Authors: Zilin Huang, Zihao Sheng, Zhengyang Wan et al. | Submitted: 2026-03-18 | arXiv: 2603.18315
Categories: cs.RO, cs.AI, cs.CV
Research Background: Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse collision signals, which fail to capture the rich contextual understanding required for safe driving and make unsafe exploration unavoidable in real-world settings.
研究背景: 在機器人學習領域,Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (R
Technical Approach: To address these limitations, this paper proposes DriveVLM-RL, a neuroscience-inspired framework that integrates VLMs into RL through a dual-pathway architecture for safe and deployable autonomous driving.
技術方法: 本文提出的方法:To address these limitations, this paper proposes DriveVLM-RL, a neuroscience-inspired framework that integrates VLMs into RL through a dual-pathway architecture for safe and deployable autonomous dri
Key Takeaway: These results demonstrate that DriveVLM-RL provides a practical paradigm for integrating foundation models into autonomous driving without compromising real-time feasibility.
核心發現: 核心結果:These results demonstrate that DriveVLM-RL provides a practical paradigm for integrating foundation models into autonomous driving without compromising real-time feasibility.
Manufacturing Micro-Patterned Surfaces with Multi-Robot Systems
Authors: Annalisa T. Taylor, Malachi Landis, Ping Guo et al. | Submitted: 2026-03-18 | arXiv: 2603.18260
Categories: cs.RO
Research Background: Applying micro-patterns to surfaces has been shown to impart useful physical properties such as drag reduction and hydrophobicity. However, current manufacturing techniques cannot produce micro-patterned surfaces at scale due to high-cost machinery and inefficient coverage techniques such as raster-scanning.
研究背景: 在機器人學習領域,Applying micro-patterns to surfaces has been shown to impart useful physical properties such as drag reduction and hydrophobicity. However, current manufacturing techniques cannot
Technical Approach: However, current manufacturing techniques cannot produce micro-patterned surfaces at scale due to high-cost machinery and inefficient coverage techniques such as raster-scanning. In this work, we use multiple robots, each equipped with a patterning tool, to manufacture these surfaces. To allow these robots to coordinate during the patterning task, we use the ergodic control algorithm, which specifies coverage objectives using distributions.
技術方法: 本文提出的方法:However, current manufacturing techniques cannot produce micro-patterned surfaces at scale due to high-cost machinery and inefficient coverage techniques such as raster-scanning. In this work, we use
Key Takeaway: This work demonstrates that distributed multi-robot systems can coordinate to manufacture products that were previously unrealizable at scale.
核心發現: 核心結果:This work demonstrates that distributed multi-robot systems can coordinate to manufacture products that were previously unrealizable at scale.
Semantic Segmentation and Depth Estimation for Real-Time Lunar Surface Mapping Using 3D Gaussian Splatting
Authors: Guillem Casadesus Vila, Adam Dai, Grace Gao | Submitted: 2026-03-18 | arXiv: 2603.18218
Categories: cs.CV, cs.RO
Research Background: Navigation and mapping on the lunar surface require robust perception under challenging conditions, including poorly textured environments, high-contrast lighting, and limited computational resources. This paper presents a real-time mapping framework that integrates dense perception models with a 3D Gaussian Splatting (3DGS) representation.
研究背景: 在機器人學習領域,Navigation and mapping on the lunar surface require robust perception under challenging conditions, including poorly textured environments, high-contrast lighting, and limited comp
Technical Approach: This paper presents a real-time mapping framework that integrates dense perception models with a 3D Gaussian Splatting (3DGS) representation.
技術方法: 本文提出的方法:This paper presents a real-time mapping framework that integrates dense perception models with a 3D Gaussian Splatting (3DGS) representation.
Key Takeaway: Our results demonstrate that combining semantic segmentation and dense depth estimation with learned map representations is an effective approach for creating detailed, large-scale maps to support future lunar surface missions.
核心發現: 核心結果:Our results demonstrate that combining semantic segmentation and dense depth estimation with learned map representations is an effective approach for creating detailed, large-scale maps to support fut
R2-Dreamer: Redundancy-Reduced World Models without Decoders or Augmentation
Authors: Naoki Morihira, Amal Nahar, Kartik Bharadwaj et al. | Submitted: 2026-03-18 | arXiv: 2603.18202
Categories: cs.LG, cs.AI, cs.RO
Research Background: A central challenge in image-based Model-Based Reinforcement Learning (MBRL) is to learn representations that distill essential information from irrelevant visual details. While promising, reconstruction-based methods often waste capacity on large task-irrelevant regions.
研究背景: 在機器人學習領域,A central challenge in image-based Model-Based Reinforcement Learning (MBRL) is to learn representations that distill essential information from irrelevant visual details. While pr
Technical Approach: We propose R2-Dreamer, a decoder-free MBRL framework with a self-supervised objective that serves as an internal regularizer, preventing representation collapse without resorting to DA. The core of our method is a redundancy-reduction objective inspired by Barlow Twins, which can be easily integrated into existing frameworks.
技術方法: 本文提出的方法:We propose R2-Dreamer, a decoder-free MBRL framework with a self-supervised objective that serves as an internal regularizer, preventing representation collapse without resorting to DA. The core of ou
Key Takeaway: These results suggest that an effective internal regularizer can enable versatile, high-performance decoder-free MBRL.
核心發現: 核心結果:These results suggest that an effective internal regularizer can enable versatile, high-performance decoder-free MBRL.
GMT: Goal-Conditioned Multimodal Transformer for 6-DOF Object Trajectory Synthesis in 3D Scenes
Authors: Huajian Zeng, Abhishek Saroha, Daniel Cremers et al. | Submitted: 2026-03-18 | arXiv: 2603.17993
Categories: cs.CV, cs.RO
Research Background: Synthesizing controllable 6-DOF object manipulation trajectories in 3D environments is essential for enabling robots to interact with complex scenes, yet remains challenging due to the need for accurate spatial reasoning, physical feasibility, and multimodal scene understanding. Existing approaches often rely on 2D or partial 3D representations, limiting their ability to capture full scene geometry and constraining trajectory precision.
研究背景: 在機器人學習領域,Synthesizing controllable 6-DOF object manipulation trajectories in 3D environments is essential for enabling robots to interact with complex scenes, yet remains challenging due to
Technical Approach: We present GMT, a multimodal transformer framework that generates realistic and goal-directed object trajectories by jointly leveraging 3D bounding box geometry, point cloud context, semantic object categories, and target end poses. Our method establishes a new benchmark for learningbased manipulation planning and shows strong generalization to diverse objects and cluttered 3D environments.
技術方法: 本文提出的方法:We present GMT, a multimodal transformer framework that generates realistic and goal-directed object trajectories by jointly leveraging 3D bounding box geometry, point cloud context, semantic object c
Key Takeaway: Extensive experiments on synthetic and real-world benchmarks demonstrate that GMT outperforms state-of-the-art human motion and human-object interaction baselines, such as CHOIS and GIMO, achieving substantial gains in spatial accuracy and orientation control.
核心發現: 核心結果:Extensive experiments on synthetic and real-world benchmarks demonstrate that GMT outperforms state-of-the-art human motion and human-object interaction baselines, such as CHOIS and GIMO, achieving su
EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards
Authors: Ruixiang Wang, Qingming Liu, Yueci Deng et al. | Submitted: 2026-03-18 | arXiv: 2603.17808
Categories: cs.RO, cs.AI
Research Background: Video generative models are increasingly used as world models for robotics, where a model generates a future visual rollout conditioned on the current observation and task instruction, and an inverse dynamics model (IDM) converts the generated frames into executable robot actions. However, current video world models lack explicit executability constraints.
研究背景: 在機器人學習領域,Video generative models are increasingly used as world models for robotics, where a model generates a future visual rollout conditioned on the current observation and task instruct
Technical Approach: In this paper, we leverage the executability gap as a training signal and introduce Executable Video Alignment (EVA), a reinforcement-learning post-training framework for aligning video world models.
技術方法: 本文提出的方法:In this paper, we leverage the executability gap as a training signal and introduce Executable Video Alignment (EVA), a reinforcement-learning post-training framework for aligning video world models.
Key Takeaway: Experiments on the RoboTwin benchmark and a real bimanual robot show that EVA reduces embodiment-specific artifacts in generated rollouts and improves downstream task execution success.
核心發現: 核心結果:Experiments on the RoboTwin benchmark and a real bimanual robot show that EVA reduces embodiment-specific artifacts in generated rollouts and improves downstream task execution success.
Multi-Source Human-in-the-Loop Digital Twin Testbed for Connected and Autonomous Vehicles in Mixed Traffic Flow
Authors: Jianghong Dong, Chunying Yang, Mengchi Cai et al. | Submitted: 2026-03-18 | arXiv: 2603.17751
Categories: cs.RO, eess.SY
Research Background: In the emerging mixed traffic environments, Connected and Autonomous Vehicles (CAVs) have to interact with surrounding human-driven vehicles (HDVs). This paper introduces MSH-MCCT (Multi-Source Human-in-the-Loop Mixed Cloud Control Testbed), a novel CAV testbed that captures complex interactions between various CAVs and HDVs.
研究背景: 在機器人學習領域,In the emerging mixed traffic environments, Connected and Autonomous Vehicles (CAVs) have to interact with surrounding human-driven vehicles (HDVs). This paper introduces MSH-MCCT
Technical Approach: This paper introduces MSH-MCCT (Multi-Source Human-in-the-Loop Mixed Cloud Control Testbed), a novel CAV testbed that captures complex interactions between various CAVs and HDVs.
技術方法: 本文提出的方法:This paper introduces MSH-MCCT (Multi-Source Human-in-the-Loop Mixed Cloud Control Testbed), a novel CAV testbed that captures complex interactions between various CAVs and HDVs.
Key Takeaway: The videos for the experiments are available at our project website: https://dongjh20.github.io/MSH-MCCT.
核心發現: 核心結果:The videos for the experiments are available at our project website: https://dongjh20.github.io/MSH-MCCT.
VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector Graphs
Authors: Chaokang Jiang, Desen Zhou, Jiuming Liu et al. | Submitted: 2026-03-18 | arXiv: 2603.17652
Categories: cs.RO, cs.CV
Research Background: Closed-loop evaluation of autonomous-driving policies requires interactive simulation beyond log replay. However, existing generative world models often degrade in closed loop due to (i) history-free initialization that mismatches policy inputs, (ii) multi-step sampling latency that violates real-time budgets, and (iii) compounding kinematic infeasibility over long horizons.
研究背景: 在機器人學習領域,Closed-loop evaluation of autonomous-driving policies requires interactive simulation beyond log replay. However, existing generative world models often degrade in closed loop due
Technical Approach: We propose VectorWorld, a streaming world model that incrementally generates ego-centric lane—agent vector-graph tiles during rollout. To stabilize long-horizon rollouts, we introduce Sim, a physics-aligned non-ego (NPC) policy with hybrid discrete—continuous actions and differentiable kinematic logit shaping.
技術方法: 本文提出的方法:We propose VectorWorld, a streaming world model that incrementally generates ego-centric lane—agent vector-graph tiles during rollout. To stabilize long-horizon rol
Key Takeaway: On Waymo open motion and nuPlan, VectorWorld improves map-structure fidelity and initialization validity, and supports stable, real-time closed-loop rollouts (\href{https://github.com/jiangchaokang/VectorWorld}{code}).
核心發現: 核心結果:On Waymo open motion and nuPlan, VectorWorld improves map-structure fidelity and initialization validity, and supports stable, real-time closed-loop rollouts (\href{https://github.com/
Real-Time Online Learning for Model Predictive Control using a Spatio-Temporal Gaussian Process Approximation
Authors: Lars Bartels, Amon Lahr, Andrea Carron et al. | Submitted: 2026-03-18 | arXiv: 2603.17632
Categories: eess.SY, cs.RO, math.OC
Research Background: Learning-based model predictive control (MPC) can enhance control performance by correcting for model inaccuracies, enabling more precise state trajectory predictions than traditional MPC. A common approach is to model unknown residual dynamics as a Gaussian process (GP), which leverages data and also provides an estimate of the associated uncertainty.
研究背景: 在機器人學習領域,Learning-based model predictive control (MPC) can enhance control performance by correcting for model inaccuracies, enabling more precise state trajectory predictions than traditio
Technical Approach: A common approach is to model unknown residual dynamics as a Gaussian process (GP), which leverages data and also provides an estimate of the associated uncertainty. However, the high computational cost of online learning poses a major challenge for real-time GP-MPC applications. This work presents an efficient implementation of an approximate spatio-temporal GP model, offering online learning at constant computational complexity.
技術方法: 本文提出的方法:A common approach is to model unknown residual dynamics as a Gaussian process (GP), which leverages data and also provides an estimate of the associated uncertainty. However, the high computational co
Key Takeaway: The performance of the proposed method is demonstrated by simulations and hardware experiments in the exemplary application of autonomous miniature racing.
核心發現: 核心結果:The performance of the proposed method is demonstrated by simulations and hardware experiments in the exemplary application of autonomous miniature racing.
Bringing Network Coding into Multi-Robot Systems: Interplay Study for Autonomous Systems over Wireless Communications
Authors: Anil Zaher, Kiril Solovey, Alejandro Cohen | Submitted: 2026-03-18 | arXiv: 2603.17472
Categories: cs.RO, cs.MA, cs.NI
Research Background: Communication is a core enabler for multi-robot systems (MRS), providing the mechanism through which robots exchange state information, coordinate actions, and satisfy safety constraints. While many MRS autonomy algorithms assume reliable and timely message delivery, realistic wireless channels introduce delay, erasures, and ordering stalls that can degrade performance and compromise safety-critical decisions of the robot task.
研究背景: 在機器人學習領域,Communication is a core enabler for multi-robot systems (MRS), providing the mechanism through which robots exchange state information, coordinate actions, and satisfy safety const
Technical Approach: In this paper, we investigate how transport-layer reliability mechanisms that mitigate communication losses and delays shape the autonomy-communication loop. We present two case studies: cooperative localization under delayed and lossy inter-robot communication, and a safety-critical overtaking maneuver where timely vehicle-to-vehicle message availability determines whether an ego vehicle can abort to avoid a crash.
技術方法: 本文提出的方法:In this paper, we investigate how transport-layer reliability mechanisms that mitigate communication losses and delays shape the autonomy-communication loop. We present two case studies: cooperative l
Key Takeaway: Our results demonstrate that coding-based communication significantly reduces in-order delivery stalls, preserves estimation consistency under delay, and improves deadline reliability relative to retransmission-based transport.
核心發現: 核心結果:Our results demonstrate that coding-based communication significantly reduces in-order delivery stalls, preserves estimation consistency under delay, and improves deadline reliability relative to retr
Uncovering Latent Phase Structures and Branching Logic in Locomotion Policies: A Case Study on HalfCheetah
Authors: Daisuke Yasui, Toshitaka Matsuki, Hiroshi Sato | Submitted: 2026-03-18 | arXiv: 2603.18084
Categories: cs.RO, cs.AI
Research Background: In locomotion control tasks, Deep Reinforcement Learning (DRL) has demonstrated high performance; however, the decision-making process of the learned policy remains a black box, making it difficult for humans to understand. On the other hand, in periodic motions such as walking, it is well known that implicit motion phases exist, such as the stance phase and the swing phase.
研究背景: 在機器人學習領域,In locomotion control tasks, Deep Reinforcement Learning (DRL) has demonstrated high performance; however, the decision-making process of the learned policy remains a black box, ma
Technical Approach: On the other hand, in periodic motions such as walking, it is well known that implicit motion phases exist, such as the stance phase and the swing phase. Focusing on this point, this study hypothesizes that a policy trained for locomotion control may also represent a phase structure that is interpretable by humans. To examine this hypothesis in a controlled setting, we consider a locomotion task that is amenable to observing whether a policy autonomously acquires temporally structured phases through interaction with the environment.
技術方法: 本文提出的方法:On the other hand, in periodic motions such as walking, it is well known that implicit motion phases exist, such as the stance phase and the swing phase. Focusing on this point, this study hypothesize
Key Takeaway: These results suggest that neural network-based policies, which are often regarded as black boxes, can autonomously acquire interpretable phase structures and logical branching mechanisms.
核心發現: 核心結果:These results suggest that neural network-based policies, which are often regarded as black boxes, can autonomously acquire interpretable phase structures and logical branching mechanisms.
SafeLand: Safe Autonomous Landing in Unknown Environments with Bayesian Semantic Mapping
Authors: Markus Gross, Andreas Greiner, Sai Bharadhwaj Matha et al. | Submitted: 2026-03-18 | arXiv: 2603.17430
Categories: cs.RO
Research Background: Autonomous landing of uncrewed aerial vehicles (UAVs) in unknown, dynamic environments poses significant safety challenges, particularly near people and infrastructure, as UAVs transition to routine urban and rural operations. Existing methods often rely on prior maps, heavy sensors like LiDAR, static markers, or fail to handle non-cooperative dynamic obstacles like humans, limiting generalization and real-time performance.
研究背景: 在機器人學習領域,Autonomous landing of uncrewed aerial vehicles (UAVs) in unknown, dynamic environments poses significant safety challenges, particularly near people and infrastructure, as UAVs tra
Technical Approach: To address these challenges, we introduce SafeLand, a lean, vision-based system for safe autonomous landing (SAL) that requires no prior information and operates only with a camera and a lightweight height sensor. Our approach constructs an online semantic ground map via deep learning-based semantic segmentation, optimized for embedded deployment and trained on a consolidation of seven curated public aerial datasets (achieving 70.22% mIoU across 20 classes), which is further refined through Bayesian probabilistic filtering with temporal semantic decay to robustly identify metric-scale landing spots. We extensively evaluate our method in 200 simulations and 60 end-to-end field tests across industrial, urban, and rural environments at altitudes up to 100m, demonstrating zero false negatives for human detection.
技術方法: 本文提出的方法:To address these challenges, we introduce SafeLand, a lean, vision-based system for safe autonomous landing (SAL) that requires no prior information and operates only with a camera and a lightweight h
Key Takeaway: Compared to the state of the art, SafeLand achieves sub-second response latency, substantially lower than previous methods, while maintaining a superior success rate of 95%.
核心發現: 核心結果:Compared to the state of the art, SafeLand achieves sub-second response latency, substantially lower than previous methods, while maintaining a superior success rate of 95%.
Physics-informed Deep Mixture-of-Koopmans Vehicle Dynamics Model with Dual-branch Encoder for Distributed Electric-drive Trucks
Authors: Jinyu Miao, Pu Zhang, Rujun Yan et al. | Submitted: 2026-03-18 | arXiv: 2603.17416
Categories: cs.RO, eess.SY
Research Background: Advanced autonomous driving systems require accurate vehicle dynamics modeling. However, identifying a precise dynamics model remains challenging due to strong nonlinearities and the coupled longitudinal and lateral dynamic characteristics.
研究背景: 在機器人學習領域,Advanced autonomous driving systems require accurate vehicle dynamics modeling. However, identifying a precise dynamics model remains challenging due to strong nonlinearities and t
Technical Approach: In this paper, we propose a fully data-driven dynamics modeling method tailored for complex distributed electric-drive trucks (DETs), leveraging Koopman operator theory to represent highly nonlinear dynamics in a lifted linear embedding space.
技術方法: 本文提出的方法:In this paper, we propose a fully data-driven dynamics modeling method tailored for complex distributed electric-drive trucks (DETs), leveraging Koopman operator theory to represent highly nonlinear d
Key Takeaway: Simulations conducted in a high-fidelity TruckSim environment and real-world experiments demonstrate that the proposed approach achieves state-of-the-art performance in long-term dynamics state estimation.
核心發現: 核心結果:Simulations conducted in a high-fidelity TruckSim environment and real-world experiments demonstrate that the proposed approach achieves state-of-the-art performance in long-term dynamics state estima
Physics-informed offline reinforcement learning eliminates catastrophic fuel waste in maritime routing
Authors: Aniruddha Bora, Julie Chalfant, Chryssostomos Chryssostomidis | Submitted: 2026-03-18 | arXiv: 2603.17319
Categories: cs.AI, cs.LG, cs.RO
Research Background: International shipping produces approximately 3% of global greenhouse gas emissions, yet voyage routing remains dominated by heuristic methods. We present PIER (Physics-Informed, Energy-efficient, Risk-aware routing), an offline reinforcement learning framework that learns fuel-efficient, safety-aware routing policies from physics-calibrated environments grounded in historical vessel tracking data and ocean reanalysis products, requiring no online simulator.
研究背景: 在機器人學習領域,International shipping produces approximately 3% of global greenhouse gas emissions, yet voyage routing remains dominated by heuristic methods. We present PIER (Physics-Informed, E
Technical Approach: We present PIER (Physics-Informed, Energy-efficient, Risk-aware routing), an offline reinforcement learning framework that learns fuel-efficient, safety-aware routing policies from physics-calibrated environments grounded in historical vessel tracking data and ocean reanalysis products, requiring no online simulator.
技術方法: 本文提出的方法:We present PIER (Physics-Informed, Energy-efficient, Risk-aware routing), an offline reinforcement learning framework that learns fuel-efficient, safety-aware routing policies from physics-calibrated
Key Takeaway: The framework combines physics-informed state construction, demonstration-augmented offline data, and a decoupled post-hoc safety shield, an architecture that transfers to wildfire evacuation, aircraft trajectory optimization, and autonomous navigation in unmapped terrain.
核心發現: 核心結果:The framework combines physics-informed state construction, demonstration-augmented offline data, and a decoupled post-hoc safety shield, an architecture that transfers to wildfire evacuation, aircraf
Neural Radiance Maps for Extraterrestrial Navigation and Path Planning
Authors: Adam Dai, Shubh Gupta, Grace Gao | Submitted: 2026-03-18 | arXiv: 2603.17236
Categories: cs.RO, cs.CV
Research Background: Autonomous vehicles such as the Mars rovers currently lead the vanguard of surface exploration on extraterrestrial planets and moons. In order to accelerate the pace of exploration and science objectives, it is critical to plan safe and efficient paths for these vehicles.
研究背景: 在機器人學習領域,Autonomous vehicles such as the Mars rovers currently lead the vanguard of surface exploration on extraterrestrial planets and moons. In order to accelerate the pace of exploration
Technical Approach: We propose to use NeRFs to construct maps for online use in autonomous navigation, and present a planning framework which leverages the NeRF map to integrate local and global information. Our approach interpolates local cost observations across global regions using kernel ridge regression over terrain features extracted from the NeRF map, allowing the rover to re-route itself around untraversable areas discovered during online operation. We validate our approach in high-fidelity simulation and demonstrate lower cost and higher percentage success rate path planning compared to various baselines.
技術方法: 本文提出的方法:We propose to use NeRFs to construct maps for online use in autonomous navigation, and present a planning framework which leverages the NeRF map to integrate local and global information. Our approach
Key Takeaway: We validate our approach in high-fidelity simulation and demonstrate lower cost and higher percentage success rate path planning compared to various baselines.
核心發現: 核心結果:We validate our approach in high-fidelity simulation and demonstrate lower cost and higher percentage success rate path planning compared to various baselines.
Full Stack Navigation, Mapping, and Planning for the Lunar Autonomy Challenge
Authors: Adam Dai, Asta Wu, Keidai Iiyama et al. | Submitted: 2026-03-18 | arXiv: 2603.17232
Categories: cs.RO
Research Background: We present a modular, full-stack autonomy system for lunar surface navigation and mapping developed for the Lunar Autonomy Challenge. Operating in a GNSS-denied, visually challenging environment, our pipeline integrates semantic segmentation, stereo visual odometry, pose graph SLAM with loop closures, and layered planning and control.
研究背景: 在機器人學習領域,We present a modular, full-stack autonomy system for lunar surface navigation and mapping developed for the Lunar Autonomy Challenge. Operating in a GNSS-denied, visually challengi
Technical Approach: We present a modular, full-stack autonomy system for lunar surface navigation and mapping developed for the Lunar Autonomy Challenge. We leverage lightweight learning-based perception models for real-time segmentation and feature tracking and use a factor-graph backend to maintain globally consistent localization. We evaluate our approach in the competition’s high-fidelity lunar simulator, demonstrating centimeter-level localization accuracy, high-fidelity map generation, and strong repeatability across random seeds and rock distributions.
技術方法: 本文提出的方法:We present a modular, full-stack autonomy system for lunar surface navigation and mapping developed for the Lunar Autonomy Challenge. We leverage lightweight learning-based perception models for real-
Key Takeaway: Our solution achieved first place in the final competition evaluation.
核心發現: 核心結果:Our solution achieved first place in the final competition evaluation.
Visual SLAM with DEM Anchoring for Lunar Surface Navigation
Authors: Adam Dai, Guillem Casadesus Vila, Grace Gao | Submitted: 2026-03-18 | arXiv: 2603.17229
Categories: cs.RO, cs.CV
Research Background: Future lunar missions will require autonomous rovers capable of traversing tens of kilometers across challenging terrain while maintaining accurate localization and producing globally consistent maps. However, the absence of global positioning systems, extreme illumination, and low-texture regolith make long-range navigation on the Moon particularly difficult, as visual-inertial odometry pipelines accumulate drift over extended traverses.
研究背景: 在機器人學習領域,Future lunar missions will require autonomous rovers capable of traversing tens of kilometers across challenging terrain while maintaining accurate localization and producing globa
Technical Approach: To address this challenge, we present a stereo visual simultaneous localization and mapping (SLAM) system that integrates learned feature detection and matching with global constraints from digital elevation models (DEMs). We validate our approach using both simulated lunar traverse data generated in Unreal Engine and real Moon/Mars analog data collected from Mt.
技術方法: 本文提出的方法:To address this challenge, we present a stereo visual simultaneous localization and mapping (SLAM) system that integrates learned feature detection and matching with global constraints from digital el
Key Takeaway: Results demonstrate that DEM anchoring consistently reduces absolute trajectory error compared to baseline SLAM methods, lowering drift in long-range navigation even in repetitive or visually aliased terrain.
核心發現: 核心結果:Results demonstrate that DEM anchoring consistently reduces absolute trajectory error compared to baseline SLAM methods, lowering drift in long-range navigation even in repetitive or visually aliased
Unlabeled Multi-Robot Motion Planning with Improved Separation Trade-offs
Authors: Tsuri Farhana, Omrit Filtser, Shalev Goldshtein | Submitted: 2026-03-19 | arXiv: 2603.19502
Categories: cs.CG, cs.RO
Research Background: We study unlabeled multi-robot motion planning for unit-disk robots in a polygonal environment. Although the problem is hard in general, polynomial-time solutions exist under appropriate separation assumptions on start and target positions.
研究背景: 在機器人學習領域,We study unlabeled multi-robot motion planning for unit-disk robots in a polygonal environment. Although the problem is hard in general, polynomial-time solutions exist under appro
Technical Approach: In this paper we present a generalized algorithm that achieve different trade-offs on the robots-separation and obstacles-separation bounds, all significantly improving upon the state of the art. Additionally, we introduce a different strategy yielding a polynomial-time solution when the robots-separation is only , and the obstacles-separation is .
技術方法: 本文提出的方法:In this paper we present a generalized algorithm that achieve different trade-offs on the robots-separation and obstacles-separation bounds, all significantly improving upon the state of the art. Addi
Key Takeaway: Finally, we show that without any robots-separation assumption, obstacles-separation of at least may be necessary for a solution to exist.
核心發現: 核心結果:Finally, we show that without any robots-separation assumption, obstacles-separation of at least may be necessary for a solution to exist.
Real-Time Optical Communication Using Event-Based Vision with Moving Transmitters
Authors: Harmeet Dhillon, Pranay Katyal, Brendan Long et al. | Submitted: 2026-03-19 | arXiv: 2603.19477
Categories: cs.RO
Research Background: In multi-robot systems, traditional radio frequency (RF) communication struggles with contention and jamming. Optical communication offers a strong alternative.
研究背景: 在機器人學習領域,In multi-robot systems, traditional radio frequency (RF) communication struggles with contention and jamming. Optical communication offers a strong alternative.
Technical Approach: Leveraging these strengths, we develop a complete optical communication system capable of tracking moving transmitters and decoding messages in real time. Our system achieves over decoding accuracy for text transmission during motion by implementing a Geometry-Aware Unscented Kalman Filter (GA-UKF), achieving 7x faster processing speed compared to the previous state-of-the-art method, while maintaining equivalent tracking accuracy at transmitting frequencies 1 kHz.
技術方法: 本文提出的方法:Leveraging these strengths, we develop a complete optical communication system capable of tracking moving transmitters and decoding messages in real time. Our system achieves over decoding accu
Key Takeaway: Our system achieves over decoding accuracy for text transmission during motion by implementing a Geometry-Aware Unscented Kalman Filter (GA-UKF), achieving 7x faster processing speed compared to the previous state-of-the-art method, while maintaining equivalent tracking accuracy at transmitting frequencies 1 kHz.
核心發現: 核心結果:Our system achieves over decoding accuracy for text transmission during motion by implementing a Geometry-Aware Unscented Kalman Filter (GA-UKF), achieving 7x faster processing speed compared t
Can LLMs Prove Robotic Path Planning Optimality? A Benchmark for Research-Level Algorithm Verification
Authors: Zhengbang Yang, Md. Tasin Tazwar, Minghan Wei et al. | Submitted: 2026-03-19 | arXiv: 2603.19464
Categories: cs.RO
Research Background: Robotic path planning problems are often NP-hard, and practical solutions typically rely on approximation algorithms with provable performance guarantees for general cases. While designing such algorithms is challenging, formally proving their approximation optimality is even more demanding, which requires domain-specific geometric insights and multi-step mathematical reasoning over complex operational constraints.
研究背景: 在機器人學習領域,Robotic path planning problems are often NP-hard, and practical solutions typically rely on approximation algorithms with provable performance guarantees for general cases. While d
Technical Approach: In this work, we introduce the first benchmark for evaluating LLMs on approximation-ratio proofs of robotic path planning algorithms.
技術方法: 本文提出的方法:In this work, we introduce the first benchmark for evaluating LLMs on approximation-ratio proofs of robotic path planning algorithms.
Key Takeaway: We further provide fine-grained error analysis to characterize common logical failures and hallucinations, and demonstrate how each error type can be mitigated through targeted context augmentation.
核心發現: 核心結果:We further provide fine-grained error analysis to characterize common logical failures and hallucinations, and demonstrate how each error type can be mitigated through targeted context augmentation.
Exact and Approximate Convex Reformulation of Linear Stochastic Optimal Control with Chance Constraints
Authors: Tanmay Dokania, Yashwanth Kumar Nakka | Submitted: 2026-03-19 | arXiv: 2603.19454
Categories: eess.SY, cs.RO
Research Background: In this paper, we present an equivalent convex optimization formulation for discrete-time stochastic linear systems subject to linear chance constraints, alongside a tight convex relaxation for quadratic chance constraints. By lifting the state vector to encode moment information explicitly, the formulation captures linear chance constraints on states and controls across multiple time steps exactly, without conservatism, yielding strict improvements in both feasibility and optimality.
研究背景: 在機器人學習領域,In this paper, we present an equivalent convex optimization formulation for discrete-time stochastic linear systems subject to linear chance constraints, alongside a tight convex r
Technical Approach: In this paper, we present an equivalent convex optimization formulation for discrete-time stochastic linear systems subject to linear chance constraints, alongside a tight convex relaxation for quadratic chance constraints.
技術方法: 本文提出的方法:In this paper, we present an equivalent convex optimization formulation for discrete-time stochastic linear systems subject to linear chance constraints, alongside a tight convex relaxation for quadra
Key Takeaway: By lifting the state vector to encode moment information explicitly, the formulation captures linear chance constraints on states and controls across multiple time steps exactly, without conservatism, yielding strict improvements in both feasibility and optimality.
核心發現: 核心結果:By lifting the state vector to encode moment information explicitly, the formulation captures linear chance constraints on states and controls across multiple time steps exactly, without conservatism,
Tendon-Actuated Robots with a Tapered, Flexible Polymer Backbone: Design, Fabrication, and Modeling
Authors: Harald Minde Hansen, Nandita Gallacher, Nicholas B. Andrews et al. | Submitted: 2026-03-19 | arXiv: 2603.19124
Categories: cs.RO
Research Background: This paper presents the design, modeling, and fabrication of 3D-printed, tendon-actuated continuum robots featuring a flexible, tapered backbone constructed from thermoplastic polyurethane (TPU). Our scalable design incorporates an integrated electronics base housing that enables direct tendon tension control and sensing via actuators and compression load cells.
研究背景: 在機器人學習領域,This paper presents the design, modeling, and fabrication of 3D-printed, tendon-actuated continuum robots featuring a flexible, tapered backbone constructed from thermoplastic poly
Technical Approach: This paper presents the design, modeling, and fabrication of 3D-printed, tendon-actuated continuum robots featuring a flexible, tapered backbone constructed from thermoplastic polyurethane (TPU). We develop a generalized forward kinetostatic model of the tapered backbone based on Cosserat rod theory using a Newtonian approach, extending existing tendon-actuated Cosserat rod formulations to explicitly account for spatially varying backbone cross-sectional geometry.
技術方法: 本文提出的方法:This paper presents the design, modeling, and fabrication of 3D-printed, tendon-actuated continuum robots featuring a flexible, tapered backbone constructed from thermoplastic polyurethane (TPU). We d
Key Takeaway: We further demonstrate teleoperated grasping using an endoscopic gripper routed along the continuum robot, mounted on a 6-DoF robotic arm.
核心發現: 核心結果:We further demonstrate teleoperated grasping using an endoscopic gripper routed along the continuum robot, mounted on a 6-DoF robotic arm.
DROID-SLAM in the Wild
Authors: Moyang Li, Zihan Zhu, Marc Pollefeys et al. | Submitted: 2026-03-19 | arXiv: 2603.19076
Categories: cs.CV, cs.RO
Research Background: We present a robust, real-time RGB SLAM system that handles dynamic environments by leveraging differentiable Uncertainty-aware Bundle Adjustment. Traditional SLAM methods typically assume static scenes, leading to tracking failures in the presence of motion.
研究背景: 在機器人學習領域,We present a robust, real-time RGB SLAM system that handles dynamic environments by leveraging differentiable Uncertainty-aware Bundle Adjustment. Traditional SLAM methods typicall
Technical Approach: We present a robust, real-time RGB SLAM system that handles dynamic environments by leveraging differentiable Uncertainty-aware Bundle Adjustment. In contrast, our method estimates per-pixel uncertainty by exploiting multi-view visual feature inconsistency, enabling robust tracking and reconstruction even in real-world environments.
技術方法: 本文提出的方法:We present a robust, real-time RGB SLAM system that handles dynamic environments by leveraging differentiable Uncertainty-aware Bundle Adjustment. In contrast, our method estimates per-pixel uncertain
Key Takeaway: The proposed system achieves state-of-the-art camera poses and scene geometry in cluttered dynamic scenarios while running in real time at around 10 FPS.
核心發現: 核心結果:The proposed system achieves state-of-the-art camera poses and scene geometry in cluttered dynamic scenarios while running in real time at around 10 FPS.
Lightweight Model Predictive Control for Spacecraft Rendezvous Attitude Synchronization
Authors: Peter Stadler, Alexander Meinert, Niklas Baldauf et al. | Submitted: 2026-03-19 | arXiv: 2603.18921
Categories: cs.RO, eess.SY
Research Background: This work introduces two lightweight model predictive control (MPC) approaches for attitude tracking with reaction wheels during spacecraft rendezvous synchronization. Both approaches are based on a novel attitude deviation formulation, which enables the use of inherently linear constraints on angular velocity.
研究背景: 在機器人學習領域,This work introduces two lightweight model predictive control (MPC) approaches for attitude tracking with reaction wheels during spacecraft rendezvous synchronization. Both approac
Technical Approach: We develop a single-loop and a dual-loop MPC; the latter embeds a stabilizing feedback controller within the inner loop, yielding a linear time-invariant system.
技術方法: 本文提出的方法:We develop a single-loop and a dual-loop MPC; the latter embeds a stabilizing feedback controller within the inner loop, yielding a linear time-invariant system.
Key Takeaway: The experimental results demonstrate improved tracking accuracy alongside reductions in computational effort and memory consumption.
核心發現: 核心結果:The experimental results demonstrate improved tracking accuracy alongside reductions in computational effort and memory consumption.
A Passive Elastic-Folding Mechanism for Stackable Airdrop Sensors
Authors: Damyon Kim, Yuichi Honjo, Tatsuya Iizuka et al. | Submitted: 2026-03-19 | arXiv: 2603.18861
Categories: cs.RO, eess.SY
Research Background: Air-dispersed sensor networks deployed from aerial robotic systems (e.g., UAVs) provide a low-cost approach to wide-area environmental monitoring. However, existing methods often rely on active actuators for mid-air shape or trajectory control, increasing both power consumption and system cost.
研究背景: 在機器人學習領域,Air-dispersed sensor networks deployed from aerial robotic systems (e.g., UAVs) provide a low-cost approach to wide-area environmental monitoring. However, existing methods often r
Technical Approach: Here, we introduce a passive elastic-folding hinge mechanism that transforms sensors from a flat, stackable form into a three-dimensional structure upon release.
技術方法: 本文提出的方法:Here, we introduce a passive elastic-folding hinge mechanism that transforms sensors from a flat, stackable form into a three-dimensional structure upon release.
Key Takeaway: Field trials further demonstrated reliable data collection and LoRa transmission during dispersion, while the Horizontal Wind Model (HWM)-based trajectory simulations indicated strong potential for wide-area sensing exceeding 10 km.
核心發現: 核心結果:Field trials further demonstrated reliable data collection and LoRa transmission during dispersion, while the Horizontal Wind Model (HWM)-based trajectory simulations indicated strong potential for wi
ROFT-VINS: Robust Feature Tracking-based Visual-Inertial State Estimation for Harsh Environment
Authors: Sanghyun Park, Soohee Han | Submitted: 2026-03-19 | arXiv: 2603.18746
Categories: cs.RO
Research Background: SLAM (Simultaneous Localization and Mapping) and Odometry are important systems for estimating the position of mobile devices, such as robots and cars, utilizing one or more sensors. Particularly in camera-based SLAM or Odometry, effectively tracking visual features is important as it significantly impacts system performance.
研究背景: 在機器人學習領域,SLAM (Simultaneous Localization and Mapping) and Odometry are important systems for estimating the position of mobile devices, such as robots and cars, utilizing one or more sensor
Technical Approach: In this paper, we propose a method that leverages deep learning to robustly track visual features in monocular camera images.
技術方法: 本文提出的方法:In this paper, we propose a method that leverages deep learning to robustly track visual features in monocular camera images.
Key Takeaway: Additionally, we evaluate the performance of our proposed method by integrating it into VINS-Fusion (Monocular-Inertial), a commonly used Visual-Inertial Odometry (VIO) system.
核心發現: 核心結果:Additionally, we evaluate the performance of our proposed method by integrating it into VINS-Fusion (Monocular-Inertial), a commonly used Visual-Inertial Odometry (VIO) system.
CSSDF-Net: Safe Motion Planning Based on Neural Implicit Representations of Configuration Space Distance Field
Authors: Haohua Chen, Yixuan Zhou, Yifan Zhou et al. | Submitted: 2026-03-19 | arXiv: 2603.18669
Categories: cs.RO
Research Background: High-dimensional manipulator operation in unstructured environments requires a differentiable, scene-agnostic distance query mechanism to guide safe motion generation. Existing geometric collision checkers are typically non-differentiable, while workspace-based implicit distance models are hindered by the highly nonlinear workspace—configuration mapping and often suffer from poor convergence; moreover, self-collision and environment collision are commonly handled as separate constraints.
研究背景: 在機器人學習領域,High-dimensional manipulator operation in unstructured environments requires a differentiable, scene-agnostic distance query mechanism to guide safe motion generation. Existing geo
Technical Approach: We propose Configuration-Space Signed Distance Field-Net (CSSDF-Net), which learns a continuous signed distance field directly in configuration space to provide joint-space distance and gradient queries under a unified geometric notion of safety. To enable zero-shot generalization without environment-specific retraining, we introduce a spatial-hashing-based data generation pipeline that encodes robot-centric geometric priors and supports efficient retrieval of risk configurations for arbitrary obstacle point sets.
技術方法: 本文提出的方法:We propose Configuration-Space Signed Distance Field-Net (CSSDF-Net), which learns a continuous signed distance field directly in configuration space to provide joint-space distance and gradient queri
Key Takeaway: Experiments on a planar arm and a 7-DoF manipulator demonstrate stable gradients, effective collision avoidance in static and dynamic scenes, and practical inference latency for large-scale point-cloud queries, supporting deployment in previously unseen environments.
核心發現: 核心結果:Experiments on a planar arm and a 7-DoF manipulator demonstrate stable gradients, effective collision avoidance in static and dynamic scenes, and practical inference latency for large-scale point-clou
Benchmarking Visual Feature Representations for LiDAR-Inertial-Visual Odometry Under Challenging Conditions
Authors: Eunseon Choi, Junwoo Hong, Daehan Lee et al. | Submitted: 2026-03-19 | arXiv: 2603.18589
Categories: cs.RO
Research Background: Accurate localization in autonomous driving is critical for successful missions including environmental mapping and survivor searches. In visually challenging environments, including low-light conditions, overexposure, illumination changes, and high parallax, the performance of conventional visual odometry methods significantly degrade undermining robust robotic navigation.
研究背景: 在機器人學習領域,Accurate localization in autonomous driving is critical for successful missions including environmental mapping and survivor searches. In visually challenging environments, includi
Technical Approach: This paper extends the FAST-LIVO2-based framework by introducing a hybrid approach that integrates direct photometric methods with descriptor-based feature matching.
技術方法: 本文提出的方法:This paper extends the FAST-LIVO2-based framework by introducing a hybrid approach that integrates direct photometric methods with descriptor-based feature matching.
Key Takeaway: The experimental results reveal that the proposed hybrid approach outperforms the conventional sparse-direct method.
核心發現: 核心結果:The experimental results reveal that the proposed hybrid approach outperforms the conventional sparse-direct method.
HEP Statistical Inference for UAV Fault Detection: CLs, LRT, and SBI Applied to Blade Damage
Authors: Khushiyant | Submitted: 2026-03-19 | arXiv: 2603.18546
Categories: cs.LG, cs.RO, eess.SY
Research Background: This paper transfers three statistical methods from particle physics to multirotor propeller fault detection: the likelihood ratio test (LRT) for binary detection, the CLs modified frequentist method for false alarm rate control, and sequential neural posterior estimation (SNPE) for quantitative fault characterization. Operating on spectral features tied to rotor harmonic physics, the system returns three outputs: binary detection, controlled false alarm rates, and calibrated posteriors over fault severity and motor location.
研究背景: 在機器人學習領域,This paper transfers three statistical methods from particle physics to multirotor propeller fault detection: the likelihood ratio test (LRT) for binary detection, the CLs modified
Technical Approach: This paper transfers three statistical methods from particle physics to multirotor propeller fault detection: the likelihood ratio test (LRT) for binary detection, the CLs modified frequentist method for false alarm rate control, and sequential neural posterior estimation (SNPE) for quantitative fault characterization.
技術方法: 本文提出的方法:This paper transfers three statistical methods from particle physics to multirotor propeller fault detection: the likelihood ratio test (LRT) for binary detection, the CLs modified frequentist method
Key Takeaway: Per-flight sequential detection achieves 100% fault detection with 94% overall accuracy.
核心發現: 核心結果:Per-flight sequential detection achieves 100% fault detection with 94% overall accuracy.
Computationally Efficient Density-Driven Optimal Control via Analytical KKT Reduction and Contractive MPC
Authors: Julian Martinez, Kooktae Lee | Submitted: 2026-03-19 | arXiv: 2603.18503
Categories: math.OC, cs.MA, cs.RO
Research Background: Efficient coordination for collective spatial distribution is a fundamental challenge in multi-agent systems. Prior research on Density-Driven Optimal Control (D2OC) established a framework to match agent trajectories to a desired spatial distribution.
研究背景: 在機器人學習領域,Efficient coordination for collective spatial distribution is a fundamental challenge in multi-agent systems. Prior research on Density-Driven Optimal Control (D2OC) established a
Technical Approach: To resolve this, we propose an analytical structural reduction that transforms the T-horizon KKT system into a condensed quadratic program (QP).
技術方法: 本文提出的方法:To resolve this, we propose an analytical structural reduction that transforms the T-horizon KKT system into a condensed quadratic program (QP).
Key Takeaway: This formulation achieves O(T) linear scalability, significantly reducing the online computational burden compared to conventional O(T^3) approaches.
核心發現: 核心結果:This formulation achieves O(T) linear scalability, significantly reducing the online computational burden compared to conventional O(T^3) approaches.
Graph-of-Constraints Model Predictive Control for Reactive Multi-agent Task and Motion Planning
Authors: Anastasios Manganaris, Jeremy Lu, Ahmed H. Qureshi et al. | Submitted: 2026-03-19 | arXiv: 2603.18400
Categories: cs.RO
Research Background: Sequences of interdependent geometric constraints are central to many multi-agent Task and Motion Planning (TAMP) problems. However, existing methods for handling such constraint sequences struggle with partially ordered tasks and dynamic agent assignments.
研究背景: 在機器人學習領域,Sequences of interdependent geometric constraints are central to many multi-agent Task and Motion Planning (TAMP) problems. However, existing methods for handling such constraint s
Technical Approach: To overcome these limitations, we introduce Graph-of-Constraints Model Predictive Control (GoC-MPC), a generalized sequence-of-constraints framework integrated with MPC. By defining constraints over tracked 3D keypoints, our method robustly solves diverse multi-agent manipulation tasks-coordinating agents and adapting online from visual observations alone, without relying on training data or environment models.
技術方法: 本文提出的方法:To overcome these limitations, we introduce Graph-of-Constraints Model Predictive Control (GoC-MPC), a generalized sequence-of-constraints framework integrated with MPC. By defining constraints over t
Key Takeaway: Experiments demonstrate that GoC-MPC achieves higher success rates, significantly faster TAMP computation, and shorter overall paths compared to recent baselines, establishing it as an efficient and robust solution for multi-agent manipulation under real-world disturbances.
核心發現: 核心結果:Experiments demonstrate that GoC-MPC achieves higher success rates, significantly faster TAMP computation, and shorter overall paths compared to recent baselines, establishing it as an efficient and r
RE-SAC: Disentangling aleatoric and epistemic risks in bus fleet control: A stable and robust ensemble DRL approach
Authors: Yifan Zhang, Liang Zheng | Submitted: 2026-03-19 | arXiv: 2603.18396
Categories: cs.LG, cs.RO
Research Background: Bus holding control is challenging due to stochastic traffic and passenger demand. While deep reinforcement learning (DRL) shows promise, standard actor-critic algorithms suffer from Q-value instability in volatile environments.
研究背景: 在機器人學習領域,Bus holding control is challenging due to stochastic traffic and passenger demand. While deep reinforcement learning (DRL) shows promise, standard actor-critic algorithms suffer fr
Technical Approach: We propose a robust ensemble soft actor-critic (RE-SAC) framework to explicitly disentangle these uncertainties.
技術方法: 本文提出的方法:We propose a robust ensemble soft actor-critic (RE-SAC) framework to explicitly disentangle these uncertainties.
Key Takeaway: Experiments in a realistic bidirectional bus corridor simulation demonstrate that RE-SAC achieves the highest cumulative reward (approx. -0.4e6) compared to vanilla SAC (-0.55e6).
核心發現: 核心結果:Experiments in a realistic bidirectional bus corridor simulation demonstrate that RE-SAC achieves the highest cumulative reward (approx. -0.4e6) compared to vanilla SAC (-0.55e6).
High-Speed, All-Terrain Autonomy: Ensuring Safety at the Limits of Mobility
Authors: James R. Baxter, Bogdan I. Epureanu, Paramsothy Jayakumar et al. | Submitted: 2026-03-20 | arXiv: 2603.20525
Categories: cs.RO, eess.SY
Research Background: A novel local trajectory planner, capable of controlling an autonomous off-road vehicle on rugged terrain at high-speed is presented. Autonomous vehicles are currently unable to safely operate off-road at high-speed, as current approaches either fail to predict and mitigate rollovers induced by rough terrain or are not real-time feasible.
研究背景: 在機器人學習領域,A novel local trajectory planner, capable of controlling an autonomous off-road vehicle on rugged terrain at high-speed is presented. Autonomous vehicles are currently unable to sa
Technical Approach: Autonomous vehicles are currently unable to safely operate off-road at high-speed, as current approaches either fail to predict and mitigate rollovers induced by rough terrain or are not real-time feasible. To address this challenge, a novel model predictive control (MPC) formulation is developed for local trajectory planning. A new dynamics model for off-road vehicles on rough, non-planar terrain is derived and used for prediction.
技術方法: 本文提出的方法:Autonomous vehicles are currently unable to safely operate off-road at high-speed, as current approaches either fail to predict and mitigate rollovers induced by rough terrain or are not real-time fea
Key Takeaway: The results demonstrate fewer rollovers and more successes compared to a state-of-the-art baseline across several challenging scenarios that push the vehicle to its mobility limits.
核心發現: 核心結果:The results demonstrate fewer rollovers and more successes compared to a state-of-the-art baseline across several challenging scenarios that push the vehicle to its mobility limits.
TRGS-SLAM: IMU-Aided Gaussian Splatting SLAM for Blurry, Rolling Shutter, and Noisy Thermal Images
Authors: Spencer Carmichael, Katherine A. Skinner | Submitted: 2026-03-20 | arXiv: 2603.20443
Categories: cs.RO
Research Background: Thermal cameras offer several advantages for simultaneous localization and mapping (SLAM) with mobile robots: they provide a passive, low-power solution to operating in darkness, are invariant to rapidly changing or high dynamic range illumination, and can see through fog, dust, and smoke. However, uncooled microbolometer thermal cameras, the only practical option in most robotics applications, suffer from significant motion blur, rolling shutter distortions, and fixed pattern noise.
研究背景: 在機器人學習領域,Thermal cameras offer several advantages for simultaneous localization and mapping (SLAM) with mobile robots: they provide a passive, low-power solution to operating in darkness, a
Technical Approach: In this paper, we present TRGS-SLAM, a 3D Gaussian Splatting (3DGS) based thermal inertial SLAM system uniquely capable of handling these degradations. To overcome the challenges of thermal data, we introduce a model-aware 3DGS rendering method and several general innovations to 3DGS SLAM, including B-spline trajectory optimization with a two-stage IMU loss, view-diversity-based opacity resetting, and pose drift correction schemes. Our system demonstrates accurate tracking on real-world, fast motion, and high-noise thermal data that causes all other tested SLAM methods to fail.
技術方法: 本文提出的方法:In this paper, we present TRGS-SLAM, a 3D Gaussian Splatting (3DGS) based thermal inertial SLAM system uniquely capable of handling these degradations. To overcome the challenges of thermal data, we i
Key Takeaway: Moreover, through offline refinement of our SLAM results, we demonstrate thermal image restoration competitive with prior work that required ground truth poses.
核心發現: 核心結果:Moreover, through offline refinement of our SLAM results, we demonstrate thermal image restoration competitive with prior work that required ground truth poses.
Learning Sampled-data Control for Swarms via MeanFlow
Authors: Anqi Dong, Yongxin Chen, Karl H. Johansson et al. | Submitted: 2026-03-20 | arXiv: 2603.20189
Categories: cs.LG, cs.MA, cs.RO, eess.SY
Research Background: Steering large-scale swarms with only limited control updates is often needed due to communication or computational constraints, yet most learning-based approaches do not account for this and instead model instantaneous velocity fields. As a result, the natural object for decision making is a finite-window control quantity rather than an infinitesimal one.
研究背景: 在機器人學習領域,Steering large-scale swarms with only limited control updates is often needed due to communication or computational constraints, yet most learning-based approaches do not account f
Technical Approach: To this end, we learn the finite-horizon coefficient that parameterizes the minimum-energy control applied over each interval, and derive a differential identity that connects this quantity to a local bridge-induced supervision signal.
技術方法: 本文提出的方法:To this end, we learn the finite-horizon coefficient that parameterizes the minimum-energy control applied over each interval, and derive a differential identity that connects this quantity to a local
Key Takeaway: This results in a new sampled-data learning framework that operates directly in control space and that can be applied for swarm steering.
核心發現: 核心結果:This results in a new sampled-data learning framework that operates directly in control space and that can be applied for swarm steering.
IndoorR2X: Indoor Robot-to-Everything Coordination with LLM-Driven Planning
Authors: Fan Yang, Soumya Teotia, Shaunak A. Mehta et al. | Submitted: 2026-03-20 | arXiv: 2603.20182
Categories: cs.RO, cs.MA
Research Background: Although robot-to-robot (R2R) communication improves indoor scene understanding beyond what a single robot can achieve, R2R alone cannot overcome partial observability without substantial exploration overhead or scaling team size. In contrast, many indoor environments already include low-cost Internet of Things (IoT) sensors (e.g., cameras) that provide persistent, building-wide context beyond onboard perception.
研究背景: 在機器人學習領域,Although robot-to-robot (R2R) communication improves indoor scene understanding beyond what a single robot can achieve, R2R alone cannot overcome partial observability without subs
Technical Approach: In contrast, many indoor environments already include low-cost Internet of Things (IoT) sensors (e.g., cameras) that provide persistent, building-wide context beyond onboard perception. We therefore introduce IndoorR2X, the first benchmark and simulation framework for Large Language Model (LLM)-driven multi-robot task planning with Robot-to-Everything (R2X) perception and communication in indoor environments. IndoorR2X integrates observations from mobile robots and static IoT devices to construct a global semantic state that supports scalable scene understanding, reduces redundant exploration, and enables high-level coordination through LLM-based planning.
技術方法: 本文提出的方法:In contrast, many indoor environments already include low-cost Internet of Things (IoT) sensors (e.g., cameras) that provide persistent, building-wide context beyond onboard perception. We therefore i
Key Takeaway: Extensive experiments across diverse settings demonstrate that IoT-augmented world modeling improves multi-robot efficiency and reliability, and we highlight key insights and failure modes for advancing LLM-based collaboration between robot teams and indoor IoT sensors.
核心發現: 核心結果:Extensive experiments across diverse settings demonstrate that IoT-augmented world modeling improves multi-robot efficiency and reliability, and we highlight key insights and failure modes for advanci
HortiMulti: A Multi-Sensor Dataset for Localisation and Mapping in Horticultural Polytunnels
Authors: Shuoyuan Xu, Zhipeng Zhong, Tiago Barros et al. | Submitted: 2026-03-20 | arXiv: 2603.20150
Categories: cs.RO
Research Background: Agricultural robotics is gaining increasing relevance in both research and real-world deployment. As these systems are expected to operate autonomously in more complex tasks, the availability of representative real-world datasets becomes essential.
研究背景: 在機器人學習領域,Agricultural robotics is gaining increasing relevance in both research and real-world deployment. As these systems are expected to operate autonomously in more complex tasks, the a
Technical Approach: To address this gap, we present HortiMulti, a multimodal, cross-season dataset collected in commercial strawberry and raspberry polytunnels across an entire growing season, capturing substantial appearance variation, dynamic foliage, specular reflections from plastic covers, severe perceptual aliasing, and GNSS-unreliable conditions, all of which directly degrade existing localisation and perception algorithms.
技術方法: 本文提出的方法:To address this gap, we present HortiMulti, a multimodal, cross-season dataset collected in commercial strawberry and raspberry polytunnels across an entire growing season, capturing substantial appea
Key Takeaway: We release time-synchronised raw measurements, calibration files, reference trajectories, and baseline benchmarks for visual, LiDAR, and multi-sensor SLAM, with results confirming that current state-of-the-art methods remain inadequate for reliable polytunnel deployment, establishing HortiMulti as a one-stop resource for developing and testing robotic perception systems in horticulture environments.
核心發現: 核心結果:We release time-synchronised raw measurements, calibration files, reference trajectories, and baseline benchmarks for visual, LiDAR, and multi-sensor SLAM, with results confirming that current state-o
Rusty Flying Robots: Learning a Full Robotics Stack with Real-Time Operation on an STM32 Microcontroller in a 9 ECTS MS Course
Authors: Wolfgang Hoenig, Christoph Scherer, Khaled Wahba | Submitted: 2026-03-20 | arXiv: 2604.00032
Categories: physics.ed-ph, cs.CY, cs.RO
Research Background: We describe a novel masters-level projects class that teaches robotics along the traditional robotics pipeline (dynamics, state estimation, controls, planning). One key motivational part is that students have to directly apply the algorithms they learn on a highly constrained compute platform, effectively making a robot fly.
研究背景: 在機器人學習領域,We describe a novel masters-level projects class that teaches robotics along the traditional robotics pipeline (dynamics, state estimation, controls, planning). One key motivationa
Technical Approach: We discuss our methodology and the student feedback over two years with ten students each.
技術方法: 本文提出的方法:We discuss our methodology and the student feedback over two years with ten students each.
Key Takeaway: We teach nonlinear algorithms as deployed in state-of-the-art flight stacks such as PX4.
核心發現: 核心結果:We teach nonlinear algorithms as deployed in state-of-the-art flight stacks such as PX4.
Uncertainty Matters: Structured Probabilistic Online Mapping for Motion Prediction in Autonomous Driving
Authors: Pritom Gogoi, Faris Janjoš, Bin Yang et al. | Submitted: 2026-03-20 | arXiv: 2603.20076
Categories: cs.RO
Research Background: Online map generation and trajectory prediction are critical components of the autonomous driving perception-prediction-planning pipeline. While modern vectorized mapping models achieve high geometric accuracy, they typically treat map estimation as a deterministic task, discarding structural uncertainty.
研究背景: 在機器人學習領域,Online map generation and trajectory prediction are critical components of the autonomous driving perception-prediction-planning pipeline. While modern vectorized mapping models ac
Technical Approach: To address this, we propose a structured probabilistic formulation for online map generation. Our method explicitly models intra-element dependencies by predicting a dense covariance matrix, parameterized via a Low-Rank plus Diagonal (LRPD) covariance decomposition. Furthermore, our approach establishes new state-of-the-art performance for map-based motion prediction, highlighting the critical role of uncertainty in planning tasks.
技術方法: 本文提出的方法:To address this, we propose a structured probabilistic formulation for online map generation. Our method explicitly models intra-element dependencies by predicting a dense covariance matrix, parameter
Key Takeaway: Furthermore, our approach establishes new state-of-the-art performance for map-based motion prediction, highlighting the critical role of uncertainty in planning tasks.
核心發現: 核心結果:Furthermore, our approach establishes new state-of-the-art performance for map-based motion prediction, highlighting the critical role of uncertainty in planning tasks.
GustPilot: A Hierarchical DRL-INDI Framework for Wind-Resilient Quadrotor Navigation
Authors: Amir Atef Habel, Roohan Ahmed Khan, Fawad Mehboob et al. | Submitted: 2026-03-20 | arXiv: 2603.19966
Categories: cs.RO
Research Background: Wind disturbances remain a key barrier to reliable autonomous navigation for lightweight quadrotors, where the rapidly varying airflow can destabilize both planning and tracking. This paper introduces GustPilot, a hierarchical wind-resilient navigation stack in which a deep reinforcement learning (DRL) policy generates inertial-frame velocity reference for gate traversal.
研究背景: 在機器人學習領域,Wind disturbances remain a key barrier to reliable autonomous navigation for lightweight quadrotors, where the rapidly varying airflow can destabilize both planning and tracking. T
Technical Approach: This paper introduces GustPilot, a hierarchical wind-resilient navigation stack in which a deep reinforcement learning (DRL) policy generates inertial-frame velocity reference for gate traversal.
技術方法: 本文提出的方法:This paper introduces GustPilot, a hierarchical wind-resilient navigation stack in which a deep reinforcement learning (DRL) policy generates inertial-frame velocity reference for gate traversal.
Key Takeaway: These results demonstrate that combining DRL-based velocity planning with structured INDI disturbance rejection provides a practical and generalizable approach to wind-resilient autonomous flight navigation.
核心發現: 核心結果:These results demonstrate that combining DRL-based velocity planning with structured INDI disturbance rejection provides a practical and generalizable approach to wind-resilient autonomous flight navi
LIORNet: Self-Supervised LiDAR Snow Removal Framework for Autonomous Driving under Adverse Weather Conditions
Authors: Ji-il Park, Inwook Shim | Submitted: 2026-03-20 | arXiv: 2603.19936
Categories: cs.CV, cs.RO
Research Background: LiDAR sensors provide high-resolution 3D perception and long-range detection, making them indispensable for autonomous driving and robotics. However, their performance significantly degrades under adverse weather conditions such as snow, rain, and fog, where spurious noise points dominate the point cloud and lead to false perception.
研究背景: 在機器人學習領域,LiDAR sensors provide high-resolution 3D perception and long-range detection, making them indispensable for autonomous driving and robotics. However, their performance significantl
Technical Approach: In this study, we propose LIORNet, which eliminates these drawbacks and integrates the strengths of all three paradigms.
技術方法: 本文提出的方法:In this study, we propose LIORNet, which eliminates these drawbacks and integrates the strengths of all three paradigms.
Key Takeaway: These results highlight LIORNet as a practical and robust solution for LiDAR perception in extreme weather, with strong potential for real-time deployment in autonomous driving systems.
核心發現: 核心結果:These results highlight LIORNet as a practical and robust solution for LiDAR perception in extreme weather, with strong potential for real-time deployment in autonomous driving systems.
Multi-Agent Motion Planning on Industrial Magnetic Levitation Platforms: A Hybrid ADMM-HOCBF approach
Authors: Bavo Tistaert, Stan Servaes, Alejandro Gonzalez-Garcia et al. | Submitted: 2026-03-20 | arXiv: 2603.19838
Categories: cs.RO
Research Background: This paper presents a novel hybrid motion planning method for holonomic multi-agent systems. The proposed decentralised model predictive control (MPC) framework tackles the intractability of classical centralised MPC for a growing number of agents while providing safety guarantees.
研究背景: 在機器人學習領域,This paper presents a novel hybrid motion planning method for holonomic multi-agent systems. The proposed decentralised model predictive control (MPC) framework tackles the intract
Technical Approach: This paper presents a novel hybrid motion planning method for holonomic multi-agent systems.
技術方法: 本文提出的方法:This paper presents a novel hybrid motion planning method for holonomic multi-agent systems.
Key Takeaway: Simulation results show significant improvement in scalability over classical centralised MPC.
核心發現: 核心結果:Simulation results show significant improvement in scalability over classical centralised MPC.
Mixed-Integer vs. Continuous Model Predictive Control for Binary Thrusters: A Comparative Study
Authors: Franek Stark, Jakob Middelberg, Shubham Vyas | Submitted: 2026-03-20 | arXiv: 2603.19796
Categories: eess.SY, cs.RO
Research Background: Binary on/off thrusters are commonly used for spacecraft attitude and position control during proximity operations. However, their discrete nature poses challenges for conventional continuous control methods.
研究背景: 在機器人學習領域,Binary on/off thrusters are commonly used for spacecraft attitude and position control during proximity operations. However, their discrete nature poses challenges for conventional
Technical Approach: This paper provides the first systematic comparison between these two paradigms for binary thruster control, contrasting continuous Model Predictive Control (MPC) with Delta-Sigma modulation against direct Mixed-Integer MPC (MIMPC) approaches. Furthermore, we propose a new variant of MPC for binary actuated systems, which is informed using the state of the Delta-Sigma Modulator.
技術方法: 本文提出的方法:This paper provides the first systematic comparison between these two paradigms for binary thruster control, contrasting continuous Model Predictive Control (MPC) with Delta-Sigma modulation against d
Key Takeaway: It can be seen from the simulated and real-system experiments that MIMPC offers complete stability and fuel efficiency benefits, particularly for resource-constrained missions, while continuous control methods remain attractive for computationally limited applications.
核心發現: 核心結果:It can be seen from the simulated and real-system experiments that MIMPC offers complete stability and fuel efficiency benefits, particularly for resource-constrained missions, while continuous contro
Generalized Task-Driven Design of Soft Robots via Reduced-Order FEM-based Surrogate Modeling
Authors: Yao Yao, David Howard, Perla Maiolino | Submitted: 2026-03-20 | arXiv: 2603.19794
Categories: cs.RO
Research Background: Task-driven design of soft robots requires models that are physically accurate and computationally efficient, while remaining transferable across actuator designs and task scenarios. However, existing modeling approaches typically face a fundamental trade-off between physical fidelity and computational efficiency, which limits model reuse across design and task variations and constrains scalable task-driven optimization.
研究背景: 在機器人學習領域,Task-driven design of soft robots requires models that are physically accurate and computationally efficient, while remaining transferable across actuator designs and task scenario
Technical Approach: This paper presents a unified reduced-order finite element method (FEM)-based surrogate modeling pipeline for generalized task-driven soft robot design.
技術方法: 本文提出的方法:This paper presents a unified reduced-order finite element method (FEM)-based surrogate modeling pipeline for generalized task-driven soft robot design.
Key Takeaway: The results demonstrate high accuracy, efficiency, and reliable reuse, providing a scalable foundation for autonomous task-driven soft robot design.
核心發現: 核心結果:The results demonstrate high accuracy, efficiency, and reliable reuse, providing a scalable foundation for autonomous task-driven soft robot design.
DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving
Authors: Xiaolu Liu, Yicong Li, Song Wang et al. | Submitted: 2026-03-20 | arXiv: 2603.19675
Categories: cs.CV, cs.RO
Research Background: Recently, world models have been incorporated into the autonomous driving systems to improve the planning reliability. Existing approaches typically predict future states through appearance generation or deterministic regression, which limits their ability to capture trajectory-conditioned scene evolution and leads to unreliable action planning.
研究背景: 在機器人學習領域,Recently, world models have been incorporated into the autonomous driving systems to improve the planning reliability. Existing approaches typically predict future states through a
Technical Approach: To address this, we propose DynFlowDrive, a latent world model that leverages flow-based dynamics to model the transition of world states under different driving actions.
技術方法: 本文提出的方法:To address this, we propose DynFlowDrive, a latent world model that leverages flow-based dynamics to model the transition of world states under different driving actions.
Key Takeaway: Extensive experiments on the nuScenes and NavSim benchmarks demonstrate consistent improvements across diverse driving frameworks without introducing additional inference overhead.
核心發現: 核心結果:Extensive experiments on the nuScenes and NavSim benchmarks demonstrate consistent improvements across diverse driving frameworks without introducing additional inference overhead.
Accurate Open-Loop Control of a Soft Continuum Robot Through Visually Learned Latent Representations
Authors: Henrik Krauss, Johann Licher, Naoya Takeishi et al. | Submitted: 2026-03-20 | arXiv: 2603.19655
Categories: cs.RO, eess.SY
Research Background: This work addresses open-loop control of a soft continuum robot (SCR) from video-learned latent dynamics. Visual Oscillator Networks (VONs) from previous work are used, that provide mechanistically interpretable 2D oscillator latents through an attention broadcast decoder (ABCD).
研究背景: 在機器人學習領域,This work addresses open-loop control of a soft continuum robot (SCR) from video-learned latent dynamics. Visual Oscillator Networks (VONs) from previous work are used, that provid
Technical Approach: Visual Oscillator Networks (VONs) from previous work are used, that provide mechanistically interpretable 2D oscillator latents through an attention broadcast decoder (ABCD). Open-loop, single-shooting optimal control is performed in latent space to track image-specified waypoints without camera feedback. An interactive SCR live simulator enables design of static, dynamic, and extrapolated targets and maps them to model-specific latent waypoints.
技術方法: 本文提出的方法:Visual Oscillator Networks (VONs) from previous work are used, that provide mechanistically interpretable 2D oscillator latents through an attention broadcast decoder (ABCD). Open-loop, single-shootin
Key Takeaway: Using an ablation study, we demonstrate that several architecture choices and training settings contribute to the open-loop control performance.
核心發現: 核心結果:Using an ablation study, we demonstrate that several architecture choices and training settings contribute to the open-loop control performance.
CeRLP: A Cross-embodiment Robot Local Planning Framework for Visual Navigation
Authors: Haoyu Xi, Mingao Tan, Xinming Zhang et al. | Submitted: 2026-03-20 | arXiv: 2603.19602
Categories: cs.RO
Research Background: Visual navigation for cross-embodiment robots is challenging due to variations in robot and camera configurations, which can lead to the failure of navigation tasks. Previous approaches typically rely on collecting massive datasets across different robots, which is highly data-intensive, or fine-tuning models, which is time-consuming.
研究背景: 在機器人學習領域,Visual navigation for cross-embodiment robots is challenging due to variations in robot and camera configurations, which can lead to the failure of navigation tasks. Previous appro
Technical Approach: In this paper, we propose a Cross-embodiment Robot Local Planning (CeRLP) framework for general visual navigation, which abstracts visual information into a unified geometric formulation and applies to heterogeneous robots with varying physical dimensions, camera parameters, and camera types.
技術方法: 本文提出的方法:In this paper, we propose a Cross-embodiment Robot Local Planning (CeRLP) framework for general visual navigation, which abstracts visual information into a unified geometric formulation and applies t
Key Takeaway: Additionally, extensive real-world experiments verify the effectiveness of CeRLP in tasks such as point-to-point navigation and vision-language navigation, demonstrating its generalization across varying robot and camera configurations.
核心發現: 核心結果:Additionally, extensive real-world experiments verify the effectiveness of CeRLP in tasks such as point-to-point navigation and vision-language navigation, demonstrating its generalization across vary
Pedestrian Crossing Intent Prediction via Psychological Features and Transformer Fusion
Authors: Sima Ashayer, Hoang H. Nguyen, Yu Liang et al. | Submitted: 2026-03-20 | arXiv: 2603.19533
Categories: cs.CV, cs.RO
Research Background: Pedestrian intention prediction needs to be accurate for autonomous vehicles to navigate safely in urban environments. We present a lightweight, socially informed architecture for pedestrian intention prediction.
研究背景: 在機器人學習領域,Pedestrian intention prediction needs to be accurate for autonomous vehicles to navigate safely in urban environments. We present a lightweight, socially informed architecture for
Technical Approach: We present a lightweight, socially informed architecture for pedestrian intention prediction.
技術方法: 本文提出的方法:We present a lightweight, socially informed architecture for pedestrian intention prediction.
Key Takeaway: On the more diverse PSI 2.0 dataset, where, to the best of our knowledge, no prior results exist, we establish a strong initial baseline of 0.78 F1 and 0.79 AUC-ROC.
核心發現: 核心結果:On the more diverse PSI 2.0 dataset, where, to the best of our knowledge, no prior results exist, we establish a strong initial baseline of 0.78 F1 and 0.79 AUC-ROC.
2K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Prediction
Authors: Tianbao Zhang, Zhenyu Liang, Zhenbo Song et al. | Submitted: 2026-03-20 | arXiv: 2603.19964
Categories: cs.CV
Research Background: High-resolution geometric prediction is essential for robust perception in autonomous driving, robotics, and AR/MR, but current foundation models are fundamentally limited by their scalability to real-world, high-resolution scenarios. Direct inference on 2K images with these models incurs prohibitive computational and memory demands, making practical deployment challenging.
研究背景: 在機器人學習領域,High-resolution geometric prediction is essential for robust perception in autonomous driving, robotics, and AR/MR, but current foundation models are fundamentally limited by their
Technical Approach: To tackle the issue, we present 2K Retrofit, a novel framework that enables efficient 2K-resolution inference for any geometric foundation model, without modifying or retraining the backbone. Our approach leverages fast coarse predictions and an entropy-based sparse refinement to selectively enhance high-uncertainty regions, achieving precise and high-fidelity 2K outputs with minimal overhead.
技術方法: 本文提出的方法:To tackle the issue, we present 2K Retrofit, a novel framework that enables efficient 2K-resolution inference for any geometric foundation model, without modifying or retraining the backbone. Our appr
Key Takeaway: Extensive experiments on widely used benchmark demonstrate that 2K Retrofit consistently achieves state-of-the-art accuracy and speed, bridging the gap between research advances and scalable deployment in high-resolution 3D vision applications.
核心發現: 核心結果:Extensive experiments on widely used benchmark demonstrate that 2K Retrofit consistently achieves state-of-the-art accuracy and speed, bridging the gap between research advances and scalable deploymen
Implementing Robust M-Estimators with Certifiable Factor Graph Optimization
Authors: Zhexin Xu, Hanna Jiamei Zhang, Helena Calatrava et al. | Submitted: 2026-03-21 | arXiv: 2603.20932
Categories: cs.RO
Research Background: Parameter estimation in robotics and computer vision faces formidable challenges from both outlier contamination and nonconvex optimization landscapes. While M-estimation addresses the problem of outliers through robust loss functions, it creates severely nonconvex problems that are difficult to solve globally.
研究背景: 在機器人學習領域,Parameter estimation in robotics and computer vision faces formidable challenges from both outlier contamination and nonconvex optimization landscapes. While M-estimation addresses
Technical Approach: In this paper, we show how one can easily implement adaptively reweighted M-estimators with certifiably correct solvers for the inner WLS subproblems using only fast local optimization over smooth manifolds. Our approach exploits recent work on certifiable factor graph optimization to provide global optimality certificates for the inner WLS subproblems while seamlessly integrating into existing factor graph-based software libraries and workflows.
技術方法: 本文提出的方法:In this paper, we show how one can easily implement adaptively reweighted M-estimators with certifiably correct solvers for the inner WLS subproblems using only fast local optimization over smooth man
Key Takeaway: Experimental evaluation on pose-graph optimization and landmark SLAM tasks demonstrates that our adaptively reweighted certifiable estimation approach provides higher-quality estimates than alternative local search-based methods, while scaling tractably to realistic problem sizes.
核心發現: 核心結果:Experimental evaluation on pose-graph optimization and landmark SLAM tasks demonstrates that our adaptively reweighted certifiable estimation approach provides higher-quality estimates than alternativ
Swim2Real: VLM-Guided System Identification for Sim-to-Real Transfer
Authors: Kevin Qiu, Kyle Walker, Mike Y. Michelis et al. | Submitted: 2026-03-21 | arXiv: 2603.20827
Categories: cs.RO
Research Background: We present Swim2Real, a pipeline that calibrates a 16-parameter robotic fish simulator from swimming videos using vision-language model (VLM) feedback, requiring no hand-designed search stages. Calibrating soft aquatic robots is particularly challenging because nonlinear fluid-structure coupling makes the parameter landscape chaotic, simplified fluid models introduce a persistent sim-to-real gap, and controlled aquatic experiments are difficult to reproduce.
研究背景: 在機器人學習領域,We present Swim2Real, a pipeline that calibrates a 16-parameter robotic fish simulator from swimming videos using vision-language model (VLM) feedback, requiring no hand-designed s
Technical Approach: We present Swim2Real, a pipeline that calibrates a 16-parameter robotic fish simulator from swimming videos using vision-language model (VLM) feedback, requiring no hand-designed search stages.
技術方法: 本文提出的方法:We present Swim2Real, a pipeline that calibrates a 16-parameter robotic fish simulator from swimming videos using vision-language model (VLM) feedback, requiring no hand-designed search stages.
Key Takeaway: These results demonstrate that VLM-guided calibration can close the sim-to-real gap for aquatic robots directly from video, enabling zero-shot RL transfer to physical swimmers without manual system identification, a step toward automated, general-purpose simulator tuning for underwater robotics.
核心發現: 核心結果:These results demonstrate that VLM-guided calibration can close the sim-to-real gap for aquatic robots directly from video, enabling zero-shot RL transfer to physical swimmers without manual system id
ToFormer: Towards Large-scale Scenario Depth Completion for Lightweight ToF Camera
Authors: Juncheng Chen, Tiancheng Lai, Xingpeng Wang et al. | Submitted: 2026-03-21 | arXiv: 2603.20669
Categories: cs.RO, cs.CV
Research Background: Time-of-Flight (ToF) cameras possess compact design and high measurement precision to be applied to various robot tasks. However, their limited sensing range restricts deployment in large-scale scenarios.
研究背景: 在機器人學習領域,Time-of-Flight (ToF) cameras possess compact design and high measurement precision to be applied to various robot tasks. However, their limited sensing range restricts deployment i
Technical Approach: In this paper, we propose a full-stack framework that enables depth completion in large-scale scenarios for short-range ToF cameras. Second, we propose a sensor-aware depth completion network that incorporates a novel 3D branch with a 3D-2D Joint Propagation Pooling (JPP) module and Multimodal Cross-Covariance Attention (MXCA), enabling effective modeling of long-range relationships and efficient 3D-2D fusion under non-uniform ToF depth sparsity. Experiments show that our method achieves an 8.6% lower mean absolute error than the second-best method, while maintaining lightweight design to support onboard deployment.
技術方法: 本文提出的方法:In this paper, we propose a full-stack framework that enables depth completion in large-scale scenarios for short-range ToF cameras. Second, we propose a sensor-aware depth completion network that inc
Key Takeaway: Experiments show that our method achieves an 8.6% lower mean absolute error than the second-best method, while maintaining lightweight design to support onboard deployment.
核心發現: 核心結果:Experiments show that our method achieves an 8.6% lower mean absolute error than the second-best method, while maintaining lightweight design to support onboard deployment.
Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation
Authors: Zhichao Wu, Junyin Ye, Zhilong Zhang et al. | Submitted: 2026-03-21 | arXiv: 2603.20658
Categories: cs.RO
Research Background: While current embodied policies exhibit remarkable manipulation skills, their execution remains unsatisfactorily slow as they inherit the tardy pacing of human demonstrations. Existing acceleration methods typically require policy retraining or costly online interactions, limiting their scalability for large-scale foundation models.
研究背景: 在機器人學習領域,While current embodied policies exhibit remarkable manipulation skills, their execution remains unsatisfactorily slow as they inherit the tardy pacing of human demonstrations. Exis
Technical Approach: In this paper, we propose Speedup Patch (SuP), a lightweight, policy-agnostic framework that enables plug-and-play acceleration using solely offline data.
技術方法: 本文提出的方法:In this paper, we propose Speedup Patch (SuP), a lightweight, policy-agnostic framework that enables plug-and-play acceleration using solely offline data.
Key Takeaway: Empirical results on simulation benchmarks (Libero, Bigym) and real-world tasks validate that SuP achieves an overall 1.8x execution speedup for diverse policies while maintaining their original success rates.
核心發現: 核心結果:Empirical results on simulation benchmarks (Libero, Bigym) and real-world tasks validate that SuP achieves an overall 1.8x execution speedup for diverse policies while maintaining their original succe
GHOST: Ground-projected Hypotheses from Observed Structure-from-Motion Trajectories
Authors: Tomasz Frelek, Rohan Patil, Akshar Tumu et al. | Submitted: 2026-03-21 | arXiv: 2603.20583
Categories: cs.RO, cs.CV
Research Background: We present a scalable self-supervised approach for segmenting feasible vehicle trajectories from monocular images for autonomous driving in complex urban environments. Leveraging large-scale dashcam videos, we treat recorded ego-vehicle motion as implicit supervision and recover camera trajectories via monocular structure-from-motion, projecting them onto the ground plane to generate spatial masks of traversed regions without manual annotation.
研究背景: 在機器人學習領域,We present a scalable self-supervised approach for segmenting feasible vehicle trajectories from monocular images for autonomous driving in complex urban environments. Leveraging l
Technical Approach: We present a scalable self-supervised approach for segmenting feasible vehicle trajectories from monocular images for autonomous driving in complex urban environments. We evaluate our approach on NuScenes, demonstrating reliable trajectory prediction, and further show transfer to an electric scooter platform through light fine-tuning.
技術方法: 本文提出的方法:We present a scalable self-supervised approach for segmenting feasible vehicle trajectories from monocular images for autonomous driving in complex urban environments. We evaluate our approach on NuSc
Key Takeaway: Our results indicate that large-scale ego-motion distillation yields structured and generalizable path proposals beyond the demonstrated trajectory, enabling trajectory hypothesis estimation via image segmentation.
核心發現: 核心結果:Our results indicate that large-scale ego-motion distillation yields structured and generalizable path proposals beyond the demonstrated trajectory, enabling trajectory hypothesis estimation via image
Unified Orbit-Attitude Estimation and Sensor Tasking Framework for Autonomous Cislunar Space Domain Awareness Using Multiplicative Unscented Kalman Filter
Authors: Smriti Nandan Paul, Siwei Fan | Submitted: 2026-03-21 | arXiv: 2603.20579
Categories: cs.RO, physics.space-ph
Research Background: The cislunar regime departs from near-Earth orbital behavior through strongly non-linear, non-Keplerian dynamics, which adversely affect the accuracy of uncertainty propagation and state estimation. Additional challenges arise from long-range observation requirements, restrictive sensor-target geometry and illumination conditions, the need to monitor an expansive cislunar volume, and the large design space associated with space/ground-based sensor placement.
研究背景: 在機器人學習領域,The cislunar regime departs from near-Earth orbital behavior through strongly non-linear, non-Keplerian dynamics, which adversely affect the accuracy of uncertainty propagation and
Technical Approach: Numerical simulations demonstrate that our approach in Task 1 yields observer architectures that achieve significantly lower values of the proposed cost function than baseline random-search solutions, while using fewer sensors.
技術方法: 本文提出的方法:Numerical simulations demonstrate that our approach in Task 1 yields observer architectures that achieve significantly lower values of the proposed cost function than baseline random-search solutions,
Key Takeaway: These results highlight important trade-offs between sensing resources, tasking cadence, and achievable state estimation performance that influence the scalability of autonomous cislunar SDA.
核心發現: 核心結果:These results highlight important trade-offs between sensing resources, tasking cadence, and achievable state estimation performance that influence the scalability of autonomous cislunar SDA.
LASER: Level-Based Asynchronous Scheduling and Execution Regime for Spatiotemporally Constrained Multi-Robot Timber Manufacturing
Authors: Zhenxiang Huang, Lior Skoury, Tim Stark et al. | Submitted: 2026-03-21 | arXiv: 2603.20577
Categories: cs.RO, cs.MA
Research Background: Automating large-scale manufacturing in domains like timber construction requires multi-robot systems to manage tightly coupled spatiotemporal constraints, such as collision avoidance and process-driven deadlines. This paper introduces LASER (Level-based Asynchronous Scheduling and Execution Regime), a complete framework for scheduling and executing complex assembly tasks, demonstrated on a screw-press gluing application for timber slab manufacturing.
研究背景: 在機器人學習領域,Automating large-scale manufacturing in domains like timber construction requires multi-robot systems to manage tightly coupled spatiotemporal constraints, such as collision avoida
Technical Approach: This paper introduces LASER (Level-based Asynchronous Scheduling and Execution Regime), a complete framework for scheduling and executing complex assembly tasks, demonstrated on a screw-press gluing application for timber slab manufacturing. To solve this formulation for large problems, we propose two specialized algorithms: an iterative temporal-relaxation approach for heterogeneous task sequences and a bi-level decomposition for homogeneous tasks that balances workload. Computational studies show our method scales steadily with size compared to a monolithic approach.
技術方法: 本文提出的方法:This paper introduces LASER (Level-based Asynchronous Scheduling and Execution Regime), a complete framework for scheduling and executing complex assembly tasks, demonstrated on a screw-press gluing a
Key Takeaway: This paper introduces LASER (Level-based Asynchronous Scheduling and Execution Regime), a complete framework for scheduling and executing complex assembly tasks, demonstrated on a screw-press gluing application for timber slab manufacturing.
核心發現: 核心結果:This paper introduces LASER (Level-based Asynchronous Scheduling and Execution Regime), a complete framework for scheduling and executing complex assembly tasks, demonstrated on a screw-press gluing a
Current state of the multi-agent multi-view experimental and digital twin rendezvous (MMEDR-Autonomous) framework
Authors: Logan Banker, Michael Wozniak, Mohanad Alameer et al. | Submitted: 2026-03-21 | arXiv: 2603.20575
Categories: cs.RO, physics.space-ph
Research Background: As near-Earth resident space objects proliferate, there is an increasing demand for reliable technologies in applications of on-orbit servicing, debris removal, and orbit modification. Rendezvous and docking are critical mission phases for such applications and can benefit from greater autonomy to reduce operational complexity and human workload.
研究背景: 在機器人學習領域,As near-Earth resident space objects proliferate, there is an increasing demand for reliable technologies in applications of on-orbit servicing, debris removal, and orbit modificat
Technical Approach: Rendezvous and docking are critical mission phases for such applications and can benefit from greater autonomy to reduce operational complexity and human workload. Machine learning-based methods can be integrated within the guidance, navigation, and control (GNC) architecture to design a robust rendezvous and docking framework. In this work, the Multi-Agent Multi-View Experimental and Digital Twin Rendezvous (MMEDR-Autonomous) is introduced as a unified framework comprising a learning-based optical navigation network, a reinforcement learning-based guidance approach under ongoing development, and a hardware-in-the-loop testbed.
技術方法: 本文提出的方法:Rendezvous and docking are critical mission phases for such applications and can benefit from greater autonomy to reduce operational complexity and human workload. Machine learning-based methods can b
Key Takeaway: Prior Control Barrier Function results for Clohessy-Wiltshire dynamics are reviewed as a basis for enforcing safety and operational constraints and for guiding future nonlinear controller design within the MMEDR-Autonomous framework.
核心發現: 核心結果:Prior Control Barrier Function results for Clohessy-Wiltshire dynamics are reviewed as a basis for enforcing safety and operational constraints and for guiding future nonlinear controller design withi
HyReach: Vision-Guided Hybrid Manipulator Reaching in Unseen Cluttered Environments
Authors: Shivani Kamtikar, Kendall Koe, Justin Wasserman et al. | Submitted: 2026-03-22 | arXiv: 2603.21421
Categories: cs.RO, cs.AI
Research Background: As robotic systems increasingly operate in unstructured, cluttered, and previously unseen environments, there is a growing need for manipulators that combine compliance, adaptability, and precise control. This work presents a real-time hybrid rigid-soft continuum manipulator system designed for robust open-world object reaching in such challenging environments.
研究背景: 在機器人學習領域,As robotic systems increasingly operate in unstructured, cluttered, and previously unseen environments, there is a growing need for manipulators that combine compliance, adaptabili
Technical Approach: This work presents a real-time hybrid rigid-soft continuum manipulator system designed for robust open-world object reaching in such challenging environments. The system integrates vision-based perception and 3D scene reconstruction with shape-aware motion planning to generate safe trajectories. A learning-based controller drives the hybrid arm to arbitrary target poses, leveraging the flexibility of the soft segment while maintaining the precision of the rigid segment.
技術方法: 本文提出的方法:This work presents a real-time hybrid rigid-soft continuum manipulator system designed for robust open-world object reaching in such challenging environments. The system integrates vision-based percep
Key Takeaway: Extensive real-world experiments demonstrate consistent reaching performance with errors below 2 cm across diverse cluttered setups, highlighting the potential of hybrid manipulators for adaptive and reliable operation in unstructured environments.
核心發現: 核心結果:Extensive real-world experiments demonstrate consistent reaching performance with errors below 2 cm across diverse cluttered setups, highlighting the potential of hybrid manipulators for adaptive and
Architecture for Multi-Unmanned Aerial Vehicles based Autonomous Precision Agriculture Systems
Authors: Ebasa Temesgen, Nathnael Minyelshowa, Lebsework Negash | Submitted: 2026-03-22 | arXiv: 2603.21183
Categories: cs.RO, cs.LG, cs.MA
Research Background: The use of unmanned aerial vehicles (UAVs) in precision agriculture has seen a huge increase recently. As such, systems that aim to apply various algorithms on the field need a structured framework of abstractions.
研究背景: 在機器人學習領域,The use of unmanned aerial vehicles (UAVs) in precision agriculture has seen a huge increase recently. As such, systems that aim to apply various algorithms on the field need a str
Technical Approach: This paper defines the various tasks of the UAVs in precision agriculture and model them into an architectural framework.
技術方法: 本文提出的方法:This paper defines the various tasks of the UAVs in precision agriculture and model them into an architectural framework.
Key Takeaway: Simulation and field tests shows that the architecture offers a number of advantages that include fault-tolerance, robustness, developer and user-friendliness.
核心發現: 核心結果:Simulation and field tests shows that the architecture offers a number of advantages that include fault-tolerance, robustness, developer and user-friendliness.
Anatomical Prior-Driven Framework for Autonomous Robotic Cardiac Ultrasound Standard View Acquisition
Authors: Zhiyan Cao, Zhengxi Wu, Yiwei Wang et al. | Submitted: 2026-03-22 | arXiv: 2603.21134
Categories: cs.RO, cs.CV
Research Background: Cardiac ultrasound diagnosis is critical for cardiovascular disease assessment, but acquiring standard views remains highly operator-dependent. Existing medical segmentation models often yield anatomically inconsistent results in images with poor textural differentiation between distinct feature classes, while autonomous probe adjustment methods either rely on simplistic heuristic rules or black-box learning.
研究背景: 在機器人學習領域,Cardiac ultrasound diagnosis is critical for cardiovascular disease assessment, but acquiring standard views remains highly operator-dependent. Existing medical segmentation models
Technical Approach: Existing medical segmentation models often yield anatomically inconsistent results in images with poor textural differentiation between distinct feature classes, while autonomous probe adjustment methods either rely on simplistic heuristic rules or black-box learning. To address these issues, our study proposed an anatomical prior (AP)-driven framework integrating cardiac structure segmentation and autonomous probe adjustment for standard view acquisition. A YOLO-based multi-class segmentation model augmented by a spatial-relation graph (SRG) module is designed to embed AP into the feature pyramid.
技術方法: 本文提出的方法:Existing medical segmentation models often yield anatomically inconsistent results in images with poor textural differentiation between distinct feature classes, while autonomous probe adjustment meth
Key Takeaway: The SRG-YOLOv11s improves mAP50 by 11.3% and mIoU by 6.8% on the Special Case dataset, while the RL agent achieves a 92.5% success rate in simulation and 86.7% in phantom experiments.
核心發現: 核心結果:The SRG-YOLOv11s improves mAP50 by 11.3% and mIoU by 6.8% on the Special Case dataset, while the RL agent achieves a 92.5% success rate in simulation and 86.7% in phantom experiments.
VisFly-Lab: Unified Differentiable Framework for First-Order Reinforcement Learning of Quadrotor Control
Authors: Fanxing Li, Fangyu Sun, Tianbao Zhang et al. | Submitted: 2026-03-22 | arXiv: 2603.21123
Categories: cs.RO
Research Background: First-order reinforcement learning with differentiable simulation is promising for quadrotor control, but practical progress remains fragmented across task-specific settings. To support more systematic development and evaluation, we present a unified differentiable framework for multi-task quadrotor control.
研究背景: 在機器人學習領域,First-order reinforcement learning with differentiable simulation is promising for quadrotor control, but practical progress remains fragmented across task-specific settings. To su
Technical Approach: To support more systematic development and evaluation, we present a unified differentiable framework for multi-task quadrotor control. To address these issues, we propose Amended Backpropagation Through Time (ABPT), which combines differentiable rollout optimization, a value-based auxiliary objective, and visited-state initialization to improve training robustness.
技術方法: 本文提出的方法:To support more systematic development and evaluation, we present a unified differentiable framework for multi-task quadrotor control. To address these issues, we propose Amended Backpropagation Throu
Key Takeaway: Experimental results show that ABPT yields the clearest gains in tasks with partially non-differentiable rewards, while remaining competitive in fully differentiable settings.
核心發現: 核心結果:Experimental results show that ABPT yields the clearest gains in tasks with partially non-differentiable rewards, while remaining competitive in fully differentiable settings.
CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluation
Authors: Bowen Jing, Ruiyang Hao, Weitao Zhou et al. | Submitted: 2026-03-22 | arXiv: 2603.21104
Categories: cs.RO, cs.CV
Research Background: Generating safety-critical driving scenarios requires understanding why dangerous interactions arise, rather than merely forcing collisions. However, existing methods rely on heuristic adversarial agent selection and unstructured perturbations, lacking explicit modeling of interaction dependencies and thus exhibiting a realism—adversarial trade-off.
研究背景: 在機器人學習領域,Generating safety-critical driving scenarios requires understanding why dangerous interactions arise, rather than merely forcing collisions. However, existing methods rely on heuri
Technical Approach: We present CounterScene, a framework that endows closed-loop generative BEV world models with structured counterfactual reasoning for safety-critical scenario generation. To answer this, we introduce causal adversarial agent identification to identify the critical agent and classify conflict types, and develop a conflict-aware interactive world model in which a causal interaction graph is used to explicitly model dynamic inter-agent dependencies.
技術方法: 本文提出的方法:We present CounterScene, a framework that endows closed-loop generative BEV world models with structured counterfactual reasoning for safety-critical scenario generation. To answer this, we introduce
Key Takeaway: Notably, this advantage further widens over longer rollouts, and CounterScene generalizes zero-shot to nuPlan with state-of-the-art realism.
核心發現: 核心結果:Notably, this advantage further widens over longer rollouts, and CounterScene generalizes zero-shot to nuPlan with state-of-the-art realism.
Zero-Shot Generalization from Motion Demonstrations to New Tasks
Authors: Kilian Freitag, Alvin Combrink, Nadia Figueroa | Submitted: 2026-03-16 | arXiv: 2603.15445
Categories: cs.RO
Research Background: Learning motion policies from expert demonstrations is an essential paradigm in modern robotics. While end-to-end models aim for broad generalization, they require large datasets and computationally heavy inference.
研究背景: 在機器人學習領域,Learning motion policies from expert demonstrations is an essential paradigm in modern robotics. While end-to-end models aim for broad generalization, they require large datasets a
Technical Approach: We propose two frameworks leveraging this graph: Stitching, for constructing time-invariant DSs, and Chaining, giving a sequence-based DS for complex motions while retaining convergence guarantees.
技術方法: 本文提出的方法:We propose two frameworks leveraging this graph: Stitching, for constructing time-invariant DSs, and Chaining, giving a sequence-based DS for complex motions while retaining convergence guarantees.
Key Takeaway: Simulations and real-robot experiments show that these methods successfully generalize to new tasks where baseline methods fail.
核心發現: 核心結果:Simulations and real-robot experiments show that these methods successfully generalize to new tasks where baseline methods fail.
A Methodology for Dynamic Parameters Identification of 3-DOF Parallel Robots in Terms of Relevant Parameters
Authors: Miguel Díaz-Rodríguez, Vicente Mata, Angel Valera et al. | Submitted: 2026-03-16 | arXiv: 2603.15254
Categories: cs.RO
Research Background: The identification of dynamic parameters in mechanical systems is important for improving model-based control as well as for performing realistic dynamic simulations. Generally, when identification techniques are applied only a subset of so-called base parameters can be identified.
研究背景: 在機器人學習領域,The identification of dynamic parameters in mechanical systems is important for improving model-based control as well as for performing realistic dynamic simulations. Generally, wh
Technical Approach: Generally, when identification techniques are applied only a subset of so-called base parameters can be identified. More even, some of these parameters cannot be identified properly given that they have a small contribution to the robot dynamics and hence in the presence of noise in measurements and discrepancy in modeling, their quality of being identifiable decreases. For this reason, a strategy for dynamic parameter identification of fully parallel robots in terms of a subset called relevant parameters is put forward.
技術方法: 本文提出的方法:Generally, when identification techniques are applied only a subset of so-called base parameters can be identified. More even, some of these parameters cannot be identified properly given that they ha
Key Takeaway: In order to evaluate the forward dynamics response, an approach for obtaining the forward dynamics in terms of the relevant parameters is also proposed.
核心發現: 核心結果:In order to evaluate the forward dynamics response, an approach for obtaining the forward dynamics in terms of the relevant parameters is also proposed.
Coupled Particle Filters for Robust Affordance Estimation
Authors: Patrick Lowin, Vito Mengers, Oliver Brock | Submitted: 2026-03-16 | arXiv: 2603.15223
Categories: cs.RO
Research Background: Robotic affordance estimation is challenging due to visual, geometric, and semantic ambiguities in sensory input. We propose a method that disambiguates these signals using two coupled recursive estimators for sub-aspects of affordances: graspable and movable regions.
研究背景: 在機器人學習領域,Robotic affordance estimation is challenging due to visual, geometric, and semantic ambiguities in sensory input. We propose a method that disambiguates these signals using two cou
Technical Approach: We propose a method that disambiguates these signals using two coupled recursive estimators for sub-aspects of affordances: graspable and movable regions. Evaluated on a real-world dataset, our method outperforms three recent affordance estimators (Where2Act, Hands-as-Probes, and HRP) by 308%, 245%, and 257% in precision, and remains robust under challenging conditions such as low light or cluttered environments. Furthermore, our method achieves a 70% success rate in our real-world evaluation.
技術方法: 本文提出的方法:We propose a method that disambiguates these signals using two coupled recursive estimators for sub-aspects of affordances: graspable and movable regions. Evaluated on a real-world dataset, our method
Key Takeaway: These results demonstrate that coupling complementary estimators yields precise, robust, and embodiment-appropriate affordance predictions.
核心發現: 核心結果:These results demonstrate that coupling complementary estimators yields precise, robust, and embodiment-appropriate affordance predictions.
A Novel Camera-to-Robot Calibration Method for Vision-Based Floor Measurements
Authors: Jan Andre Rudolph, Dennis Haitz, Markus Ulrich | Submitted: 2026-03-16 | arXiv: 2603.15126
Categories: cs.RO, cs.CV
Research Background: A novel hand-eye calibration method for ground-observing mobile robots is proposed. While cameras on mobile robots are common, they are rarely used for ground-observing measurement tasks.
研究背景: 在機器人學習領域,A novel hand-eye calibration method for ground-observing mobile robots is proposed. While cameras on mobile robots are common, they are rarely used for ground-observing measurement
Technical Approach: While cameras on mobile robots are common, they are rarely used for ground-observing measurement tasks. Laser trackers are increasingly used in robotics for precise localization. A referencing plate is designed to combine the two measurement modalities of laser-tracker 3D metrology and camera-based 2D imaging.
技術方法: 本文提出的方法:While cameras on mobile robots are common, they are rarely used for ground-observing measurement tasks. Laser trackers are increasingly used in robotics for precise localization. A referencing plate i
Key Takeaway: Experiments indicate sub-millimeter repeatability.
核心發現: 核心結果:Experiments indicate sub-millimeter repeatability.
Multi-Mode Pneumatic Artificial Muscles Driven by Hybrid Positive-Negative Pressure
Authors: Siyuan Feng, Ruoyu Feng, Shuguang Li | Submitted: 2026-03-16 | arXiv: 2603.15066
Categories: cs.RO
Research Background: Artificial muscles embody human aspirations for engineering lifelike robotic movements. This paper introduces an architecture for Inflatable Fluid-Driven Origami-Inspired Artificial Muscles (IN-FOAMs).
研究背景: 在機器人學習領域,Artificial muscles embody human aspirations for engineering lifelike robotic movements. This paper introduces an architecture for Inflatable Fluid-Driven Origami-Inspired Artificia
Technical Approach: This paper introduces an architecture for Inflatable Fluid-Driven Origami-Inspired Artificial Muscles (IN-FOAMs). Additionally, we propose multilayer skeleton structures to enhance the contraction ratio further, and we demonstrate a multi-channel skeleton approach that allows the integration of multiple motion modes into a single IN-FOAM.
技術方法: 本文提出的方法:This paper introduces an architecture for Inflatable Fluid-Driven Origami-Inspired Artificial Muscles (IN-FOAMs). Additionally, we propose multilayer skeleton structures to enhance the contraction rat
Key Takeaway: Additionally, we propose multilayer skeleton structures to enhance the contraction ratio further, and we demonstrate a multi-channel skeleton approach that allows the integration of multiple motion modes into a single IN-FOAM.
核心發現: 核心結果:Additionally, we propose multilayer skeleton structures to enhance the contraction ratio further, and we demonstrate a multi-channel skeleton approach that allows the integration of multiple motion mo
From Folding Mechanics to Robotic Function: A Unified Modeling Framework for Compliant Origami
Authors: Bohan Zhang, Bo Wang, Huajiang Ouyang et al. | Submitted: 2026-03-16 | arXiv: 2603.14900
Categories: cs.RO
Research Background: Origami inspired architectures offer a powerful route toward lightweight, reconfigurable, and programmable robotic systems. Yet, a unified mechanics framework capable of seamlessly bridging rigid folding, elastic deformation, and stability driven transitions in compliant origami remains lacking.
研究背景: 在機器人學習領域,Origami inspired architectures offer a powerful route toward lightweight, reconfigurable, and programmable robotic systems. Yet, a unified mechanics framework capable of seamlessly
Technical Approach: Here, we introduce a geometry consistent modeling framework based on discrete differential geometry (DDG) that unifies panel elasticity and crease rotation within a single variational formulation.
技術方法: 本文提出的方法:Here, we introduce a geometry consistent modeling framework based on discrete differential geometry (DDG) that unifies panel elasticity and crease rotation within a single variational formulation.
Key Takeaway: Through representative examples spanning single fold bifurcation, deployable Miura membranes, bistable Waterbomb modules, and Kresling based crawling robots, we demonstrate how geometry driven mechanics directly informs robotic functionality.
核心發現: 核心結果:Through representative examples spanning single fold bifurcation, deployable Miura membranes, bistable Waterbomb modules, and Kresling based crawling robots, we demonstrate how geometry driven mechani
A Unified Calibration Framework for Coordinate and Kinematic Parameters in Dual-Arm Robots
Authors: Tianyu Huang, Bohan Yang, Bin Li et al. | Submitted: 2026-03-16 | arXiv: 2603.14809
Categories: cs.RO
Research Background: Precise collaboration in vision-based dual-arm robot systems requires accurate system calibration. Recent dual-robot calibration methods have achieved strong performance by simultaneously solving multiple coordinate transformations.
研究背景: 在機器人學習領域,Precise collaboration in vision-based dual-arm robot systems requires accurate system calibration. Recent dual-robot calibration methods have achieved strong performance by simulta
Technical Approach: In this paper, we present a novel framework for unified calibration of the coordinate transformations and kinematic parameters in both robot arms. To this end, we construct a consolidated error model grounded in the product-of-exponentials formula, which naturally integrates the coordinate and kinematic parameters in twist forms. Besides, to ensure robust convergence of our joint optimization, we develop a certifiably correct algorithm for initializing the unknown coordinates.
技術方法: 本文提出的方法:In this paper, we present a novel framework for unified calibration of the coordinate transformations and kinematic parameters in both robot arms. To this end, we construct a consolidated error model
Key Takeaway: Meanwhile, our certifiable initialization consistently outperforms several coordinate-only baselines, proving its reliability as a starting point for joint optimization.
核心發現: 核心結果:Meanwhile, our certifiable initialization consistently outperforms several coordinate-only baselines, proving its reliability as a starting point for joint optimization.
GraspALL: Adaptive Structural Compensation from Illumination Variation for Robotic Garment Grasping in Any Low-Light Conditions
Authors: Haifeng Zhong, Wenshuo Han, Zhouyu Wang et al. | Submitted: 2026-03-16 | arXiv: 2603.14789
Categories: cs.RO
Research Background: Achieving accurate garment grasping under dynamically changing illumination is crucial for all-day operation of service robots.However, the reduced illumination in low-light scenes severely degrades garment structural features, leading to a significant drop in grasping robustness.Existing methods typically enhance RGB features by exploiting the illumination-invariant properties of non-RGB modalities, yet they overlook the varying dependence on non-RGB features under varying lighting conditions, which can introduce misaligned non-RGB cues and thereby weaken the model’s adaptability to illumination changes when utilizing multimodal information.To address this problem, we propose GraspALL, an illumination-structure interactive compensation model.The innovation of GraspALL lies in encoding continuous illumination changes into quantitative references to guide adaptive feature fusion between RGB and non-RGB modalities according to varying lighting intensities, thereby generating illumination-consistent grasping representations.Experiments on the self-built garment grasping dataset demonstrate that GraspALL improves grasping accuracy by 32-44% over baselines under diverse illumination conditions.
研究背景: 在機器人學習領域,Achieving accurate garment grasping under dynamically changing illumination is crucial for all-day operation of service robots.However, the reduced illumination in low-light scenes
Technical Approach: Achieving accurate garment grasping under dynamically changing illumination is crucial for all-day operation of service robots.However, the reduced illumination in low-light scenes severely degrades garment structural features, leading to a significant drop in grasping robustness.Existing methods typically enhance RGB features by exploiting the illumination-invariant properties of non-RGB modalities, yet they overlook the varying dependence on non-RGB features under varying lighting conditions, which can introduce misaligned non-RGB cues and thereby weaken the model’s adaptability to illumination changes when utilizing multimodal information.To address this problem, we propose GraspALL, an illumination-structure interactive compensation model.The innovation of GraspALL lies in encoding continuous illumination changes into quantitative references to guide adaptive feature fusion between RGB and non-RGB modalities according to varying lighting intensities, thereby generating illumination-consistent grasping representations.Experiments on the self-built garment grasping dataset demonstrate that GraspALL improves grasping accuracy by 32-44% over baselines under diverse illumination conditions.
技術方法: 本文提出的方法:Achieving accurate garment grasping under dynamically changing illumination is crucial for all-day operation of service robots.However, the reduced illumination in low-light scenes severely degrades g
Key Takeaway: Achieving accurate garment grasping under dynamically changing illumination is crucial for all-day operation of service robots.However, the reduced illumination in low-light scenes severely degrades garment structural features, leading to a significant drop in grasping robustness.Existing methods typically enhance RGB features by exploiting the illumination-invariant properties of non-RGB modalities, yet they overlook the varying dependence on non-RGB features under varying lighting conditions, which can introduce misaligned non-RGB cues and thereby weaken the model’s adaptability to illumination changes when utilizing multimodal information.To address this problem, we propose GraspALL, an illumination-structure interactive compensation model.The innovation of GraspALL lies in encoding continuous illumination changes into quantitative references to guide adaptive feature fusion between RGB and non-RGB modalities according to varying lighting intensities, thereby generating illumination-consistent grasping representations.Experiments on the self-built garment grasping dataset demonstrate that GraspALL improves grasping accuracy by 32-44% over baselines under diverse illumination conditions.
核心發現: 核心結果:Achieving accurate garment grasping under dynamically changing illumination is crucial for all-day operation of service robots.However, the reduced illumination in low-light scenes severely degrades g
CORAL: COntextual Reasoning And Local Planning in A Hierarchical VLM Framework for Underwater Monitoring
Authors: Zhenqi Wu, Yuanjie Lu, Xuesu Xiao et al. | Submitted: 2026-03-16 | arXiv: 2603.14786
Categories: cs.RO
Research Background: Oyster reefs are critical ecosystem species that sustain biodiversity, filter water, and protect coastlines, yet they continue to decline globally. Restoring these ecosystems requires regular underwater monitoring to assess reef health, a task that remains costly, hazardous, and limited when performed by human divers.
研究背景: 在機器人學習領域,Oyster reefs are critical ecosystem species that sustain biodiversity, filter water, and protect coastlines, yet they continue to decline globally. Restoring these ecosystems requi
Technical Approach: To address these limitations, we propose CORAL, a framework that decouples high-level semantic reasoning from low-level reactive control.
技術方法: 本文提出的方法:To address these limitations, we propose CORAL, a framework that decouples high-level semantic reasoning from low-level reactive control.
Key Takeaway: Compared with the previous state-of-the-art, CORAL improves coverage by 14.28% percentage points, or 17.85% relatively, reduces collisions by 100%, and requires 57% fewer VLM calls.
核心發現: 核心結果:Compared with the previous state-of-the-art, CORAL improves coverage by 14.28% percentage points, or 17.85% relatively, reduces collisions by 100%, and requires 57% fewer VLM calls.
Mechanistic Foundations of Goal-Directed Control
Authors: Alma Lago | Submitted: 2026-03-16 | arXiv: 2603.15248
Categories: cs.LG, eess.SY
Research Background: Mechanistic interpretability has transformed the analysis of transformer circuits by decomposing model behavior into competing algorithms, identifying phase transitions during training, and deriving closed-form predictions for when and why strategies shift. However, this program has remained largely confined to sequence-prediction architectures, leaving embodied control systems without comparable mechanistic accounts.
研究背景: 在機器人學習領域,Mechanistic interpretability has transformed the analysis of transformer circuits by decomposing model behavior into competing algorithms, identifying phase transitions during trai
Technical Approach: However, this program has remained largely confined to sequence-prediction architectures, leaving embodied control systems without comparable mechanistic accounts. Here we extend this framework to sensorimotor-cognitive development, using infant motor learning as a model system. We show that foundational inductive biases give rise to causal control circuits, with learned gating mechanisms converging toward theoretically motivated uncertainty thresholds.
技術方法: 本文提出的方法:However, this program has remained largely confined to sequence-prediction architectures, leaving embodied control systems without comparable mechanistic accounts. Here we extend this framework to sen
Key Takeaway: Together, these results provide a mechanistic account of how reactive and prospective control strategies emerge and compete during learning.
核心發現: 核心結果:Together, these results provide a mechanistic account of how reactive and prospective control strategies emerge and compete during learning.
Pointing-Based Object Recognition
Authors: Lukáš Hajdúch, Viktor Kocur | Submitted: 2026-03-16 | arXiv: 2603.15403
Categories: cs.CV
Research Background: This paper presents a comprehensive pipeline for recognizing objects targeted by human pointing gestures using RGB images. As human-robot interaction moves toward more intuitive interfaces, the ability to identify targets of non-verbal communication becomes crucial.
研究背景: 在機器人學習領域,This paper presents a comprehensive pipeline for recognizing objects targeted by human pointing gestures using RGB images. As human-robot interaction moves toward more intuitive in
Technical Approach: This paper presents a comprehensive pipeline for recognizing objects targeted by human pointing gestures using RGB images.
技術方法: 本文提出的方法:This paper presents a comprehensive pipeline for recognizing objects targeted by human pointing gestures using RGB images.
Key Takeaway: Experimental results on a custom dataset show that incorporating depth information significantly improves target identification, especially in complex scenes with overlapping objects.
核心發現: 核心結果:Experimental results on a custom dataset show that incorporating depth information significantly improves target identification, especially in complex scenes with overlapping objects.
Real-Time Decoding of Movement Onset and Offset for Brain-Controlled Rehabilitation Exoskeleton
Authors: Kanishka Mitra, Satyam Kumar, Frigyes Samuel Racz et al. | Submitted: 2026-03-17 | arXiv: 2603.16825
Categories: cs.RO, cs.AI, cs.HC
Research Background: Robot-assisted therapy can deliver high-dose, task-specific training after neurologic injury, but most systems act primarily at the limb level-engaging the impaired neural circuits only indirectly-which remains a key barrier to truly contingent, neuroplasticity-targeted rehabilitation. We address this gap by implementing online, dual-state motor imagery control of an upper-limb exoskeleton, enabling goal-directed reaches to be both initiated and terminated directly from non-invasive EEG.
研究背景: 在機器人學習領域,Robot-assisted therapy can deliver high-dose, task-specific training after neurologic injury, but most systems act primarily at the limb level-engaging the impaired neural circuits
Technical Approach: Methodologically, we reveal a systematic, class-driven bias induced by common task-based recentering using an asymmetric margin diagnostic, and we introduce a class-agnostic fixation-based recentering method that tracks drift without sampling command classes while preserving class geometry.
技術方法: 本文提出的方法:Methodologically, we reveal a systematic, class-driven bias induced by common task-based recentering using an asymmetric margin diagnostic, and we introduce a class-agnostic fixation-based recentering
Key Takeaway: Together, these results help bridge offline decoding and practical, intention-driven start-stop control of a rehabilitation exoskeleton, enabling precisely timed, contingent assistance aligned with neuroplasticity goals while supporting future clinical translation.
核心發現: 核心結果:Together, these results help bridge offline decoding and practical, intention-driven start-stop control of a rehabilitation exoskeleton, enabling precisely timed, contingent assistance aligned with ne
Development of Low-Cost and Bidirectional Syringe Pumps for Soft Robotics Applications
Authors: Krishamsu Subedi Chhetri, Aryan Mayor, Elise Corbin et al. | Submitted: 2026-03-17 | arXiv: 2603.16803
Categories: cs.RO
Research Background: Soft robotics leverages deformable materials to develop robots capable of navigating unstructured and dynamic environments. Silicone Voxel-Based Soft Robots (Silibots) are a type of pneumatically actuated soft robots that rely on the inflation and deflation of their voxels for shape-shifting behaviors.
研究背景: 在機器人學習領域,Soft robotics leverages deformable materials to develop robots capable of navigating unstructured and dynamic environments. Silicone Voxel-Based Soft Robots (Silibots) are a type o
Technical Approach: Silicone Voxel-Based Soft Robots (Silibots) are a type of pneumatically actuated soft robots that rely on the inflation and deflation of their voxels for shape-shifting behaviors. However, traditional pneumatic actuation methods (high pressure solenoids, medical diaphragm pumps, micro compressors, compressed fluid) pose significant challenges due to their limited efficacy, cost, complexity, or lack of precision. This work introduces a low cost and modular syringe pump system, constructed with off the shelf and 3D printed parts, designed to overcome these limitations.
技術方法: 本文提出的方法:Silicone Voxel-Based Soft Robots (Silibots) are a type of pneumatically actuated soft robots that rely on the inflation and deflation of their voxels for shape-shifting behaviors. However, traditional
Key Takeaway: This flexibility makes the syringe pump an accessible and scalable tool that paves the way for broader adoption of soft robotic technologies in research and education.
核心發現: 核心結果:This flexibility makes the syringe pump an accessible and scalable tool that paves the way for broader adoption of soft robotic technologies in research and education.
Reconciling distributed compliance with high-performance control in continuum soft robotics
Authors: Vito Daniele Perfetta, Daniel Feliu-Talegon, Ebrahim Shahabi et al. | Submitted: 2026-03-17 | arXiv: 2603.16630
Categories: cs.RO
Research Background: High-performance closed-loop control of truly soft continuum manipulators has remained elusive. Experimental demonstrations have largely relied on sufficiently stiff, piecewise architectures in which each actuated segment behaves as a distributed yet effectively rigid element, while deformation modes beyond simple bending are suppressed.
研究背景: 在機器人學習領域,High-performance closed-loop control of truly soft continuum manipulators has remained elusive. Experimental demonstrations have largely relied on sufficiently stiff, piecewise arc
Technical Approach: We present a highly compliant, fully continuum robotic arm - without hardware discretization or stiffness-based mode suppression - that achieves fast, precise task-space convergence under dynamic conditions.
技術方法: 本文提出的方法:We present a highly compliant, fully continuum robotic arm - without hardware discretization or stiffness-based mode suppression - that achieves fast, precise task-space convergence under dynamic cond
Key Takeaway: These results show that distributed compliance and high-performance dynamic control can coexist, opening a path toward truly soft manipulators approaching the operational capabilities of rigid robots without sacrificing morphological richness.
核心發現: 核心結果:These results show that distributed compliance and high-performance dynamic control can coexist, opening a path toward truly soft manipulators approaching the operational capabilities of rigid robots
Scalable Inspection Planning via Flow-based Mixed Integer Linear Programming
Authors: Adir Morgan, Kiril Solovey, Oren Salzman | Submitted: 2026-03-17 | arXiv: 2603.16593
Categories: cs.RO
Research Background: Inspection planning is concerned with computing the shortest robot path to inspect a given set of points of interest (POIs) using the robot’s sensors. This problem arises in a wide range of applications from manufacturing to medical robotics.
研究背景: 在機器人學習領域,Inspection planning is concerned with computing the shortest robot path to inspect a given set of points of interest (POIs) using the robot’s sensors. This problem arises in a wide
Technical Approach: In this work, we present highly scalable Mixed Integer Linear Programming (MILP) solutions for GIP that significantly advance the state-of-the-art in both runtime and solution quality. We evaluate our approach on medical and infrastructure benchmarks alongside large-scale synthetic instances. Across all scenarios, our method produces substantially tighter lower bounds than existing formulations, reducing optimality gaps by 30-50% on large instances.
技術方法: 本文提出的方法:In this work, we present highly scalable Mixed Integer Linear Programming (MILP) solutions for GIP that significantly advance the state-of-the-art in both runtime and solution quality. We evaluate our
Key Takeaway: Furthermore, our solver demonstrates unprecedented scalability: it provides non-trivial solutions for problems with up to 15,000 vertices and thousands of POIs, where prior state-of-the-art methods typically exhaust memory or fail to provide any meaningful optimality guarantees.
核心發現: 核心結果:Furthermore, our solver demonstrates unprecedented scalability: it provides non-trivial solutions for problems with up to 15,000 vertices and thousands of POIs, where prior state-of-the-art methods ty
A Pin-Array Structured Climbing Robot for Stable Locomotion on Steep Rocky Terrain
Authors: Keita Nagaoka, Kentaro Uno, Kazuya Yoshida | Submitted: 2026-03-17 | arXiv: 2603.16543
Categories: cs.RO, cs.AR
Research Background: Climbing robots face significant challenges when navigating unstructured environments, where reliable attachment to irregular surfaces is critical. We present a novel mobile climbing robot equipped with compliant pin-array structured grippers that passively conform to surface irregularities, ensuring stable ground gripping without the need for complicated sensing or control.
研究背景: 在機器人學習領域,Climbing robots face significant challenges when navigating unstructured environments, where reliable attachment to irregular surfaces is critical. We present a novel mobile climbi
Technical Approach: We present a novel mobile climbing robot equipped with compliant pin-array structured grippers that passively conform to surface irregularities, ensuring stable ground gripping without the need for complicated sensing or control.
技術方法: 本文提出的方法:We present a novel mobile climbing robot equipped with compliant pin-array structured grippers that passively conform to surface irregularities, ensuring stable ground gripping without the need for co
Key Takeaway: The robot demonstrated robust and stable locomotion in indoor tests on inclined walls (10-30 degrees) and in outdoor tests on natural rocky terrain.
核心發現: 核心結果:The robot demonstrated robust and stable locomotion in indoor tests on inclined walls (10-30 degrees) and in outdoor tests on natural rocky terrain.
When Rolling Gets Weird: A Curved-Link Tensegrity Robot for Non-Intuitive Behavior
Authors: Lauren Ervin, Harish Bezawada, Vishesh Vikas | Submitted: 2026-03-17 | arXiv: 2603.16503
Categories: cs.RO, eess.SY
Research Background: Conventional mobile tensegrity robots constructed with straight links offer mobility at the cost of locomotion speed. While spherical robots provide highly effective rolling behavior, they often lack the stability required for navigating unstructured terrain common in many space exploration environments.
研究背景: 在機器人學習領域,Conventional mobile tensegrity robots constructed with straight links offer mobility at the cost of locomotion speed. While spherical robots provide highly effective rolling behavi
Technical Approach: While spherical robots provide highly effective rolling behavior, they often lack the stability required for navigating unstructured terrain common in many space exploration environments. This research presents a solution with a semi-circular, curved-link tensegrity robot that strikes a balance between efficient rolling locomotion and controlled stability, enabled by discontinuities present at the arc endpoints. Building upon an existing geometric static modeling framework [1], this work presents the system design of an improved Tensegrity eXploratory Robot 2 (TeXploR2).
技術方法: 本文提出的方法:While spherical robots provide highly effective rolling behavior, they often lack the stability required for navigating unstructured terrain common in many space exploration environments. This researc
Key Takeaway: Future work will focus on finalizing a dynamic model that is experimentally validated with extended testing in real-world environments as well as further refinement of the prototype to incorporate additional curved-links and subsequent ground contact points for increased controllability.
核心發現: 核心結果:Future work will focus on finalizing a dynamic model that is experimentally validated with extended testing in real-world environments as well as further refinement of the prototype to incorporate add
Early-Terminable Energy-Safe Iterative Coupling for Parallel Simulation of Port-Hamiltonian Systems
Authors: Qi Wei, Jianfeng Tao, Hongyu Nie et al. | Submitted: 2026-03-17 | arXiv: 2603.16424
Categories: cs.RO, eess.SY, math.NA
Research Background: Parallel simulation and control of large-scale robotic systems often rely on partitioned time stepping, yet finite-iteration coupling can inject spurious energy by violating power consistency—even when each subsystem is passive. This letter proposes a novel energy-safe, early-terminable iterative coupling for port-Hamiltonian subsystems by embedding a Douglas—Rachford (DR) splitting scheme in scattering (wave) coordinates.
研究背景: 在機器人學習領域,Parallel simulation and control of large-scale robotic systems often rely on partitioned time stepping, yet finite-iteration coupling can inject spurious energy by violating power
Technical Approach: This letter proposes a novel energy-safe, early-terminable iterative coupling for port-Hamiltonian subsystems by embedding a Douglas—Rachford (DR) splitting scheme in scattering (wave) coordinates. The lossless interconnection is enforced as an orthogonal constraint in the wave domain, while each subsystem contributes a discrete-time scattering port map induced by its one-step integrator. Under a discrete passivity condition on the subsystem time steps and a mild impedance-tuning condition, we prove an augmented-storage inequality certifying discrete passivity of the coupled macro-step for any finite inner-iteration budget, with the remaining mismatch captured by an explicit residual.
技術方法: 本文提出的方法:This letter proposes a novel energy-safe, early-terminable iterative coupling for port-Hamiltonian subsystems by embedding a Douglas—Rachford (DR) splitting scheme in scattering (wave) coordinates. T
Key Takeaway: Experiments on a coupled-oscillator benchmark validate the passivity certificates at numerical roundoff (on the order of 10e-14 in double precision) and show that the reported RMS state error decays monotonically with increasing inner-iteration budgets, consistent with the hard-coupling limit.
核心發現: 核心結果:Experiments on a coupled-oscillator benchmark validate the passivity certificates at numerical roundoff (on the order of 10e-14 in double precision) and show that the reported RMS state error decays m
ADAPT: Adaptive Dual-projection Architecture for Perceptive Traversal
Authors: Shuo Shao, Tianchen Huang, Wei Gao et al. | Submitted: 2026-03-17 | arXiv: 2603.16328
Categories: cs.RO
Research Background: Agile humanoid locomotion in complex 3D en- vironments requires balancing perceptual fidelity with com- putational efficiency, yet existing methods typically rely on rigid sensing configurations. We propose ADAPT (Adaptive dual-projection architecture for perceptive traversal), which represents the environment using a horizontal elevation map for terrain geometry and a vertical distance map for traversable- space constraints.
研究背景: 在機器人學習領域,Agile humanoid locomotion in complex 3D en- vironments requires balancing perceptual fidelity with com- putational efficiency, yet existing methods typically rely on rigid sensing
Technical Approach: We propose ADAPT (Adaptive dual-projection architecture for perceptive traversal), which represents the environment using a horizontal elevation map for terrain geometry and a vertical distance map for traversable- space constraints.
技術方法: 本文提出的方法:We propose ADAPT (Adaptive dual-projection architecture for perceptive traversal), which represents the environment using a horizontal elevation map for terrain geometry and a vertical distance map fo
Key Takeaway: Experimentally, it achieves successful zero-shot transfer to a Unitree G1 Humanoid and signifi- cantly outperforms fixed-range baselines, yielding highly robust traversal across diverse 3D environtmental challenges.
核心發現: 核心結果:Experimentally, it achieves successful zero-shot transfer to a Unitree G1 Humanoid and signifi- cantly outperforms fixed-range baselines, yielding highly robust traversal across diverse 3D environtmen
OGScene3D: Incremental Open-Vocabulary 3D Gaussian Scene Graph Mapping for Scene Understanding
Authors: Siting Zhu, Ziyun Lu, Guangming Wang et al. | Submitted: 2026-03-17 | arXiv: 2603.16301
Categories: cs.RO
Research Background: Open-vocabulary scene understanding is crucial for robotic applications, enabling robots to comprehend complex 3D environmental contexts and supporting various downstream tasks such as navigation and manipulation. However, existing methods require pre-built complete 3D semantic maps to construct scene graphs for scene understanding, which limits their applicability in robotic scenarios where environments are explored incrementally.
研究背景: 在機器人學習領域,Open-vocabulary scene understanding is crucial for robotic applications, enabling robots to comprehend complex 3D environmental contexts and supporting various downstream tasks suc
Technical Approach: To address this challenge, we propose OGScene3D, an open-vocabulary scene understanding system that achieves accurate 3D semantic mapping and scene graph construction incrementally. Our system employs a confidence-based Gaussian semantic representation that jointly models semantic predictions and their reliability, enabling robust scene modeling. Building on this representation, we introduce a hierarchical 3D semantic optimization strategy that achieves semantic consistency through local correspondence establishment and global refinement, thereby constructing globally consistent semantic maps.
技術方法: 本文提出的方法:To address this challenge, we propose OGScene3D, an open-vocabulary scene understanding system that achieves accurate 3D semantic mapping and scene graph construction incrementally. Our system employs
Key Takeaway: Extensive experiments on widely used datasets and real-world scenes demonstrate the effectiveness of our OGScene3D on open-vocabulary scene understanding.
核心發現: 核心結果:Extensive experiments on widely used datasets and real-world scenes demonstrate the effectiveness of our OGScene3D on open-vocabulary scene understanding.
Compact Optical Single-axis Joint Torque Sensor Using Redundant Photo-Reflectors and Quadratic-Programming Calibration
Authors: Hyun-Bin Kim, Byeong-Il Ham, Kyung-Soo Kim | Submitted: 2026-03-17 | arXiv: 2603.16040
Categories: cs.RO
Research Background: This study proposes a non-contact photo-reflector-based joint torque sensor for precise joint-level torque control and safe physical interaction. Current-sensor-based torque estimation in many collaborative robots suffers from poor low-torque accuracy due to gearbox stiction/friction and current-torque nonlinearity, especially near static conditions.
研究背景: 在機器人學習領域,This study proposes a non-contact photo-reflector-based joint torque sensor for precise joint-level torque control and safe physical interaction. Current-sensor-based torque estima
Technical Approach: Current-sensor-based torque estimation in many collaborative robots suffers from poor low-torque accuracy due to gearbox stiction/friction and current-torque nonlinearity, especially near static conditions. The proposed sensor optically measures micro-deformation of an elastic structure and employs a redundant array of photo-reflectors arranged in four directions to improve sensitivity and signal-to-noise ratio. We further present a quadratic-programming-based calibration method that exploits redundancy to suppress noise and enhance resolution compared to least-squares calibration.
技術方法: 本文提出的方法:Current-sensor-based torque estimation in many collaborative robots suffers from poor low-torque accuracy due to gearbox stiction/friction and current-torque nonlinearity, especially near static condi
Key Takeaway: Calibration tests show that the proposed calibration achieves a 3 sigma resolution of 0.0224 Nm at 1 kHz without filtering, corresponding to a 2.14 times improvement over the least-squares baseline.
核心發現: 核心結果:Calibration tests show that the proposed calibration achieves a 3 sigma resolution of 0.0224 Nm at 1 kHz without filtering, corresponding to a 2.14 times improvement over the least-squares baseline.
Speak, Segment, Track, Navigate: An Interactive System for Video-Guided Skull-Base Surgery
Authors: Jecia Z. Y. Mao, Francis X. Creighton, Russell H. Taylor et al. | Submitted: 2026-03-17 | arXiv: 2603.16024
Categories: cs.CV
Research Background: We introduce a speech-guided embodied agent framework for video-guided skull base surgery that dynamically executes perception and image-guidance tasks in response to surgeon queries. The proposed system integrates natural language interaction with real-time visual perception directly on live intraoperative video streams, thereby enabling surgeons to request computational assistance without disengaging from operative tasks.
研究背景: 在機器人學習領域,We introduce a speech-guided embodied agent framework for video-guided skull base surgery that dynamically executes perception and image-guidance tasks in response to surgeon queri
Technical Approach: We introduce a speech-guided embodied agent framework for video-guided skull base surgery that dynamically executes perception and image-guidance tasks in response to surgeon queries.
技術方法: 本文提出的方法:We introduce a speech-guided embodied agent framework for video-guided skull base surgery that dynamically executes perception and image-guidance tasks in response to surgeon queries.
Key Takeaway: These results demonstrate that speech-guided embodied agents can provide accurate spatial guidance while improving workflow integration and enabling rapid deployment of video-guided surgical systems.
核心發現: 核心結果:These results demonstrate that speech-guided embodied agents can provide accurate spatial guidance while improving workflow integration and enabling rapid deployment of video-guided surgical systems.
Multi-material Direct Ink Writing and Embroidery for Stretchable Wearable Sensors
Authors: Lukas Cha, Ryman Hashem, Ria Prakash et al. | Submitted: 2026-03-18 | arXiv: 2603.18354
Categories: cs.RO
Research Background: The development of wearable sensing systems for sports performance tracking, rehabilitation, and injury prevention has driven growing demand for smart garments that combine comfort, durability, and accurate motion detection. This paper presents a textile-compatible fabrication workflow that integrates multi-material direct ink writing with automated embroidery to create stretchable strain sensors directly embedded into garments.
研究背景: 在機器人學習領域,The development of wearable sensing systems for sports performance tracking, rehabilitation, and injury prevention has driven growing demand for smart garments that combine comfort
Technical Approach: This paper presents a textile-compatible fabrication workflow that integrates multi-material direct ink writing with automated embroidery to create stretchable strain sensors directly embedded into garments.
技術方法: 本文提出的方法:This paper presents a textile-compatible fabrication workflow that integrates multi-material direct ink writing with automated embroidery to create stretchable strain sensors directly embedded into ga
Key Takeaway: The resulting hybrid sensor demonstrates stretchability up to 120% strain while maintaining electrical continuity, with approximately linear behaviour up to 60% strain (R^2 = 0.99), a gauge factor of 31.4, and hysteresis of 22.9%.
核心發現: 核心結果:The resulting hybrid sensor demonstrates stretchability up to 120% strain while maintaining electrical continuity, with approximately linear behaviour up to 60% strain (R^2 = 0.99), a gauge factor of
SG-CoT: An Ambiguity-Aware Robotic Planning Framework using Scene Graph Representations
Authors: Akshat Rana, Peeyush Agarwal, K. P. S. Rana et al. | Submitted: 2026-03-18 | arXiv: 2603.18271
Categories: cs.RO
Research Background: Ambiguity poses a major challenge to large language models (LLMs) used as robotic planners. In this letter, we present Scene Graph-Chain-of-Thought (SG-CoT), a two-stage framework where LLMs iteratively query a scene graph representation of the environment to detect and clarify ambiguities.
研究背景: 在機器人學習領域,Ambiguity poses a major challenge to large language models (LLMs) used as robotic planners. In this letter, we present Scene Graph-Chain-of-Thought (SG-CoT), a two-stage framework
Technical Approach: In this letter, we present Scene Graph-Chain-of-Thought (SG-CoT), a two-stage framework where LLMs iteratively query a scene graph representation of the environment to detect and clarify ambiguities.
技術方法: 本文提出的方法:In this letter, we present Scene Graph-Chain-of-Thought (SG-CoT), a two-stage framework where LLMs iteratively query a scene graph representation of the environment to detect and clarify ambiguities.
Key Takeaway: Extensive experimentation demonstrates that SG-CoT consistently outperforms prior methods, with a minimum of 10% improvement in question accuracy and a minimum success rate increase of 4% in single-agent and 15% in multi-agent environments, validating its effectiveness for more generalizable robot planning.
核心發現: 核心結果:Extensive experimentation demonstrates that SG-CoT consistently outperforms prior methods, with a minimum of 10% improvement in question accuracy and a minimum success rate increase of 4% in single-ag
ReDAG-RT: Global Rate-Priority Scheduling for Real-Time Multi-DAG Execution in ROS 2
Authors: Md. Mehedi Hasan, Rafid Mostafiz, Bikash Kumar Paul et al. | Submitted: 2026-03-18 | arXiv: 2603.18238
Categories: cs.RO
Research Background: ROS 2 has become a dominant middleware for robotic systems, where perception, estimation, planning, and control pipelines are structured as directed acyclic graphs of callbacks executed under a shared executor. However, default ROS 2 executors use best-effort dispatch without cross-DAG priority enforcement, leading to callback contention, structural priority inversion, and deadline instability under concurrent workloads.
研究背景: 在機器人學習領域,ROS 2 has become a dominant middleware for robotic systems, where perception, estimation, planning, and control pipelines are structured as directed acyclic graphs of callbacks exe
Technical Approach: This paper presents ReDAGRT, a user-space global scheduling framework for deterministic multi-DAG execution in unmodified ROS 2.
技術方法: 本文提出的方法:This paper presents ReDAGRT, a user-space global scheduling framework for deterministic multi-DAG execution in unmodified ROS 2.
Key Takeaway: These results demonstrate that deterministic and analyzable multi-DAG scheduling can be achieved entirely in the ROS 2 user-space execution layer, providing a practical foundation for real-time robotic middleware in safety-critical systems.
核心發現: 核心結果:These results demonstrate that deterministic and analyzable multi-DAG scheduling can be achieved entirely in the ROS 2 user-space execution layer, providing a practical foundation for real-time roboti
Final Report for the Workshop on Robotics & AI in Medicine
Authors: Juan P Wachs | Submitted: 2026-03-18 | arXiv: 2603.18130
Categories: cs.RO, cs.AI
Research Background: The CARE Workshop on Robotics and AI in Medicine, held on December 1, 2025 in Indianapolis, convened leading researchers, clinicians, industry innovators, and federal stakeholders to shape a national vision for advancing robotics and artificial intelligence in healthcare. The event highlighted the accelerating need for coordinated research efforts that bridge engineering innovation with real clinical priorities, emphasizing safety, reliability, and translational readiness with an emphasis on the use of robotics and AI to achieve this readiness goal.
研究背景: 在機器人學習領域,The CARE Workshop on Robotics and AI in Medicine, held on December 1, 2025 in Indianapolis, convened leading researchers, clinicians, industry innovators, and federal stakeholders
Technical Approach: The event highlighted the accelerating need for coordinated research efforts that bridge engineering innovation with real clinical priorities, emphasizing safety, reliability, and translational readiness with an emphasis on the use of robotics and AI to achieve this readiness goal. Across keynotes, panels, and breakout sessions, participants underscored critical gaps in data availability, standardized evaluation methods, regulatory pathways, and workforce training that hinder the deployment of intelligent robotic systems in surgical, diagnostic, rehabilitative, and assistive contexts. Discussions emphasized the transformative potential of AI enabled robotics to improve precision, reduce provider burden, expand access to specialized care, and enhance patient outcomes particularly in undeserved regions and high risk procedural domains.
技術方法: 本文提出的方法:The event highlighted the accelerating need for coordinated research efforts that bridge engineering innovation with real clinical priorities, emphasizing safety, reliability, and translational readin
Key Takeaway: The workshop demonstrated broad consensus on the urgency of establishing a national Center for AI and Robotic Excellence in medicine (CARE).
核心發現: 核心結果:The workshop demonstrated broad consensus on the urgency of establishing a national Center for AI and Robotic Excellence in medicine (CARE).
A Single-Fiber Optical Frequency Domain Reflectometry (OFDR)-Based Shape Sensing of Concentric Tube Steerable Drilling Robots
Authors: Yash Kulkarni, Mobina Tavangarifard, Daniyal Maroufi et al. | Submitted: 2026-03-18 | arXiv: 2603.17990
Categories: cs.RO
Research Background: This paper introduces a novel shape-sensing approach for Concentric Tube Steerable Drilling Robots (CT-SDRs) based on Optical Frequency Domain Reflectometry (OFDR). Unlike traditional FBG-based methods, OFDR enables continuous strain measurement along the entire fiber length with enhanced spatial resolution.
研究背景: 在機器人學習領域,This paper introduces a novel shape-sensing approach for Concentric Tube Steerable Drilling Robots (CT-SDRs) based on Optical Frequency Domain Reflectometry (OFDR). Unlike traditio
Technical Approach: This paper introduces a novel shape-sensing approach for Concentric Tube Steerable Drilling Robots (CT-SDRs) based on Optical Frequency Domain Reflectometry (OFDR).
技術方法: 本文提出的方法:This paper introduces a novel shape-sensing approach for Concentric Tube Steerable Drilling Robots (CT-SDRs) based on Optical Frequency Domain Reflectometry (OFDR).
Key Takeaway: Results demonstrate accurate and reliable shape-sensing capability, confirming the feasibility and robustness of this integration strategy.
核心發現: 核心結果:Results demonstrate accurate and reliable shape-sensing capability, confirming the feasibility and robustness of this integration strategy.
Specification-Aware Distribution Shaping for Robotics Foundation Models
Authors: Sadık Bera Yüksel, Derya Aksaray | Submitted: 2026-03-18 | arXiv: 2603.17969
Categories: cs.RO, cs.AI
Research Background: Robotics foundation models have demonstrated strong capabilities in executing natural language instructions across diverse tasks and environments. However, they remain largely data-driven and lack formal guarantees on safety and satisfaction of time-dependent specifications during deployment.
研究背景: 在機器人學習領域,Robotics foundation models have demonstrated strong capabilities in executing natural language instructions across diverse tasks and environments. However, they remain largely data
Technical Approach: In this work, we propose a specification-aware action distribution optimization framework that enforces a broad class of Signal Temporal Logic (STL) constraints during execution of a pretrained robotics foundation model without modifying its parameters.
技術方法: 本文提出的方法:In this work, we propose a specification-aware action distribution optimization framework that enforces a broad class of Signal Temporal Logic (STL) constraints during execution of a pretrained roboti
Key Takeaway: We validate the proposed framework in simulation using a state-of-the-art robotics foundation model across multiple environments and complex specifications.
核心發現: 核心結果:We validate the proposed framework in simulation using a state-of-the-art robotics foundation model across multiple environments and complex specifications.
Huddle: Parallel Shape Assembly using Decentralized, Minimalistic Robots
Authors: Khai Yi Chin, Tingwei Meng, Zhe Chen et al. | Submitted: 2026-03-18 | arXiv: 2603.17768
Categories: cs.RO
Research Background: We propose a novel algorithm for forming arbitrarily shaped assemblies using decentralized robots. By relying on local interactions, the algorithm ensures there are no unreachable states or gaps in the assembly, which are global properties.
研究背景: 在機器人學習領域,We propose a novel algorithm for forming arbitrarily shaped assemblies using decentralized robots. By relying on local interactions, the algorithm ensures there are no unreachable
Technical Approach: We propose a novel algorithm for forming arbitrarily shaped assemblies using decentralized robots. Our approach is minimalistic, requiring only communication between attached, immediate neighbors.
技術方法: 本文提出的方法:We propose a novel algorithm for forming arbitrarily shaped assemblies using decentralized robots. Our approach is minimalistic, requiring only communication between attached, immediate neighbors.
Key Takeaway: We prove the algorithm’s correctness and demonstrate its effectiveness in forming a 107-robot assembly.
核心發現: 核心結果:We prove the algorithm’s correctness and demonstrate its effectiveness in forming a 107-robot assembly.
FloorPlan-VLN: A New Paradigm for Floor Plan Guided Vision-Language Navigation
Authors: Kehan Chen, Yan Huang, Dong An et al. | Submitted: 2026-03-18 | arXiv: 2603.17437
Categories: cs.RO
Research Background: Existing Vision-Language Navigation (VLN) task requires agents to follow verbose instructions, ignoring some potentially useful global spatial priors, limiting their capability to reason about spatial structures. Although human-readable spatial schematics (e.g., floor plans) are ubiquitous in real-world buildings, current agents lack the cognitive ability to comprehend and utilize them.
研究背景: 在機器人學習領域,Existing Vision-Language Navigation (VLN) task requires agents to follow verbose instructions, ignoring some potentially useful global spatial priors, limiting their capability to
Technical Approach: To bridge this gap, we introduce \textbf{FloorPlan-VLN}, a new paradigm that leverages structured semantic floor plans as global spatial priors to enable navigation with only concise instructions. Then, we propose a simple yet effective method \textbf{FP-Nav} that uses a dual-view, spatio-temporally aligned video sequence, and auxiliary reasoning tasks to align observations, floor plans, and instructions. When evaluated under this new benchmark, our method significantly outperforms adapted state-of-the-art VLN baselines, achieving more than a 60% relative improvement in navigation success rate.
技術方法: 本文提出的方法:To bridge this gap, we introduce \textbf{FloorPlan-VLN}, a new paradigm that leverages structured semantic floor plans as global spatial priors to enable navigation with only concise instructions. The
Key Takeaway: These results validate the effectiveness of floor plan guided navigation and highlight FloorPlan-VLN as a promising step toward more spatially intelligent navigation.
核心發現: 核心結果:These results validate the effectiveness of floor plan guided navigation and highlight FloorPlan-VLN as a promising step toward more spatially intelligent navigation.
ReSteer: Quantifying and Refining the Steerability of Multitask Robot Policies
Authors: Zhenyang Chen, Alan Tian, Liquan Wang et al. | Submitted: 2026-03-18 | arXiv: 2603.17300
Categories: cs.RO
Research Background: Despite strong multi-task pretraining, existing policies often exhibit poor task steerability. For example, a robot may fail to respond to a new instruction put the bowl in the sink" when moving towards the oven, executing close the oven”, even though it can complete both tasks when executed separately.
研究背景: 在機器人學習領域,Despite strong multi-task pretraining, existing policies often exhibit poor task steerability. For example, a robot may fail to respond to a new instruction “put the bowl in the s
Technical Approach: We propose ReSteer, a framework to quantify and improve task steerability in multitask robot policies.
技術方法: 本文提出的方法:We propose ReSteer, a framework to quantify and improve task steerability in multitask robot policies.
Key Takeaway: In real-world experiments, we show that improved steerability is critical for interactive use, enabling users to instruct robots to perform any task at any time.
核心發現: 核心結果:In real-world experiments, we show that improved steerability is critical for interactive use, enabling users to instruct robots to perform any task at any time.
Part-Aware Open-Vocabulary 3D Affordance Grounding via Prototypical Semantic and Geometric Alignment
Authors: Dongqiang Gou, Xuming He | Submitted: 2026-03-18 | arXiv: 2603.17647
Categories: cs.CV
Research Background: Grounding natural language questions to functionally relevant regions in 3D objects — termed language-driven 3D affordance grounding — is essential for embodied intelligence and human-AI interaction. Existing methods, while progressing from label-based to language-driven approaches, still face challenges in open-vocabulary generalization, fine-grained geometric alignment, and part-level semantic consistency.
研究背景: 在機器人學習領域,Grounding natural language questions to functionally relevant regions in 3D objects — termed language-driven 3D affordance grounding — is essential for embodied intelligence and
Technical Approach: To address these issues, we propose a novel two-stage cross-modal framework that enhances both semantic and geometric representations for open-vocabulary 3D affordance grounding. In the second stage, we introduce two key components: Affordance Prototype Aggregation (APA), which captures cross-object geometric consistency for each affordance, and Intra-Object Relational Modeling (IORM), which refines geometric differentiation within objects to support precise semantic alignment. We validate the effectiveness of our method through extensive experiments on a newly introduced benchmark, as well as two existing benchmarks, demonstrating superior performance in comparison with existing methods.
技術方法: 本文提出的方法:To address these issues, we propose a novel two-stage cross-modal framework that enhances both semantic and geometric representations for open-vocabulary 3D affordance grounding. In the second stage,
Key Takeaway: We validate the effectiveness of our method through extensive experiments on a newly introduced benchmark, as well as two existing benchmarks, demonstrating superior performance in comparison with existing methods.
核心發現: 核心結果:We validate the effectiveness of our method through extensive experiments on a newly introduced benchmark, as well as two existing benchmarks, demonstrating superior performance in comparison with exi
GigaWorld-Policy: An Efficient Action-Centered World—Action Model
Authors: Angen Ye, Boyuan Wang, Chaojun Ni et al. | Submitted: 2026-03-18 | arXiv: 2603.17240
Categories: cs.CV
Research Background: World-Action Models (WAM) initialized from pre-trained video generation backbones have demonstrated remarkable potential for robot policy learning. However, existing approaches face two critical bottlenecks that hinder performance and deployment.
研究背景: 在機器人學習領域,World-Action Models (WAM) initialized from pre-trained video generation backbones have demonstrated remarkable potential for robot policy learning. However, existing approaches fac
Technical Approach: To address these issues, we introduce GigaWorld-Policy, an action-centered WAM that learns 2D pixel-action dynamics while enabling efficient action decoding, with optional video generation. Specifically, we formulate policy training into two coupled components: the model predicts future action sequences conditioned on the current observation, and simultaneously generates future videos conditioned on the predicted actions and the same observation.
技術方法: 本文提出的方法:To address these issues, we introduce GigaWorld-Policy, an action-centered WAM that learns 2D pixel-action dynamics while enabling efficient action decoding, with optional video generation. Specifical
Key Takeaway: Moreover, compared with pi-0.5, GigaWorld-Policy improves performance by 95% on RoboTwin 2.0.
核心發現: 核心結果:Moreover, compared with pi-0.5, GigaWorld-Policy improves performance by 95% on RoboTwin 2.0.
A Closed-Form CLF-CBF Controller for Whole-Body Continuum Soft Robot Collision Avoidance
Authors: Kiwan Wong, Maximillian Stölzle, Wei Xiao et al. | Submitted: 2026-03-19 | arXiv: 2603.19424
Categories: cs.RO
Research Background: Safe operation is essential for deploying robots in human-centered 3D environments. Soft continuum manipulators provide passive safety through mechanical compliance, but still require active control to achieve reliable collision avoidance.
研究背景: 在機器人學習領域,Safe operation is essential for deploying robots in human-centered 3D environments. Soft continuum manipulators provide passive safety through mechanical compliance, but still requ
Technical Approach: This paper presents a closed-form Control Lyapunov Function—Control Barrier Function (CLF—CBF) controller for real-time 3D obstacle avoidance in soft continuum manipulators without online optimization.
技術方法: 本文提出的方法:This paper presents a closed-form Control Lyapunov Function—Control Barrier Function (CLF—CBF) controller for real-time 3D obstacle avoidance in soft continuum manipulators without online optimizati
Key Takeaway: These results show that the proposed framework provides a scalable and provably safe control strategy for soft robots operating in dynamic, safety-critical settings.
核心發現: 核心結果:These results show that the proposed framework provides a scalable and provably safe control strategy for soft robots operating in dynamic, safety-critical settings.
VAMPO: Policy Optimization for Improving Visual Dynamics in Video Action Models
Authors: Zirui Ge, Pengxiang Ding, Baohua Yin et al. | Submitted: 2026-03-19 | arXiv: 2603.19370
Categories: cs.RO
Research Background: Video action models are an appealing foundation for Vision—Language—Action systems because they can learn visual dynamics from large-scale video data and transfer this knowledge to downstream robot control. Yet current diffusion-based video predictors are trained with likelihood-surrogate objectives, which encourage globally plausible predictions without explicitly optimizing the precision-critical visual dynamics needed for manipulation.
研究背景: 在機器人學習領域,Video action models are an appealing foundation for Vision—Language—Action systems because they can learn visual dynamics from large-scale video data and transfer this knowledge
Technical Approach: We propose VAMPO, a post-training framework that directly improves visual dynamics in video action models through policy optimization. To make this optimization practical, we introduce an Euler Hybrid sampler that injects stochasticity only at the first denoising step, enabling tractable low-variance policy-gradient estimation while preserving the coherence of the remaining denoising trajectory.
技術方法: 本文提出的方法:We propose VAMPO, a post-training framework that directly improves visual dynamics in video action models through policy optimization. To make this optimization practical, we introduce an Euler Hybrid
Key Takeaway: Across diverse simulated and real-world manipulation tasks, VAMPO improves task-relevant visual dynamics, leading to better downstream action generation and stronger generalization.
核心發現: 核心結果:Across diverse simulated and real-world manipulation tasks, VAMPO improves task-relevant visual dynamics, leading to better downstream action generation and stronger generalization.
Meanings and Measurements: Multi-Agent Probabilistic Grounding for Vision-Language Navigation
Authors: Swagat Padhan, Lakshya Jain, Bhavya Minesh Shah et al. | Submitted: 2026-03-19 | arXiv: 2603.19166
Categories: cs.RO, cs.AI, cs.CL, cs.CV, cs.LG
Research Background: Robots collaborating with humans must convert natural language goals into actionable, physically grounded decisions. For example, executing a command such as “go two meters to the right of the fridge” requires grounding semantic references, spatial relations, and metric constraints within a 3D scene.
研究背景: 在機器人學習領域,Robots collaborating with humans must convert natural language goals into actionable, physically grounded decisions. For example, executing a command such as “go two meters to the
Technical Approach: To address this limitation, we propose MAPG (Multi-Agent Probabilistic Grounding), an agentic framework that decomposes language queries into structured subcomponents and queries a VLM to ground each component. Furthermore, we introduce a new benchmark, MAPG-Bench, specifically designed to evaluate metric-semantic goal grounding, addressing a gap in existing language grounding evaluations.
技術方法: 本文提出的方法:To address this limitation, we propose MAPG (Multi-Agent Probabilistic Grounding), an agentic framework that decomposes language queries into structured subcomponents and queries a VLM to ground each
Key Takeaway: Furthermore, we introduce a new benchmark, MAPG-Bench, specifically designed to evaluate metric-semantic goal grounding, addressing a gap in existing language grounding evaluations.
核心發現: 核心結果:Furthermore, we introduce a new benchmark, MAPG-Bench, specifically designed to evaluate metric-semantic goal grounding, addressing a gap in existing language grounding evaluations.
CAMO: A Conditional Neural Solver for the Multi-objective Multiple Traveling Salesman Problem
Authors: Fengxiaoxiao Li, Xiao Mao, Mingfeng Fan et al. | Submitted: 2026-03-19 | arXiv: 2603.19074
Categories: cs.RO, cs.AI
Research Background: Robotic systems often require a team of robots to collectively visit multiple targets while optimizing competing objectives, such as total travel cost and makespan. This setting can be formulated as the Multi-Objective Multiple Traveling Salesman Problem (MOMTSP).
研究背景: 在機器人學習領域,Robotic systems often require a team of robots to collectively visit multiple targets while optimizing competing objectives, such as total travel cost and makespan. This setting ca
Technical Approach: To bridge this gap, we propose CAMO, a conditional neural solver for MOMTSP that generalizes across varying numbers of targets, agents, and preference vectors, and yields high-quality approximations to the Pareto front (PF).
技術方法: 本文提出的方法:To bridge this gap, we propose CAMO, a conditional neural solver for MOMTSP that generalizes across varying numbers of targets, agents, and preference vectors, and yields high-quality approximations t
Key Takeaway: In addition, ablation results validate the contributions of CAMO’s key components, and real-world tests on a mobile robot platform demonstrate its practical applicability.
核心發現: 核心結果:In addition, ablation results validate the contributions of CAMO’s key components, and real-world tests on a mobile robot platform demonstrate its practical applicability.
PRIOR: Perceptive Learning for Humanoid Locomotion with Reference Gait Priors
Authors: Chenxi Han, Shilu He, Yi Cheng et al. | Submitted: 2026-03-19 | arXiv: 2603.18979
Categories: cs.RO, cs.AI
Research Background: Training perceptive humanoid locomotion policies that traverse complex terrains with natural gaits remains an open challenge, typically demanding multi-stage training pipelines, adversarial objectives, or extensive real-world calibration. We present PRIOR, an efficient and reproducible framework built on Isaac Lab that achieves robust terrain traversal with human-like gaits through a simple yet effective design: (i) a parametric gait generator that supplies stable reference trajectories derived from motion capture without adversarial training, (ii) a GRU-based state estimator that infers terrain geometry directly from egocentric depth images via self-supervised heightmap reconstruction, and (iii) terrain-adaptive footstep rewards that guide foot placement toward traversable regions.
研究背景: 在機器人學習領域,Training perceptive humanoid locomotion policies that traverse complex terrains with natural gaits remains an open challenge, typically demanding multi-stage training pipelines, ad
Technical Approach: We present PRIOR, an efficient and reproducible framework built on Isaac Lab that achieves robust terrain traversal with human-like gaits through a simple yet effective design: (i) a parametric gait generator that supplies stable reference trajectories derived from motion capture without adversarial training, (ii) a GRU-based state estimator that infers terrain geometry directly from egocentric depth images via self-supervised heightmap reconstruction, and (iii) terrain-adaptive footstep rewards that guide foot placement toward traversable regions.
技術方法: 本文提出的方法:We present PRIOR, an efficient and reproducible framework built on Isaac Lab that achieves robust terrain traversal with human-like gaits through a simple yet effective design: (i) a parametric gait g
Key Takeaway: We will open-source the complete PRIOR framework, including the training pipeline, parametric gait generator, and evaluation benchmarks, to serve as a reproducible foundation for humanoid locomotion research on Isaac Lab.
核心發現: 核心結果:We will open-source the complete PRIOR framework, including the training pipeline, parametric gait generator, and evaluation benchmarks, to serve as a reproducible foundation for humanoid locomotion r
TiBCLaG: A Trigger-induced Bistable Compliant Laparoscopic Grasper
Authors: Joel J Nellikkunnel, Prabhat Kumar | Submitted: 2026-03-19 | arXiv: 2603.18559
Categories: cs.RO
Research Background: Industrial laparoscopic graspers use multi-link rigid mechanisms manufactured to tight tolerances, resulting in high manufacturing and assembly costs. This work presents the design and proof-of-concept validation of a monolithic, fully compliant, bistable, laparoscopic grasper that eliminates the need for multiple rigid links, thereby reducing part count.
研究背景: 在機器人學習領域,Industrial laparoscopic graspers use multi-link rigid mechanisms manufactured to tight tolerances, resulting in high manufacturing and assembly costs. This work presents the design
Technical Approach: This work presents the design and proof-of-concept validation of a monolithic, fully compliant, bistable, laparoscopic grasper that eliminates the need for multiple rigid links, thereby reducing part count. The device integrates a compliant trigger and a compliant gripper end-effector, coupled via a control push-rod, to achieve stable grasping without continuous user input. The trigger mechanism is synthesized using a Two-Element Beam Constraint Model as a design framework to control the deformation and stiffness of V-beam-like elements.
技術方法: 本文提出的方法:This work presents the design and proof-of-concept validation of a monolithic, fully compliant, bistable, laparoscopic grasper that eliminates the need for multiple rigid links, thereby reducing part
Key Takeaway: The fabricated prototype demonstrates reliable bistable actuation, confirming the feasibility of such compliant laparoscopic grasper architectures.
核心發現: 核心結果:The fabricated prototype demonstrates reliable bistable actuation, confirming the feasibility of such compliant laparoscopic grasper architectures.
Inductance-Based Force Self-Sensing in Fiber-Reinforced Pneumatic Twisted-and-Coiled Actuators
Authors: Yunsong Zhang, Tianlin Li, Mingyang Yang et al. | Submitted: 2026-03-19 | arXiv: 2603.18555
Categories: cs.RO
Research Background: Fiber-reinforced pneumatic twisted-and-coiled actuators (FR-PTCAs) offer high power density and compliance but their strong hysteresis and lack of intrinsic proprioception limit effective closed-loop control. This paper presents a self-sensing FR-PTCA integrated with a conductive nickel wire that enables intrinsic force estimation and indirect displacement inference via inductance feedback.
研究背景: 在機器人學習領域,Fiber-reinforced pneumatic twisted-and-coiled actuators (FR-PTCAs) offer high power density and compliance but their strong hysteresis and lack of intrinsic proprioception limit ef
Technical Approach: This paper presents a self-sensing FR-PTCA integrated with a conductive nickel wire that enables intrinsic force estimation and indirect displacement inference via inductance feedback. Leveraging this property, this paper develops a parametric self-sensing model and a nonlinear hybrid observer that integrates an Extended Kalman Filter (EKF) with constrained optimization to resolve the ambiguity in the inductance-force mapping and estimate actuator states.
技術方法: 本文提出的方法:This paper presents a self-sensing FR-PTCA integrated with a conductive nickel wire that enables intrinsic force estimation and indirect displacement inference via inductance feedback. Leveraging this
Key Takeaway: Experimental results demonstrate that the proposed approach achieves force estimation accuracy comparable to that of external load cells and maintains robust performance under varying load conditions.
核心發現: 核心結果:Experimental results demonstrate that the proposed approach achieves force estimation accuracy comparable to that of external load cells and maintains robust performance under varying load conditions.
DriveTok: 3D Driving Scene Tokenization for Unified Multi-View Reconstruction and Understanding
Authors: Dong Zhuo, Wenzhao Zheng, Sicheng Zuo et al. | Submitted: 2026-03-19 | arXiv: 2603.19219
Categories: cs.CV, cs.LG
Research Background: With the growing adoption of vision-language-action models and world models in autonomous driving systems, scalable image tokenization becomes crucial as the interface for the visual modality. However, most existing tokenizers are designed for monocular and 2D scenes, leading to inefficiency and inter-view inconsistency when applied to high-resolution multi-view driving scenes.
研究背景: 在機器人學習領域,With the growing adoption of vision-language-action models and world models in autonomous driving systems, scalable image tokenization becomes crucial as the interface for the visu
Technical Approach: To address this, we propose DriveTok, an efficient 3D driving scene tokenizer for unified multi-view reconstruction and understanding.
技術方法: 本文提出的方法:To address this, we propose DriveTok, an efficient 3D driving scene tokenizer for unified multi-view reconstruction and understanding.
Key Takeaway: Extensive experiments on the widely used nuScenes dataset demonstrate that the scene tokens from DriveTok perform well on image reconstruction, semantic segmentation, depth prediction, and 3D occupancy prediction tasks.
核心發現: 核心結果:Extensive experiments on the widely used nuScenes dataset demonstrate that the scene tokens from DriveTok perform well on image reconstruction, semantic segmentation, depth prediction, and 3D occupanc
GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems
Authors: Xiaojian Lin, Yaomin Shen, Junyuan Ma et al. | Submitted: 2026-03-19 | arXiv: 2603.20310
Categories: cs.CV, cs.GR
Research Background: Monocular vertex-level human-scene contact prediction is a fundamental capability for interactive systems such as assistive monitoring, embodied AI, and rehabilitation analysis. In this work, we study this task jointly with single-image 3D human mesh reconstruction, using reconstructed body geometry as a scaffold for contact reasoning.
研究背景: 在機器人學習領域,Monocular vertex-level human-scene contact prediction is a fundamental capability for interactive systems such as assistive monitoring, embodied AI, and rehabilitation analysis. In
Technical Approach: To address this gap, we propose GraphiContact, a pose-aware framework that transfers complementary human priors from two pretrained Transformer encoders and predicts per-vertex human-scene contact on the reconstructed mesh.
技術方法: 本文提出的方法:To address this gap, we propose GraphiContact, a pose-aware framework that transfers complementary human priors from two pretrained Transformer encoders and predicts per-vertex human-scene contact on
Key Takeaway: Experiments on five benchmark datasets show that GraphiContact achieves consistent gains on both contact prediction and 3D human reconstruction.
核心發現: 核心結果:Experiments on five benchmark datasets show that GraphiContact achieves consistent gains on both contact prediction and 3D human reconstruction.
NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Data
Authors: Daniel DeTone, Federica Bogo, Eric-Tuan Le et al. | Submitted: 2026-03-19 | arXiv: 2603.18496
Categories: cs.CV
Research Background: The Nymeria Dataset, released in 2024, is a large-scale collection of in-the-wild human activities captured with multiple egocentric wearable devices that are spatially localized and temporally synchronized. It provides body-motion ground truth recorded with a motion-capture suit, device trajectories, semi-dense 3D point clouds, and in-context narrations.
研究背景: 在機器人學習領域,The Nymeria Dataset, released in 2024, is a large-scale collection of in-the-wild human activities captured with multiple egocentric wearable devices that are spatially localized a
Technical Approach: In this paper, we upgrade Nymeria and introduce NymeriaPlus.
技術方法: 本文提出的方法:In this paper, we upgrade Nymeria and introduce NymeriaPlus.
Key Takeaway: We expect NymeriaPlus to bridge a key gap in existing egocentric resources and to support a broader range of research, including unique explorations of multimodal learning for embodied AI.
核心發現: 核心結果:We expect NymeriaPlus to bridge a key gap in existing egocentric resources and to support a broader range of research, including unique explorations of multimodal learning for embodied AI.
An Open Source Computer Vision and Machine Learning Framework for Affordable Life Science Robotic Automation
Authors: Zachary Logan, Andrew Dudash, Daniel Negrón | Submitted: 2026-03-20 | arXiv: 2603.20465
Categories: cs.RO
Research Background: We present an open-source robotic framework that integrates computer vision and machine learning based inverse kinematics to enable low-cost laboratory automation tasks such as colony picking and liquid handling. The system uses a custom trained U-net model for semantic segmentation of microbial cultures, combined with Mixture Density Network for predicating joint angles of a simple 5-DOF robot arm.
研究背景: 在機器人學習領域,We present an open-source robotic framework that integrates computer vision and machine learning based inverse kinematics to enable low-cost laboratory automation tasks such as col
Technical Approach: We present an open-source robotic framework that integrates computer vision and machine learning based inverse kinematics to enable low-cost laboratory automation tasks such as colony picking and liquid handling.
技術方法: 本文提出的方法:We present an open-source robotic framework that integrates computer vision and machine learning based inverse kinematics to enable low-cost laboratory automation tasks such as colony picking and liqu
Key Takeaway: Experimental results demonstrate the framework’s feasibility for precise, repeatable operations, with mean positional error below 1 mm and joint angle prediction errors below 4 degrees and colony detection capabilities with IoU score of 0.537 and Dice coefficient of 0.596.
核心發現: 核心結果:Experimental results demonstrate the framework’s feasibility for precise, repeatable operations, with mean positional error below 1 mm and joint angle prediction errors below 4 degrees and colony dete
The Robot’s Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanning
Authors: Jiyu Lim, Youngwoo Yoon, Kwanghyun Park | Submitted: 2026-03-20 | arXiv: 2603.20164
Categories: cs.RO, cs.AI
Research Background: Conventional robot social behavior generation has been limited in flexibility and autonomy, relying on predefined motions or human feedback. This study proposes CRISP (Critique-and-Replan for Interactive Social Presence), an autonomous framework where a robot critiques and replans its own actions by leveraging a Vision-Language Model (VLM) as a `human-like social critic.’ CRISP integrates (1) extraction of movable joints and constraints by analyzing the robot’s description file (e.g., MJCF), (2) generation of step-by-step behavior plans based on situational context, (3) generation of low-level joint control code by referencing visual information (joint range-of-motion visualizations), (4) VLM-based evaluation of social appropriateness and naturalness, including pinpointing erroneous steps, and (5) iterative refinement of behaviors through reward-based search.
研究背景: 在機器人學習領域,Conventional robot social behavior generation has been limited in flexibility and autonomy, relying on predefined motions or human feedback. This study proposes CRISP (Critique-and
Technical Approach: This study proposes CRISP (Critique-and-Replan for Interactive Social Presence), an autonomous framework where a robot critiques and replans its own actions by leveraging a Vision-Language Model (VLM) as a `human-like social critic.’ CRISP integrates (1) extraction of movable joints and constraints by analyzing the robot’s description file (e.g., MJCF), (2) generation of step-by-step behavior plans based on situational context, (3) generation of low-level joint control code by referencing visual information (joint range-of-motion visualizations), (4) VLM-based evaluation of social appropriateness and naturalness, including pinpointing erroneous steps, and (5) iterative refinement of behaviors through reward-based search. This approach is not tied to a specific robot API; it can generate subtly different, human-like motions on various platforms using only the robot’s structure file. In a user study involving five different robot types and 20 scenarios, including mobile manipulators and humanoids, our proposed method achieved significantly higher preference and situational appropriateness ratings compared to previous methods.
技術方法: 本文提出的方法:This study proposes CRISP (Critique-and-Replan for Interactive Social Presence), an autonomous framework where a robot critiques and replans its own actions by leveraging a Vision-Language Model (VLM)
Key Takeaway: In a user study involving five different robot types and 20 scenarios, including mobile manipulators and humanoids, our proposed method achieved significantly higher preference and situational appropriateness ratings compared to previous methods.
核心發現: 核心結果:In a user study involving five different robot types and 20 scenarios, including mobile manipulators and humanoids, our proposed method achieved significantly higher preference and situational appropr
Real-Time Structural Detection for Indoor Navigation from 3D LiDAR Using Bird’s-Eye-View Images
Authors: Guanliang Li, Pedro Espinosa-Angulo, David Perez-Saura et al. | Submitted: 2026-03-20 | arXiv: 2603.19830
Categories: cs.RO
Research Background: Efficient structural perception is essential for mapping and autonomous navigation on resource-constrained robots. Existing 3D methods are computationally prohibitive, while traditional 2D geometric approaches lack robustness.
研究背景: 在機器人學習領域,Efficient structural perception is essential for mapping and autonomous navigation on resource-constrained robots. Existing 3D methods are computationally prohibitive, while tradit
Technical Approach: This paper presents a lightweight, real-time framework that projects 3D LiDAR data into 2D Bird’s-Eye-View (BEV) images to enable efficient detection of structural elements relevant to mapping and navigation.
技術方法: 本文提出的方法:This paper presents a lightweight, real-time framework that projects 3D LiDAR data into 2D Bird’s-Eye-View (BEV) images to enable efficient detection of structural elements relevant to mapping and nav
Key Takeaway: In contrast, the YOLO-OBB-based approach achieves the best balance between robustness and computational efficiency, maintaining an end-to-end latency (satisfying 10 Hz operation) while effectively filtering cluttered observations in a low-power single-board computer (SBC) without using GPU acceleration.
核心發現: 核心結果:In contrast, the YOLO-OBB-based approach achieves the best balance between robustness and computational efficiency, maintaining an end-to-end latency (satisfying 10 Hz operation) while effectively fil
Semantic Audio-Visual Navigation in Continuous Environments
Authors: Yichen Zeng, Hebaixu Wang, Meng Liu et al. | Submitted: 2026-03-20 | arXiv: 2603.19660
Categories: cs.CV, cs.SD
Research Background: Audio-visual navigation enables embodied agents to navigate toward sound-emitting targets by leveraging both auditory and visual cues. However, most existing approaches rely on precomputed room impulse responses (RIRs) for binaural audio rendering, restricting agents to discrete grid positions and leading to spatially discontinuous observations.
研究背景: 在機器人學習領域,Audio-visual navigation enables embodied agents to navigate toward sound-emitting targets by leveraging both auditory and visual cues. However, most existing approaches rely on pre
Technical Approach: To establish a more realistic setting, we introduce Semantic Audio-Visual Navigation in Continuous Environments (SAVN-CE), where agents can move freely in 3D spaces and perceive temporally and spatially coherent audio-visual streams. To tackle this challenge, we propose MAGNet, a multimodal transformer-based model that jointly encodes spatial and semantic goal representations and integrates historical context with self-motion cues to enable memory-augmented goal reasoning.
技術方法: 本文提出的方法:To establish a more realistic setting, we introduce Semantic Audio-Visual Navigation in Continuous Environments (SAVN-CE), where agents can move freely in 3D spaces and perceive temporally and spatial
Key Takeaway: These results also highlight its robustness to short-duration sounds and long-distance navigation scenarios.
核心發現: 核心結果:These results also highlight its robustness to short-duration sounds and long-distance navigation scenarios.
Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning
Authors: Qin Zhang, Peiyu Jing, Hong-Xing Yu et al. | Submitted: 2026-03-20 | arXiv: 2603.19607
Categories: cs.CV
Research Background: Video generation models are increasingly used as world simulators for storytelling, simulation, and embodied AI. As these models advance, a key question arises: do generated videos obey the physical laws of the real world?
研究背景: 在機器人學習領域,Video generation models are increasingly used as world simulators for storytelling, simulation, and embodied AI. As these models advance, a key question arises: do generated videos
Technical Approach: We introduce Physion-Eval, a large-scale benchmark of expert human reasoning for diagnosing physical realism failures in videos generated by five state-of-the-art models across egocentric and exocentric views, containing 10,990 expert reasoning traces spanning 22 fine-grained physical categories.
技術方法: 本文提出的方法:We introduce Physion-Eval, a large-scale benchmark of expert human reasoning for diagnosing physical realism failures in videos generated by five state-of-the-art models across egocentric and exocentr
Key Takeaway: We hope Physion-Eval will set a new standard for physical realism evaluation and guide the development of physics-grounded video generation.
核心發現: 核心結果:We hope Physion-Eval will set a new standard for physical realism evaluation and guide the development of physics-grounded video generation.
Characterizing the onset and offset of motor imagery during passive arm movements induced by an upper-body exoskeleton
Authors: Kanishka Mitra, Frigyes Samuel Racz, Satyam Kumar et al. | Submitted: 2026-03-21 | arXiv: 2603.20885
Categories: cs.RO, cs.AI, cs.HC
Research Background: Two distinct technologies have gained attention lately due to their prospects for motor rehabilitation: robotics and brain-machine interfaces (BMIs). Harnessing their combined efforts is a largely uncharted and promising direction that has immense clinical potential.
研究背景: 在機器人學習領域,Two distinct technologies have gained attention lately due to their prospects for motor rehabilitation: robotics and brain-machine interfaces (BMIs). Harnessing their combined effo
Technical Approach: Our approach showed that participants could produce quality and reliable sensorimotor rhythms regardless of noise or passive arm movements induced by wearing the exoskeleton, which opens new possibilities for BMI control of assistive devices.
技術方法: 本文提出的方法:Our approach showed that participants could produce quality and reliable sensorimotor rhythms regardless of noise or passive arm movements induced by wearing the exoskeleton, which opens new possibili
Key Takeaway: Furthermore, pseudo-online evaluation could replicate this performance, forecasting reliable online exoskeleton control in the future.
核心發現: 核心結果:Furthermore, pseudo-online evaluation could replicate this performance, forecasting reliable online exoskeleton control in the future.
Enhancing Vision-Based Policies with Omni-View and Cross-Modality Knowledge Distillation for Mobile Robots
Authors: Kai Li, Shiyu Zhao | Submitted: 2026-03-21 | arXiv: 2603.20679
Categories: cs.RO
Research Background: Vision-based policies are widely applied in robotics for tasks such as manipulation and locomotion. On lightweight mobile robots, however, they face a trilemma of limited scene transferability, restricted onboard computation resources, and sensor hardware cost.
研究背景: 在機器人學習領域,Vision-based policies are widely applied in robotics for tasks such as manipulation and locomotion. On lightweight mobile robots, however, they face a trilemma of limited scene tra
Technical Approach: To address these issues, we propose a knowledge distillation approach that transfers knowledge from an information-rich, appearance invariant omniview depth policy to a lightweight monocular policy. Real world experiments further validate the effectiveness and practicality of our approach.
技術方法: 本文提出的方法:To address these issues, we propose a knowledge distillation approach that transfers knowledge from an information-rich, appearance invariant omniview depth policy to a lightweight monocular policy. R
Key Takeaway: Real world experiments further validate the effectiveness and practicality of our approach.
核心發現: 核心結果:Real world experiments further validate the effectiveness and practicality of our approach.
E-SocialNav: Efficient Socially Compliant Navigation with Language Models
Authors: Ling Xiao, Daeun Song, Xuesu Xiao et al. | Submitted: 2026-03-21 | arXiv: 2603.20664
Categories: cs.RO
Research Background: Language models (LMs) are increasingly applied to robotic navigation; however, existing benchmarks primarily emphasize navigation success rates while paying limited attention to social compliance. Moreover, relying on large-scale LMs can raise efficiency concerns, as their heavy computational overhead leads to slower response times and higher energy consumption, making them impractical for real-time deployment on resource-constrained robotic platforms.
研究背景: 在機器人學習領域,Language models (LMs) are increasingly applied to robotic navigation; however, existing benchmarks primarily emphasize navigation success rates while paying limited attention to so
Technical Approach: Moreover, relying on large-scale LMs can raise efficiency concerns, as their heavy computational overhead leads to slower response times and higher energy consumption, making them impractical for real-time deployment on resource-constrained robotic platforms. In this work, we evaluate the social compliance of GPT-4o and Claude in robotic navigation and propose E-SocialNav, an efficient LM designed for socially compliant navigation. Despite being trained on a relatively small dataset, E-SocialNav consistently outperforms zero-shot baselines in generating socially compliant behaviors.
技術方法: 本文提出的方法:Moreover, relying on large-scale LMs can raise efficiency concerns, as their heavy computational overhead leads to slower response times and higher energy consumption, making them impractical for real
Key Takeaway: By employing a two-stage training pipeline consisting of supervised fine-tuning followed by direct preference optimization, E-SocialNav achieves strong performance in both text-level semantic similarity to human annotations and action accuracy.
核心發現: 核心結果:By employing a two-stage training pipeline consisting of supervised fine-tuning followed by direct preference optimization, E-SocialNav achieves strong performance in both text-level semantic similari
Motion as a Sensing Modality for Metric Scale in Monocular Visual-Inertial Odometry
Authors: Hadush Hailu, Bruk Gebregziabher | Submitted: 2026-03-22 | arXiv: 2603.26740
Categories: cs.RO
Research Background: Monocular visual-inertial odometry (VIO) cannot recover metric scale from vision alone; scale must be resolved through inertial measurements. We present a trajectory-dependent observability analysis showing that translational acceleration, produced by curvature, not constant-speed straight-line travel, is the fundamental source that couples scale to the inertial state.
研究背景: 在機器人學習領域,Monocular visual-inertial odometry (VIO) cannot recover metric scale from vision alone; scale must be resolved through inertial measurements. We present a trajectory-dependent obse
Technical Approach: We present a trajectory-dependent observability analysis showing that translational acceleration, produced by curvature, not constant-speed straight-line travel, is the fundamental source that couples scale to the inertial state.
技術方法: 本文提出的方法:We present a trajectory-dependent observability analysis showing that translational acceleration, produced by curvature, not constant-speed straight-line travel, is the fundamental source that couples
Key Takeaway: These results establish trajectory design as a practical mechanism for improving metric scale recovery.
核心發現: 核心結果:These results establish trajectory design as a practical mechanism for improving metric scale recovery.
Evaluating Factor-Wise Auxiliary Dynamics Supervision for Latent Structure and Robustness in Simulated Humanoid Locomotion
Authors: Chayanin Chamachot | Submitted: 2026-03-22 | arXiv: 2603.21268
Categories: cs.RO
Research Background: We evaluate whether factor-wise auxiliary dynamics supervision produces useful latent structure or improved robustness in simulated humanoid locomotion. DynaMITE — a transformer encoder with a factored 24-d latent trained by per-factor auxiliary losses during proximal policy optimization (PPO) — is compared against Long Short-Term Memory (LSTM), plain Transformer, and Multilayer Perceptron (MLP) baselines on a Unitree G1 humanoid across four Isaac Lab tasks.
研究背景: 在機器人學習領域,We evaluate whether factor-wise auxiliary dynamics supervision produces useful latent structure or improved robustness in simulated humanoid locomotion. DynaMITE — a transformer e
Technical Approach: DynaMITE — a transformer encoder with a factored 24-d latent trained by per-factor auxiliary losses during proximal policy optimization (PPO) — is compared against Long Short-Term Memory (LSTM), plain Transformer, and Multilayer Perceptron (MLP) baselines on a Unitree G1 humanoid across four Isaac Lab tasks. The supervised latent shows no evidence of decodable or functionally separable factor structure: probe R^2 ~ 0 for all five dynamics factors, clamping any subspace changes reward by < 0.05, and standard disentanglement metrics (MIG, DCI, SAP) are near zero. An unsupervised LSTM hidden state achieves higher probe R^2 (up to 0.10).
技術方法: 本文提出的方法:DynaMITE — a transformer encoder with a factored 24-d latent trained by per-factor auxiliary losses during proximal policy optimization (PPO) — is compared against Long Short-Term Memory (LSTM), pla
Key Takeaway: LSTM achieves the best nominal reward on all four tasks (p < 0.03); DynaMITE degrades less under combined-shift stress (2.3% vs. 16.7%), but this difference is attributable to the bottleneck compression, not the auxiliary supervision.
核心發現: 核心結果:LSTM achieves the best nominal reward on all four tasks (p < 0.03); DynaMITE degrades less under combined-shift stress (2.3% vs. 16.7%), but this difference is attributable to the bottleneck compressi
Dynamic Control Barrier Function Regulation with Vision-Language Models for Safe, Adaptive, and Realtime Visual Navigation
Authors: Jeffrey Chen, Rohan Chandra | Submitted: 2026-03-22 | arXiv: 2603.21142
Categories: cs.RO
Research Background: Robots operating in dynamic, unstructured environments must balance safety and efficiency under potentially limited sensing. While control barrier functions (CBFs) provide principled collision avoidance via safety filtering, their behavior is often governed by fixed parameters that can be overly conservative in benign scenes or overly permissive near hazards.
研究背景: 在機器人學習領域,Robots operating in dynamic, unstructured environments must balance safety and efficiency under potentially limited sensing. While control barrier functions (CBFs) provide principl
Technical Approach: We present AlphaAdj, a vision-to-control navigation framework that uses egocentric RGB input to adapt the conservativeness of a CBF safety filter in real time.
技術方法: 本文提出的方法:We present AlphaAdj, a vision-to-control navigation framework that uses egocentric RGB input to adapt the conservativeness of a CBF safety filter in real time.
Key Takeaway: Results show that AlphaAdj maintains collision-free navigation while improving efficiency (in terms of path length and time to goal) by up to 18.5% relative to fixed settings and improving robustness and success rate relative to an uncapped baseline.
核心發現: 核心結果:Results show that AlphaAdj maintains collision-free navigation while improving efficiency (in terms of path length and time to goal) by up to 18.5% relative to fixed settings and improving robustness