arXiv Weekly Digest — Week 10, 2026
Fetched: 2026-03-08 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 256
UniLACT: Depth-Aware RGB Latent Action Learning for Vision-Language-Action Models
Authors: Manish Kumar Govind, Dominick Reilly, Pu Wang et al. | Submitted: 2026-02-23 | arXiv: 2602.20231
Categories: cs.RO, cs.CV
Research Background: Latent action representations learned from unlabeled videos have recently emerged as a promising paradigm for pretraining vision-language-action (VLA) models without explicit robot action supervision. However, latent actions derived solely from RGB observations primarily encode appearance-driven dynamics and lack explicit 3D geometric structure, which is essential for precise and contact-rich manipulation.
研究背景: 在機器人學習領域,Latent action representations learned from unlabeled videos have recently emerged as a promising paradigm for pretraining vision-language-action (VLA) models without explicit robot
Technical Approach: To address this limitation, we introduce UniLACT, a transformer-based VLA model that incorporates geometric structure through depth-aware latent pretraining, enabling downstream policies to inherit stronger spatial priors. To facilitate this process, we propose UniLARN, a unified latent action learning framework based on inverse and forward dynamics objectives that learns a shared embedding space for RGB and depth while explicitly modeling their cross-modal interactions.
技術方法: 本文提出的方法:To address this limitation, we introduce UniLACT, a transformer-based VLA model that incorporates geometric structure through depth-aware latent pretraining, enabling downstream policies to inherit st
Key Takeaway: UniLACT consistently outperforms RGB-based latent action baselines under in-domain and out-of-domain pretraining regimes, as well as on both seen and unseen manipulation tasks.The project page is at https://manishgovind.github.io/unilact-vla/
核心發現: 核心結果:UniLACT consistently outperforms RGB-based latent action baselines under in-domain and out-of-domain pretraining regimes, as well as on both seen and unseen manipulation tasks.The project page is at h
AdaWorldPolicy: World-Model-Driven Diffusion Policy with Online Adaptive Learning for Robotic Manipulation
Authors: Ge Yuan, Qiyuan Qiao, Jing Zhang et al. | Submitted: 2026-02-23 | arXiv: 2602.20057
Categories: cs.RO, cs.AI
Research Background: Effective robotic manipulation requires policies that can anticipate physical outcomes and adapt to real-world environments. Effective robotic manipulation requires policies that can anticipate physical outcomes and adapt to real-world environments.
研究背景: 在機器人學習領域,Effective robotic manipulation requires policies that can anticipate physical outcomes and adapt to real-world environments. Effective robotic manipulation requires policies that c
Technical Approach: In this work, we introduce a unified framework, World-Model-Driven Diffusion Policy with Online Adaptive Learning (AdaWorldPolicy) to enhance robotic manipulation under dynamic conditions with minimal human involvement.
技術方法: 本文提出的方法:In this work, we introduce a unified framework, World-Model-Driven Diffusion Policy with Online Adaptive Learning (AdaWorldPolicy) to enhance robotic manipulation under dynamic conditions with minimal
Key Takeaway: Across a suite of simulated and real-robot benchmarks, our AdaWorldPolicy achieves state-of-the-art performance, with dynamical adaptive capacity to out-of-distribution scenarios.
核心發現: 核心結果:Across a suite of simulated and real-robot benchmarks, our AdaWorldPolicy achieves state-of-the-art performance, with dynamical adaptive capacity to out-of-distribution scenarios.
TactiVerse: Generalizing Multi-Point Tactile Sensing in Soft Robotics Using Single-Point Data
Authors: Junhui Lee, Hyosung Kim, Saekwang Nam | Submitted: 2026-02-23 | arXiv: 2602.19850
Categories: cs.RO
Research Background: Real-time prediction of deformation in highly compliant soft materials remains a significant challenge in soft robotics. While vision-based soft tactile sensors can track internal marker displacements, learning-based models for 3D contact estimation heavily depend on their training datasets, inherently limiting their ability to generalize to complex scenarios such as multi-point sensing.
研究背景: 在機器人學習領域,Real-time prediction of deformation in highly compliant soft materials remains a significant challenge in soft robotics. While vision-based soft tactile sensors can track internal
Technical Approach: To address this limitation, we introduce TactiVerse, a U-Net-based framework that formulates contact geometry estimation as a spatial heatmap prediction task.
技術方法: 本文提出的方法:To address this limitation, we introduce TactiVerse, a U-Net-based framework that formulates contact geometry estimation as a spatial heatmap prediction task.
Key Takeaway: Furthermore, we demonstrate that augmenting the training dataset with multi-point contact data substantially enhances the sensor’s multi-point sensing capabilities, significantly improving the overall mean MAE for two-point discrimination from 1.214 mm to 0.383 mm.
核心發現: 核心結果:Furthermore, we demonstrate that augmenting the training dataset with multi-point contact data substantially enhances the sensor’s multi-point sensing capabilities, significantly improving the overall
Universal Pose Pretraining for Generalizable Vision-Language-Action Policies
Authors: Haitao Lin, Hanyang Yu, Jingshun Huang et al. | Submitted: 2026-02-23 | arXiv: 2602.19710
Categories: cs.CV, cs.LG, cs.RO
Research Background: Existing Vision-Language-Action (VLA) models often suffer from feature collapse and low training efficiency because they entangle high-level perception with sparse, embodiment-specific action supervision. Since these models typically rely on VLM backbones optimized for Visual Question Answering (VQA), they excel at semantic identification but often overlook subtle 3D state variations that dictate distinct action patterns.
研究背景: 在機器人學習領域,Existing Vision-Language-Action (VLA) models often suffer from feature collapse and low training efficiency because they entangle high-level perception with sparse, embodiment-spec
Technical Approach: To resolve these misalignments, we propose Pose-VLA, a decoupled paradigm that separates VLA training into a pre-training phase for extracting universal 3D spatial priors in a unified camera-centric space, and a post-training phase for efficient embodiment alignment within robot-specific action space. Our framework follows a two-stage pre-training pipeline, establishing fundamental spatial grounding via poses followed by motion alignment through trajectory supervision.
技術方法: 本文提出的方法:To resolve these misalignments, we propose Pose-VLA, a decoupled paradigm that separates VLA training into a pre-training phase for extracting universal 3D spatial priors in a unified camera-centric s
Key Takeaway: Real-world experiments further showcase robust generalization across diverse objects using only 100 demonstrations per task, validating the efficiency of our pre-training paradigm.
核心發現: 核心結果:Real-world experiments further showcase robust generalization across diverse objects using only 100 demonstrations per task, validating the efficiency of our pre-training paradigm.
An Approach to Combining Video and Speech with Large Language Models in Human-Robot Interaction
Authors: Guanting Shen, Zi Tian | Submitted: 2026-02-23 | arXiv: 2602.20219
Categories: cs.RO, cs.AI
Research Background: Interpreting human intent accurately is a central challenge in human-robot interaction (HRI) and a key requirement for achieving more natural and intuitive collaboration between humans and machines. This work presents a novel multimodal HRI framework that combines advanced vision-language models, speech processing, and fuzzy logic to enable precise and adaptive control of a Dobot Magician robotic arm.
研究背景: 在機器人學習領域,Interpreting human intent accurately is a central challenge in human-robot interaction (HRI) and a key requirement for achieving more natural and intuitive collaboration between hu
Technical Approach: This work presents a novel multimodal HRI framework that combines advanced vision-language models, speech processing, and fuzzy logic to enable precise and adaptive control of a Dobot Magician robotic arm. The proposed system integrates Florence-2 for object detection, Llama 3.1 for natural language understanding, and Whisper for speech recognition, providing users with a seamless and intuitive interface for object manipulation through spoken commands. By jointly addressing scene perception and action planning, the approach enhances the reliability of command interpretation and execution.
技術方法: 本文提出的方法:This work presents a novel multimodal HRI framework that combines advanced vision-language models, speech processing, and fuzzy logic to enable precise and adaptive control of a Dobot Magician robotic
Key Takeaway: Experimental evaluations conducted on consumer-grade hardware demonstrate a command execution accuracy of 75%, highlighting both the robustness and adaptability of the system.
核心發現: 核心結果:Experimental evaluations conducted on consumer-grade hardware demonstrate a command execution accuracy of 75%, highlighting both the robustness and adaptability of the system.
Botson: An Accessible and Low-Cost Platform for Social Robotics Research
Authors: Samuel Bellaire, Abdalmalek Abu-raddaha, Natalie Kim et al. | Submitted: 2026-02-23 | arXiv: 2602.19491
Categories: cs.RO, cs.AI, cs.HC
Research Background: Trust remains a critical barrier to the effective integration of Artificial Intelligence (AI) into human-centric domains. Disembodied agents, such as voice assistants, often fail to establish trust due to their inability to convey non-verbal social cues.
研究背景: 在機器人學習領域,Trust remains a critical barrier to the effective integration of Artificial Intelligence (AI) into human-centric domains. Disembodied agents, such as voice assistants, often fail t
Technical Approach: This paper introduces the architecture of Botson: an anthropomorphic social robot powered by a large language model (LLM).
技術方法: 本文提出的方法:This paper introduces the architecture of Botson: an anthropomorphic social robot powered by a large language model (LLM).
Key Takeaway: Botson was created as a low-cost and accessible platform for social robotics research.
核心發現: 核心結果:Botson was created as a low-cost and accessible platform for social robotics research.
QuantVLA: Scale-Calibrated Post-Training Quantization for Vision-Language-Action Models
Authors: Jingxuan Zhang, Yunta Hsieh, Zhongwei Wan et al. | Submitted: 2026-02-23 | arXiv: 2602.20309
Categories: cs.LG
Research Background: Vision-language-action (VLA) models unify perception, language, and control for embodied agents but face significant challenges in practical deployment due to rapidly increasing compute and memory demands, especially as models scale to longer horizons and larger backbones. To address these bottlenecks, we introduce QuantVLA, a training-free post-training quantization (PTQ) framework that, to our knowledge, is the first PTQ approach for VLA systems and the first to successfully quantize a diffusion transformer (DiT) action head.
研究背景: 在機器人學習領域,Vision-language-action (VLA) models unify perception, language, and control for embodied agents but face significant challenges in practical deployment due to rapidly increasing co
Technical Approach: To address these bottlenecks, we introduce QuantVLA, a training-free post-training quantization (PTQ) framework that, to our knowledge, is the first PTQ approach for VLA systems and the first to successfully quantize a diffusion transformer (DiT) action head.
技術方法: 本文提出的方法:To address these bottlenecks, we introduce QuantVLA, a training-free post-training quantization (PTQ) framework that, to our knowledge, is the first PTQ approach for VLA systems and the first to succe
Key Takeaway: Across representative VLA models on LIBERO, QuantVLA exceeds the task success rates of full-precision baselines, achieves about 70% relative memory savings on the quantized components, providing a practical pathway toward scalable low-bit embodied intelligence under strict compute, memory, and power constraints.
核心發現: 核心結果:Across representative VLA models on LIBERO, QuantVLA exceeds the task success rates of full-precision baselines, achieves about 70% relative memory savings on the quantized components, providing a pra
Beyond Mimicry: Toward Lifelong Adaptability in Imitation Learning
Authors: Nathan Gavenski, Felipe Meneguzzi, Odinaldo Rodrigues | Submitted: 2026-02-23 | arXiv: 2602.19930
Categories: cs.AI, cs.LG
Research Background: Imitation learning stands at a crossroads: despite decades of progress, current imitation learning agents remain sophisticated memorisation machines, excelling at replay but failing when contexts shift or goals evolve. This paper argues that this failure is not technical but foundational: imitation learning has been optimised for the wrong objective.
研究背景: 在機器人學習領域,Imitation learning stands at a crossroads: despite decades of progress, current imitation learning agents remain sophisticated memorisation machines, excelling at replay but failin
Technical Approach: This paper argues that this failure is not technical but foundational: imitation learning has been optimised for the wrong objective. We propose a research agenda that redefines success from perfect replay to compositional adaptability.
技術方法: 本文提出的方法:This paper argues that this failure is not technical but foundational: imitation learning has been optimised for the wrong objective. We propose a research agenda that redefines success from perfect r
Key Takeaway: Agents that embed adaptability at the core of imitation learning thus have an essential capability for operating in an open-ended world.
核心發現: 核心結果:Agents that embed adaptability at the core of imitation learning thus have an essential capability for operating in an open-ended world.
HALO: A Unified Vision-Language-Action Model for Embodied Multimodal Chain-of-Thought Reasoning
Authors: Quanxin Shou, Fangqi Zhu, Shawn Chen et al. | Submitted: 2026-02-24 | arXiv: 2602.21157
Categories: cs.RO
Research Background: Vision-Language-Action (VLA) models have shown strong performance in robotic manipulation, but often struggle in long-horizon or out-of-distribution scenarios due to the lack of explicit mechanisms for multimodal reasoning and anticipating how the world will evolve under action. Recent works introduce textual chain-of-thought or visual subgoal prediction within VLA models to reason, but still fail to offer a unified human-like reasoning framework for joint textual reasoning, visual foresight, and action prediction.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have shown strong performance in robotic manipulation, but often struggle in long-horizon or out-of-distribution scenarios due to the lack of ex
Technical Approach: To this end, we propose HALO, a unified VLA model that enables embodied multimodal chain-of-thought (EM-CoT) reasoning through a sequential process of textual task reasoning, visual subgoal prediction for fine-grained guidance, and EM-CoT-augmented action prediction. To enable HALO learning at scale, we introduce an automated pipeline to synthesize EM-CoT training data along with a carefully crafted training recipe.
技術方法: 本文提出的方法:To this end, we propose HALO, a unified VLA model that enables embodied multimodal chain-of-thought (EM-CoT) reasoning through a sequential process of textual task reasoning, visual subgoal prediction
Key Takeaway: Extensive experiments demonstrate that: (1) HALO achieves superior performance in both simulated and real-world environments, surpassing baseline policy pi_0 by 34.1% on RoboTwin benchmark; (2) all proposed components of the training recipe and EM-CoT design help improve task success rate; and (3) HALO exhibits strong generalization capabilities under aggressive unseen environmental randomization with our proposed EM-CoT reasoning.
核心發現: 核心結果:Extensive experiments demonstrate that: (1) HALO achieves superior performance in both simulated and real-world environments, surpassing baseline policy pi_0 by 34.1% on RoboTwin benchmark; (2) all pr
Notes-to-Self: Scratchpad Augmented VLAs for Memory Dependent Manipulation Tasks
Authors: Sanjay Haresh, Daniel Dijkman, Apratim Bhattacharyya et al. | Submitted: 2026-02-24 | arXiv: 2602.21013
Categories: cs.RO
Research Background: Many dexterous manipulation tasks are non-markovian in nature, yet little attention has been paid to this fact in the recent upsurge of the vision-language-action (VLA) paradigm. Although they are successful in bringing internet-scale semantic understanding to robotics, existing VLAs are primarily “stateless” and struggle with memory-dependent long horizon tasks.
研究背景: 在機器人學習領域,Many dexterous manipulation tasks are non-markovian in nature, yet little attention has been paid to this fact in the recent upsurge of the vision-language-action (VLA) paradigm. A
Technical Approach: Although they are successful in bringing internet-scale semantic understanding to robotics, existing VLAs are primarily “stateless” and struggle with memory-dependent long horizon tasks. In this work, we explore a way to impart both spatial and temporal memory to a VLA by incorporating a language scratchpad. The scratchpad makes it possible to memorize task-specific information, such as object positions, and it allows the model to keep track of a plan and progress towards subgoals within that plan.
技術方法: 本文提出的方法:Although they are successful in bringing internet-scale semantic understanding to robotics, existing VLAs are primarily “stateless” and struggle with memory-dependent long horizon tasks. In this work,
Key Takeaway: We show that incorporating a language scratchpad significantly improves generalization on these tasks for both non-recurrent and recurrent models.
核心發現: 核心結果:We show that incorporating a language scratchpad significantly improves generalization on these tasks for both non-recurrent and recurrent models.
KCFRC: Kinematic Collision-Aware Foothold Reachability Criteria for Legged Locomotion
Authors: Lei Ye, Haibo Gao, Huaiguang Yang et al. | Submitted: 2026-02-24 | arXiv: 2602.20850
Categories: cs.RO
Research Background: Legged robots face significant challenges in navigating complex environments, as they require precise real-time decisions for foothold selection and contact planning. While existing research has explored methods to select footholds based on terrain geometry or kinematics, a critical gap remains: few existing methods efficiently validate the existence of a non-collision swing trajectory.
研究背景: 在機器人學習領域,Legged robots face significant challenges in navigating complex environments, as they require precise real-time decisions for foothold selection and contact planning. While existin
Technical Approach: This paper addresses this gap by introducing KCFRC, a novel approach for efficient foothold reachability analysis. Based on this condition, we develop the KCFRC algorithm, which enables robots to validate foothold reachability in real time.
技術方法: 本文提出的方法:This paper addresses this gap by introducing KCFRC, a novel approach for efficient foothold reachability analysis. Based on this condition, we develop the KCFRC algorithm, which enables robots to vali
Key Takeaway: Furthermore, we show that KCFRC can accelerate trajectory optimization and is particularly beneficial for contact planning in confined spaces, enhancing the adaptability and robustness of legged robots in challenging environments.
核心發現: 核心結果:Furthermore, we show that KCFRC can accelerate trajectory optimization and is particularly beneficial for contact planning in confined spaces, enhancing the adaptability and robustness of legged robot
IG-RFT: An Interaction-Guided RL Framework for VLA Models in Long-Horizon Robotic Manipulation
Authors: Zhian Su, Weijie Kong, Haonan Dong et al. | Submitted: 2026-02-24 | arXiv: 2602.20715
Categories: cs.RO
Research Background: Vision-Language-Action (VLA) models have demonstrated significant potential for generalist robotic policies; however, they struggle to generalize to long-horizon complex tasks in novel real-world domains due to distribution shifts and the scarcity of high-quality demonstrations. Although reinforcement learning (RL) offers a promising avenue for policy improvement, applying it to real-world VLA fine-tuning faces challenges regarding exploration efficiency, training stability, and sample cost.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have demonstrated significant potential for generalist robotic policies; however, they struggle to generalize to long-horizon complex tasks in n
Technical Approach: To address these issues, we propose IG-RFT, a novel Interaction-Guided Reinforced Fine-Tuning system designed for flow-based VLA models. Firstly, to facilitate effective policy optimization, we introduce Interaction-Guided Advantage Weighted Regression (IG-AWR), an RL algorithm that dynamically modulates exploration intensity based on the robot’s interaction status. Furthermore, to address the limitations of sparse or task-specific rewards, we design a novel hybrid dense reward function that integrates the trajectory-level reward and the subtask-level reward.
技術方法: 本文提出的方法:To address these issues, we propose IG-RFT, a novel Interaction-Guided Reinforced Fine-Tuning system designed for flow-based VLA models. Firstly, to facilitate effective policy optimization, we introd
Key Takeaway: Extensive real-world experiments on four challenging long-horizon tasks demonstrate that IG-RFT achieves an average success rate of 85.0%, significantly outperforming SFT (18.8%) and standard Offline RL baselines (40.0%).
核心發現: 核心結果:Extensive real-world experiments on four challenging long-horizon tasks demonstrate that IG-RFT achieves an average success rate of 85.0%, significantly outperforming SFT (18.8%) and standard Offline
BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action Model
Authors: Haosheng Li, Weixin Mao, Zihan Lan et al. | Submitted: 2026-02-24 | arXiv: 2602.20566
Categories: cs.RO, cs.CV
Research Background: Vision-Language-Action (VLA) models have achieved significant breakthroughs by leveraging Large Vision Language Models (VLMs) to jointly interpret instructions and visual inputs. However, the substantial increase in visual tokens, particularly from multi-view inputs, poses serious challenges to real-time robotic manipulation.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have achieved significant breakthroughs by leveraging Large Vision Language Models (VLMs) to jointly interpret instructions and visual inputs. H
Technical Approach: To address this, we propose BFA++, a dynamic token pruning framework designed specifically for VLA models.
技術方法: 本文提出的方法:To address this, we propose BFA++, a dynamic token pruning framework designed specifically for VLA models.
Key Takeaway: Our results highlight that context-sensitive and task-aware token pruning serves as a more effective strategy than full visual processing, enabling faster inference and improved manipulation accuracy in real-world robotic systems.
核心發現: 核心結果:Our results highlight that context-sensitive and task-aware token pruning serves as a more effective strategy than full visual processing, enabling faster inference and improved manipulation accuracy
Matching Multiple Experts: On the Exploitability of Multi-Agent Imitation Learning
Authors: Antoine Bergerault, Volkan Cevher, Negar Mehr | Submitted: 2026-02-24 | arXiv: 2602.21020
Categories: cs.LG, cs.GT, cs.MA
Research Background: Multi-agent imitation learning (MA-IL) aims to learn optimal policies from expert demonstrations of interactions in multi-agent interactive domains. Despite existing guarantees on the performance of the resulting learned policies, characterizations of how far the learned polices are from a Nash equilibrium are missing for offline MA-IL.
研究背景: 在機器人學習領域,Multi-agent imitation learning (MA-IL) aims to learn optimal policies from expert demonstrations of interactions in multi-agent interactive domains. Despite existing guarantees on
Technical Approach: In this paper, we demonstrate impossibility and hardness results of learning low-exploitable policies in general -player Markov Games.
技術方法: 本文提出的方法:In this paper, we demonstrate impossibility and hardness results of learning low-exploitable policies in general -player Markov Games.
Key Takeaway: In this paper, we demonstrate impossibility and hardness results of learning low-exploitable policies in general -player Markov Games.
核心發現: 核心結果:In this paper, we demonstrate impossibility and hardness results of learning low-exploitable policies in general -player Markov Games.
NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning
Authors: Ishaan Rawal, Shubh Gupta, Yihan Hu et al. | Submitted: 2026-02-24 | arXiv: 2602.21172
Categories: cs.AI, cs.CV
Research Background: Vision-Language-Action (VLA) models are advancing autonomous driving by replacing modular pipelines with unified end-to-end architectures. However, current VLAs face two expensive requirements: (1) massive dataset collection, and (2) dense reasoning annotations.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models are advancing autonomous driving by replacing modular pipelines with unified end-to-end architectures. However, current VLAs face two expensive
Technical Approach: However, current VLAs face two expensive requirements: (1) massive dataset collection, and (2) dense reasoning annotations. In this work, we address both challenges with NORD (No Reasoning for Driving). Compared to existing VLAs, NORD achieves competitive performance while being fine-tuned on <60% of the data and no reasoning annotations, resulting in 3x fewer tokens.
技術方法: 本文提出的方法:However, current VLAs face two expensive requirements: (1) massive dataset collection, and (2) dense reasoning annotations. In this work, we address both challenges with NORD (No Reasoning for Driving
Key Takeaway: As a result, NORD achieves competitive performance on Waymo and NAVSIM with a fraction of the training data and no reasoning overhead, enabling more efficient autonomous systems.
核心發現: 核心結果:As a result, NORD achieves competitive performance on Waymo and NAVSIM with a fraction of the training data and no reasoning overhead, enabling more efficient autonomous systems.
Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion
Authors: Jiaru Zhang, Manav Gagvani, Can Cui et al. | Submitted: 2026-02-24 | arXiv: 2602.20577
Categories: cs.CV
Research Background: Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged as promising candidates for end-to-end autonomous driving. However, these models typically face challenges in inference latency, action precision, and explainability.
研究背景: 在機器人學習領域,Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged as promising candidates for end-to-end autonomous driving. However, these models typically face challeng
Technical Approach: In this work, we propose Masked Vision-Language-Action Diffusion for Autonomous Driving (MVLAD-AD), a novel framework designed to bridge the gap between efficient planning and semantic explainability via a masked vision-language-action diffusion model. Unlike methods that force actions into the language space, we introduce a discrete action tokenization strategy that constructs a compact codebook of kinematically feasible waypoints from real-world driving distributions. Moreover, we propose geometry-aware embedding learning to ensure that embeddings in the latent space approximate physical geometric metrics.
技術方法: 本文提出的方法:In this work, we propose Masked Vision-Language-Action Diffusion for Autonomous Driving (MVLAD-AD), a novel framework designed to bridge the gap between efficient planning and semantic explainability
Key Takeaway: Extensive experiments on nuScenes and derived benchmarks demonstrate that MVLAD-AD achieves superior efficiency and outperforms state-of-the-art autoregressive and diffusion baselines in planning precision, while providing high-fidelity and explainable reasoning.
核心發現: 核心結果:Extensive experiments on nuScenes and derived benchmarks demonstrate that MVLAD-AD achieves superior efficiency and outperforms state-of-the-art autoregressive and diffusion baselines in planning prec
EgoAVFlow: Robot Policy Learning with Active Vision from Human Egocentric Videos via 3D Flow
Authors: Daesol Cho, Youngseok Jang, Danfei Xu et al. | Submitted: 2026-02-25 | arXiv: 2602.22461
Categories: cs.RO
Research Background: Egocentric human videos provide a scalable source of manipulation demonstrations; however, deploying them on robots requires active viewpoint control to maintain task-critical visibility, which human viewpoint imitation often fails to provide due to human-specific priors. We propose EgoAVFlow, which learns manipulation and active vision from egocentric videos through a shared 3D flow representation that supports geometric visibility reasoning and transfers without robot demonstrations.
研究背景: 在機器人學習領域,Egocentric human videos provide a scalable source of manipulation demonstrations; however, deploying them on robots requires active viewpoint control to maintain task-critical visi
Technical Approach: We propose EgoAVFlow, which learns manipulation and active vision from egocentric videos through a shared 3D flow representation that supports geometric visibility reasoning and transfers without robot demonstrations.
技術方法: 本文提出的方法:We propose EgoAVFlow, which learns manipulation and active vision from egocentric videos through a shared 3D flow representation that supports geometric visibility reasoning and transfers without robo
Key Takeaway: Real-world experiments under actively changing viewpoints show that EgoAVFlow consistently outperforms prior human-demo-based baselines, demonstrating effective visibility maintenance and robust manipulation without robot demonstrations.
核心發現: 核心結果:Real-world experiments under actively changing viewpoints show that EgoAVFlow consistently outperforms prior human-demo-based baselines, demonstrating effective visibility maintenance and robust manip
CWM: Contrastive World Models for Action Feasibility Learning in Embodied Agent Pipelines
Authors: Chayan Banerjee | Submitted: 2026-02-25 | arXiv: 2602.22452
Categories: cs.AI, cs.RO
Research Background: A reliable action feasibility scorer is a critical bottleneck in embodied agent pipelines: before any planning or reasoning occurs, the agent must identify which candidate actions are physically executable in the current state. Existing approaches use supervised fine-tuning (SFT) to train action scorers, but SFT treats each candidate independently and does not explicitly teach the model to discriminate between actions that are physically correct and those that are subtly wrong.
研究背景: 在機器人學習領域,A reliable action feasibility scorer is a critical bottleneck in embodied agent pipelines: before any planning or reasoning occurs, the agent must identify which candidate actions
Technical Approach: We propose the Contrastive World Model (CWM), which fine-tunes a large language model (LLM) as an action scorer using an InfoNCE contrastive objective with hard-mined negative examples.
技術方法: 本文提出的方法:We propose the Contrastive World Model (CWM), which fine-tunes a large language model (LLM) as an action scorer using an InfoNCE contrastive objective with hard-mined negative examples.
Key Takeaway: These results support the hypothesis that contrastive training induces representations that capture physical feasibility more faithfully than SFT alone.
核心發現: 核心結果:These results support the hypothesis that contrastive training induces representations that capture physical feasibility more faithfully than SFT alone.
FlowCorrect: Efficient Interactive Correction of Generative Flow Policies for Robotic Manipulation
Authors: Edgar Welte, Yitian Shi, Rosa Wolf et al. | Submitted: 2026-02-25 | arXiv: 2602.22056
Categories: cs.RO, cs.LG
Research Background: Generative manipulation policies can fail catastrophically under deployment-time distribution shift, yet many failures are near-misses: the robot reaches almost-correct poses and would succeed with a small corrective motion. We propose FlowCorrect, a modular interactive imitation learning approach that enables deployment-time adaptation of flow-matching manipulation policies from sparse, relative human corrections without retraining.
研究背景: 在機器人學習領域,Generative manipulation policies can fail catastrophically under deployment-time distribution shift, yet many failures are near-misses: the robot reaches almost-correct poses and w
Technical Approach: We propose FlowCorrect, a modular interactive imitation learning approach that enables deployment-time adaptation of flow-matching manipulation policies from sparse, relative human corrections without retraining.
技術方法: 本文提出的方法:We propose FlowCorrect, a modular interactive imitation learning approach that enables deployment-time adaptation of flow-matching manipulation policies from sparse, relative human corrections without
Key Takeaway: The results clearly demonstrate that FlowCorrect learns from very few demonstrations and enables fast, sample-efficient, incremental, human-in-the-loop corrections of generative visuomotor policies at deployment time in real-world robotics.
核心發現: 核心結果:The results clearly demonstrate that FlowCorrect learns from very few demonstrations and enables fast, sample-efficient, incremental, human-in-the-loop corrections of generative visuomotor policies at
Humanizing Robot Gaze Shifts: A Framework for Natural Gaze Shifts in Humanoid Robots
Authors: Jingchao Wei, Jingkai Qin, Yuxiao Cao et al. | Submitted: 2026-02-25 | arXiv: 2602.21983
Categories: cs.RO
Research Background: Leveraging auditory and visual feedback for attention reorientation is essential for natural gaze shifts in social interaction. However, enabling humanoid robots to perform natural and context-appropriate gaze shifts in unconstrained human—robot interaction (HRI) remains challenging, as it requires the coupling of cognitive attention mechanisms and biomimetic motion generation.
研究背景: 在機器人學習領域,Leveraging auditory and visual feedback for attention reorientation is essential for natural gaze shifts in social interaction. However, enabling humanoid robots to perform natural
Technical Approach: In this work, we propose the Robot Gaze-Shift (RGS) framework, which integrates these two components into a unified pipeline.
技術方法: 本文提出的方法:In this work, we propose the Robot Gaze-Shift (RGS) framework, which integrates these two components into a unified pipeline.
Key Takeaway: Experiments validate that RGS effectively replicates human-like target selection and generates realistic, diverse gaze-shift motions.
核心發現: 核心結果:Experiments validate that RGS effectively replicates human-like target selection and generates realistic, diverse gaze-shift motions.
DexRepNet++: Learning Dexterous Robotic Manipulation with Geometric and Spatial Hand-Object Representations
Authors: Qingtao Liu, Zhengnan Sun, Yu Cui et al. | Submitted: 2026-02-25 | arXiv: 2602.21811
Categories: cs.RO
Research Background: Robotic dexterous manipulation is a challenging problem due to high degrees of freedom (DoFs) and complex contacts of multi-fingered robotic hands. Many existing deep reinforcement learning (DRL) based methods aim at improving sample efficiency in high-dimensional output action spaces.
研究背景: 在機器人學習領域,Robotic dexterous manipulation is a challenging problem due to high degrees of freedom (DoFs) and complex contacts of multi-fingered robotic hands. Many existing deep reinforcement
Technical Approach: In this paper, we propose DexRep, a novel hand-object interaction representation to capture object surface features and spatial relations between hands and objects for dexterous manipulation skill learning.
技術方法: 本文提出的方法:In this paper, we propose DexRep, a novel hand-object interaction representation to capture object surface features and spatial relations between hands and objects for dexterous manipulation skill lea
Key Takeaway: The grasp policies with DexRep are deployed to the real world under multi-camera and single-camera setups and demonstrate a small sim-to-real gap.
核心發現: 核心結果:The grasp policies with DexRep are deployed to the real world under multi-camera and single-camera setups and demonstrate a small sim-to-real gap.
ADM-DP: Adaptive Dynamic Modality Diffusion Policy through Vision-Tactile-Graph Fusion for Multi-Agent Manipulation
Authors: Enyi Wang, Wen Fan, Dandan Zhang | Submitted: 2026-02-25 | arXiv: 2602.21622
Categories: cs.RO
Research Background: Multi-agent robotic manipulation remains challenging due to the combined demands of coordination, grasp stability, and collision avoidance in shared workspaces. To address these challenges, we propose the Adaptive Dynamic Modality Diffusion Policy (ADM-DP), a framework that integrates vision, tactile, and graph-based (multi-agent pose) modalities for coordinated control.
研究背景: 在機器人學習領域,Multi-agent robotic manipulation remains challenging due to the combined demands of coordination, grasp stability, and collision avoidance in shared workspaces. To address these ch
Technical Approach: To address these challenges, we propose the Adaptive Dynamic Modality Diffusion Policy (ADM-DP), a framework that integrates vision, tactile, and graph-based (multi-agent pose) modalities for coordinated control.
技術方法: 本文提出的方法:To address these challenges, we propose the Adaptive Dynamic Modality Diffusion Policy (ADM-DP), a framework that integrates vision, tactile, and graph-based (multi-agent pose) modalities for coordina
Key Takeaway: Ablation studies show the greatest improvements in tasks requiring multiple sensory modalities, validating our adaptive fusion strategy and demonstrating its robustness for diverse manipulation scenarios.
核心發現: 核心結果:Ablation studies show the greatest improvements in tasks requiring multiple sensory modalities, validating our adaptive fusion strategy and demonstrating its robustness for diverse manipulation scenar
Jumping Control for a Quadrupedal Wheeled-Legged Robot via NMPC and DE Optimization
Authors: Xuanqi Zeng, Lingwei Zhang, Linzhu Yue et al. | Submitted: 2026-02-25 | arXiv: 2602.21612
Categories: cs.RO
Research Background: Quadrupedal wheeled-legged robots combine the advantages of legged and wheeled locomotion to achieve superior mobility, but executing dynamic jumps remains a significant challenge due to the additional degrees of freedom introduced by wheeled legs. This paper develops a mini-sized wheeled-legged robot for agile motion and presents a novel motion control framework that integrates the Nonlinear Model Predictive Control (NMPC) for locomotion and the Differential Evolution (DE) based trajectory optimization for jumping in quadrupedal wheeled-legged robots.
研究背景: 在機器人學習領域,Quadrupedal wheeled-legged robots combine the advantages of legged and wheeled locomotion to achieve superior mobility, but executing dynamic jumps remains a significant challenge
Technical Approach: This paper develops a mini-sized wheeled-legged robot for agile motion and presents a novel motion control framework that integrates the Nonlinear Model Predictive Control (NMPC) for locomotion and the Differential Evolution (DE) based trajectory optimization for jumping in quadrupedal wheeled-legged robots.
技術方法: 本文提出的方法:This paper develops a mini-sized wheeled-legged robot for agile motion and presents a novel motion control framework that integrates the Nonlinear Model Predictive Control (NMPC) for locomotion and th
Key Takeaway: Extensive simulations and real-world experiments validate the effectiveness of the framework, demonstrating a forward jump over a 0.12 m obstacle and a vertical jump reaching 0.5 m.
核心發現: 核心結果:Extensive simulations and real-world experiments validate the effectiveness of the framework, demonstrating a forward jump over a 0.12 m obstacle and a vertical jump reaching 0.5 m.
Iterative Closed-Loop Motion Synthesis for Scaling the Capabilities of Humanoid Control
Authors: Weisheng Xu, Qiwei Wu, Jiaxi Zhang et al. | Submitted: 2026-02-25 | arXiv: 2602.21599
Categories: cs.RO, cs.CV
Research Background: Physics-based humanoid control relies on training with motion datasets that have diverse data distributions. However, the fixed difficulty distribution of datasets limits the performance ceiling of the trained control policies.
研究背景: 在機器人學習領域,Physics-based humanoid control relies on training with motion datasets that have diverse data distributions. However, the fixed difficulty distribution of datasets limits the perfo
Technical Approach: To address these issues, we propose a closed-loop automated motion data generation and iterative framework. Furthermore, our framework enables difficulty iteration of policies and data through physical metrics and objective evaluations, allowing the trained tracker to break through its original difficulty limits. Finally, we conduct comprehensive ablation and comparative experiments to highlight the rationality and advantages of our framework.
技術方法: 本文提出的方法:To address these issues, we propose a closed-loop automated motion data generation and iterative framework. Furthermore, our framework enables difficulty iteration of policies and data through physica
Key Takeaway: Finally, we conduct comprehensive ablation and comparative experiments to highlight the rationality and advantages of our framework.
核心發現: 核心結果:Finally, we conduct comprehensive ablation and comparative experiments to highlight the rationality and advantages of our framework.
OOWM: Structuring Embodied Reasoning and Planning via Object-Oriented Programmatic World Modeling
Authors: Hongyu Chen, Liang Lin, Guangrun Wang | Submitted: 2026-02-25 | arXiv: 2604.09580
Categories: cs.AI, cs.LG
Research Background: Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient for effective world modeling in embodied tasks. While text offers flexibility, it fails to explicitly represent the state-space, object hierarchies, and causal dependencies required for robust robotic planning.
研究背景: 在機器人學習領域,Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient
Technical Approach: To address these limitations, we propose Object-Oriented World Modeling (OOWM), a novel framework that structures embodied reasoning through the lens of software engineering formalisms. Furthermore, we introduce a three-stage training pipeline combining Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO).
技術方法: 本文提出的方法:To address these limitations, we propose Object-Oriented World Modeling (OOWM), a novel framework that structures embodied reasoning through the lens of software engineering formalisms. Furthermore, w
Key Takeaway: Extensive evaluations on the MRoom-30k benchmark demonstrate that OOWM significantly outperforms unstructured textual baselines in planning coherence, execution success, and structural fidelity, establishing a new paradigm for structured embodied reasoning.
核心發現: 核心結果:Extensive evaluations on the MRoom-30k benchmark demonstrate that OOWM significantly outperforms unstructured textual baselines in planning coherence, execution success, and structural fidelity, estab
Embedding Morphology into Transformers for Cross-Robot Policy Learning
Authors: Kei Suzuki, Jing Liu, Ye Wang et al. | Submitted: 2026-02-26 | arXiv: 2603.00182
Categories: cs.RO, cs.AI, cs.LG, eess.SY
Research Background: Cross-robot policy learning — training a single policy to perform well across multiple embodiments — remains a central challenge in robot learning. Transformer-based policies, such as vision-language-action (VLA) models, are typically embodiment-agnostic and must infer kinematic structure purely from observations, which can reduce robustness across embodiments and even limit performance within a single embodiment.
研究背景: 在機器人學習領域,Cross-robot policy learning — training a single policy to perform well across multiple embodiments — remains a central challenge in robot learning. Transformer-based policies, su
Technical Approach: We propose an embodiment-aware transformer policy that injects morphology via three mechanisms: (1) kinematic tokens that factorize actions across joints and compress time through per-joint temporal chunking; (2) a topology-aware attention bias that encodes kinematic topology as an inductive bias in self-attention, encouraging message passing along kinematic edges; and (3) joint-attribute conditioning that augments topology with per-joint descriptors to capture semantics beyond connectivity.
技術方法: 本文提出的方法:We propose an embodiment-aware transformer policy that injects morphology via three mechanisms: (1) kinematic tokens that factorize actions across joints and compress time through per-joint temporal c
Key Takeaway: Across a range of embodiments, this structured integration consistently improves performance over a vanilla pi0.5 VLA baseline, indicating improved robustness both within an embodiment and across embodiments.
核心發現: 核心結果:Across a range of embodiments, this structured integration consistently improves performance over a vanilla pi0.5 VLA baseline, indicating improved robustness both within an embodiment and across embo
Interface-Aware Trajectory Reconstruction of Limited Demonstrations for Robot Learning
Authors: Demiana R. Barsoum, Mahdieh Nejati Javaremi, Larisa Y. C. Loke et al. | Submitted: 2026-02-26 | arXiv: 2602.23287
Categories: cs.RO
Research Background: Assistive robots offer agency to humans with severe motor impairments. Often, these users control high-DoF robots through low-dimensional interfaces, such as using a 1-D sip-and-puff interface to operate a 6-DoF robotic arm.
研究背景: 在機器人學習領域,Assistive robots offer agency to humans with severe motor impairments. Often, these users control high-DoF robots through low-dimensional interfaces, such as using a 1-D sip-and-pu
Technical Approach: To address this, we present a trajectory reconstruction algorithm that reasons about task, environment, and interface constraints to lift demonstrations into the robot’s full control space. We evaluate our approach using real-world demonstrations of ADL-inspired tasks performed via a 2-D joystick and 1-D sip-and-puff control interface, teleoperating two distinct 7-DoF robotic arms.
技術方法: 本文提出的方法:To address this, we present a trajectory reconstruction algorithm that reasons about task, environment, and interface constraints to lift demonstrations into the robot’s full control space. We evaluat
Key Takeaway: We evaluate our approach using real-world demonstrations of ADL-inspired tasks performed via a 2-D joystick and 1-D sip-and-puff control interface, teleoperating two distinct 7-DoF robotic arms.
核心發現: 核心結果:We evaluate our approach using real-world demonstrations of ADL-inspired tasks performed via a 2-D joystick and 1-D sip-and-puff control interface, teleoperating two distinct 7-DoF robotic arms.
Towards Intelligible Human-Robot Interaction: An Active Inference Approach to Occluded Pedestrian Scenarios
Authors: Kai Chen, Yuyao Huang, Guang Chen | Submitted: 2026-02-26 | arXiv: 2602.23109
Categories: cs.RO
Research Background: The sudden appearance of occluded pedestrians presents a critical safety challenge in autonomous driving. Conventional rule-based or purely data-driven approaches struggle with the inherent high uncertainty of these long-tail scenarios.
研究背景: 在機器人學習領域,The sudden appearance of occluded pedestrians presents a critical safety challenge in autonomous driving. Conventional rule-based or purely data-driven approaches struggle with the
Technical Approach: To tackle this challenge, we propose a novel framework grounded in Active Inference, which endows the agent with a human-like, belief-driven mechanism. Our framework leverages a Rao-Blackwellized Particle Filter (RBPF) to efficiently estimate the pedestrian’s hybrid state. To emulate human-like cognitive processes under uncertainty, we introduce a Conditional Belief Reset mechanism and a Hypothesis Injection technique to explicitly model beliefs about the pedestrian’s multiple latent intentions.
技術方法: 本文提出的方法:To tackle this challenge, we propose a novel framework grounded in Active Inference, which endows the agent with a human-like, belief-driven mechanism. Our framework leverages a Rao-Blackwellized Part
Key Takeaway: Simulation experiments demonstrate that our approach significantly reduces the collision rate compared to reactive, rule-based, and reinforcement learning (RL) baselines, while also exhibiting explainable and human-like driving behavior that reflects the agent’s internal belief state.
核心發現: 核心結果:Simulation experiments demonstrate that our approach significantly reduces the collision rate compared to reactive, rule-based, and reinforcement learning (RL) baselines, while also exhibiting explain
InCoM: Intent-Driven Perception and Structured Coordination for Mobile Manipulation
Authors: Jiahao Liu, Cui Wenbo, Zhongpu Xia et al. | Submitted: 2026-02-26 | arXiv: 2602.23024
Categories: cs.RO
Research Background: Mobile manipulation is a fundamental capability for general-purpose robotic agents, requiring both coordinated control of the mobile base and manipulator and robust perception under dynamically changing viewpoints. However, existing approaches face two key challenges: strong coupling between base and arm actions complicates control optimization, and perceptual attention is often poorly allocated as viewpoints shift during mobile manipulation.
研究背景: 在機器人學習領域,Mobile manipulation is a fundamental capability for general-purpose robotic agents, requiring both coordinated control of the mobile base and manipulator and robust perception unde
Technical Approach: We propose InCoM, an intent-driven perception and structured coordination framework for mobile manipulation. On the control side, we design a decoupled coordinated flow matching action decoder that explicitly models coordinated base-arm action generation, alleviating optimization difficulties caused by control coupling.
技術方法: 本文提出的方法:We propose InCoM, an intent-driven perception and structured coordination framework for mobile manipulation. On the control side, we design a decoupled coordinated flow matching action decoder that ex
Key Takeaway: Furthermore, its effectiveness is consistently validated in real-world mobile manipulation tasks, where InCoM maintains a superior success rate over existing baselines.
核心發現: 核心結果:Furthermore, its effectiveness is consistently validated in real-world mobile manipulation tasks, where InCoM maintains a superior success rate over existing baselines.
Demystifying Action Space Design for Robotic Manipulation Policies
Authors: Yuchun Feng, Jinliang Zheng, Zhihao Wang et al. | Submitted: 2026-02-26 | arXiv: 2602.23408
Categories: cs.RO, cs.CV
Research Background: The specification of the action space plays a pivotal role in imitation-based robotic manipulation policy learning, fundamentally shaping the optimization landscape of policy learning. While recent advances have focused heavily on scaling training data and model capacity, the choice of action space remains guided by ad-hoc heuristics or legacy designs, leading to an ambiguous understanding of robotic policy design philosophies.
研究背景: 在機器人學習領域,The specification of the action space plays a pivotal role in imitation-based robotic manipulation policy learning, fundamentally shaping the optimization landscape of policy learn
Technical Approach: While recent advances have focused heavily on scaling training data and model capacity, the choice of action space remains guided by ad-hoc heuristics or legacy designs, leading to an ambiguous understanding of robotic policy design philosophies. To address this ambiguity, we conducted a large-scale and systematic empirical study, confirming that the action space does have significant and complex impacts on robotic policy learning. We dissect the action design space along temporal and spatial axes, facilitating a structured analysis of how these choices govern both policy learnability and control stability.
技術方法: 本文提出的方法:While recent advances have focused heavily on scaling training data and model capacity, the choice of action space remains guided by ad-hoc heuristics or legacy designs, leading to an ambiguous unders
Key Takeaway: Our large-scale results suggest that properly designing the policy to predict delta actions consistently improves performance, while joint-space and task-space representations offer complementary strengths, favoring control stability and generalization, respectively.
核心發現: 核心結果:Our large-scale results suggest that properly designing the policy to predict delta actions consistently improves performance, while joint-space and task-space representations offer complementary stre
Cybersecurity of Teleoperated Quadruped Robots: A Systematic Survey of Vulnerabilities, Threats, and Open Defense Gaps
Authors: Mohammad Sabouri | Submitted: 2026-02-26 | arXiv: 2602.23404
Categories: cs.RO, cs.CR, eess.SY
Research Background: Teleoperated quadruped robots are increasingly deployed in safety-critical missions — industrial inspection, military reconnaissance, and emergency response — yet the security of their communication and control infrastructure remains insufficiently characterized. Quadrupeds present distinct security challenges arising from dynamic stability constraints, gait-dependent vulnerability windows, substantial kinetic energy, and elevated operator cognitive load.
研究背景: 在機器人學習領域,Teleoperated quadruped robots are increasingly deployed in safety-critical missions — industrial inspection, military reconnaissance, and emergency response — yet the security of
Technical Approach: Quadrupeds present distinct security challenges arising from dynamic stability constraints, gait-dependent vulnerability windows, substantial kinetic energy, and elevated operator cognitive load. This survey synthesizes peer-reviewed literature and vulnerability disclosures (2019—2025) to provide comprehensive analysis of cybersecurity threats, consequences, and countermeasures for teleoperated quadruped systems. We contribute: (i) a six-layer attack taxonomy spanning perception manipulation, VR/AR operator targeting, communication disruption, control signal attacks, localization spoofing, and network intrusion; (ii) systematic attack-to-consequence mapping with timing characterization; (iii) Technology Readiness Level classification exposing critical maturity gaps between field-deployed communication protections (TRL 7—9) and experimental perception/operator-layer defenses (TRL 3—5); (iv) comparative security analysis of six commercial platforms; (v) pragmatic deployment guidance stratified by implementation timeline; and (vi) eight prioritized research gaps with implementation roadmaps.
技術方法: 本文提出的方法:Quadrupeds present distinct security challenges arising from dynamic stability constraints, gait-dependent vulnerability windows, substantial kinetic energy, and elevated operator cognitive load. This
Key Takeaway: Attack success rates derive from cited studies under controlled conditions and require domain-specific validation.
核心發現: 核心結果:Attack success rates derive from cited studies under controlled conditions and require domain-specific validation.
DySL-VLA: Efficient Vision-Language-Action Model Inference via Dynamic-Static Layer-Skipping for Robot Manipulation
Authors: Zebin Yang, Yijiahao Qi, Tong Xie et al. | Submitted: 2026-02-26 | arXiv: 2602.22896
Categories: cs.RO
Research Background: Vision-Language-Action (VLA) models have shown remarkable success in robotic tasks like manipulation by fusing a language model’s reasoning with a vision model’s 3D understanding. However, their high computational cost remains a major obstacle for real-world applications that require real-time performance.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have shown remarkable success in robotic tasks like manipulation by fusing a language model’s reasoning with a vision model’s 3D understanding.
Technical Approach: Leveraging this insight, we propose DySL-VLA, a novel framework that addresses computational cost by dynamically skipping VLA layers based on each action’s importance.
技術方法: 本文提出的方法:Leveraging this insight, we propose DySL-VLA, a novel framework that addresses computational cost by dynamically skipping VLA layers based on each action’s importance.
Key Takeaway: Our experiments indicate that DySL-VLA achieves 2.1% improvement in success length over Deer-VLA on the Calvin dataset, while simultaneously reducing trainable parameters by a factor of 85.7 and providing a 3.75x speedup relative to the RoboFlamingo baseline at iso-accuracy.
核心發現: 核心結果:Our experiments indicate that DySL-VLA achieves 2.1% improvement in success length over Deer-VLA on the Calvin dataset, while simultaneously reducing trainable parameters by a factor of 85.7 and provi
LeRobot: An Open-Source Library for End-to-End Robot Learning
Authors: Remi Cadene, Simon Aliberts, Francesco Capuano et al. | Submitted: 2026-02-26 | arXiv: 2602.22818
Categories: cs.RO
Research Background: Robotics is undergoing a significant transformation powered by advances in high-level control techniques based on machine learning, giving rise to the field of robot learning. Recent progress in robot learning has been accelerated by the increasing availability of affordable teleoperation systems, large-scale openly available datasets, and scalable learning-based methods.
研究背景: 在機器人學習領域,Robotics is undergoing a significant transformation powered by advances in high-level control techniques based on machine learning, giving rise to the field of robot learning. Rece
Technical Approach: In this paper, we present \texttt{lerobot}, an open-source library that integrates across the entire robot learning stack, from low-level middleware communication for motor controls to large-scale dataset collection, storage and streaming.
技術方法: 本文提出的方法:In this paper, we present \texttt{lerobot}, an open-source library that integrates across the entire robot learning stack, from low-level middleware communication for motor controls to large-scale dat
Key Takeaway: Designed for accessibility, scalability, and openness, \texttt{lerobot} lowers the barrier to entry for researchers and practitioners to robotics while providing a platform for reproducible, state-of-the-art robot learning.
核心發現: 核心結果:Designed for accessibility, scalability, and openness, \texttt{lerobot} lowers the barrier to entry for researchers and practitioners to robotics while providing a platform for reproducible, state-of-
Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baseline
Authors: Wenxuan Song, Jiayi Chen, Xiaoquan Sun et al. | Submitted: 2026-02-26 | arXiv: 2602.22663
Categories: cs.RO
Research Background: Vision-Language-Action (VLA) models have emerged as a generalist robotic agent. However, existing VLAs are hindered by excessive parameter scales, prohibitive pre-training requirements, and limited applicability to diverse embodiments.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models have emerged as a generalist robotic agent. However, existing VLAs are hindered by excessive parameter scales, prohibitive pre-training requirem
Technical Approach: To improve the practicality of VLAs, we propose a comprehensive benchmark and an improved baseline. First, we propose CEBench, a new benchmark spanning diverse embodiments in both simulation and the real world with consideration of domain randomization. Informed by these findings, we introduce LLaVA-VLA, a lightweight yet powerful VLA designed for practical deployment on consumer-grade GPUs.
技術方法: 本文提出的方法:To improve the practicality of VLAs, we propose a comprehensive benchmark and an improved baseline. First, we propose CEBench, a new benchmark spanning diverse embodiments in both simulation and the r
Key Takeaway: Experiments across embodiments demonstrate the capabilities of generalization and versatility of LLaVA-VLA , while real-world mobile manipulation experiments establish it as the first end-to-end VLA model for mobile manipulation.
核心發現: 核心結果:Experiments across embodiments demonstrate the capabilities of generalization and versatility of LLaVA-VLA , while real-world mobile manipulation experiments establish it as the first end-to-end VLA m
SignVLA: A Gloss-Free Vision-Language-Action Framework for Real-Time Sign Language-Guided Robotic Manipulation
Authors: Xinyu Tan, Ningwei Bai, Harry Gardener et al. | Submitted: 2026-02-26 | arXiv: 2602.22514
Categories: cs.RO, cs.AI, eess.SY
Research Background: We present, to our knowledge, the first sign language-driven Vision-Language-Action (VLA) framework for intuitive and inclusive human-robot interaction. Unlike conventional approaches that rely on gloss annotations as intermediate supervision, the proposed system adopts a gloss-free paradigm and directly maps visual sign gestures to semantic instructions.
研究背景: 在機器人學習領域,We present, to our knowledge, the first sign language-driven Vision-Language-Action (VLA) framework for intuitive and inclusive human-robot interaction. Unlike conventional approac
Technical Approach: We present, to our knowledge, the first sign language-driven Vision-Language-Action (VLA) framework for intuitive and inclusive human-robot interaction.
技術方法: 本文提出的方法:We present, to our knowledge, the first sign language-driven Vision-Language-Action (VLA) framework for intuitive and inclusive human-robot interaction.
Key Takeaway: These results highlight the potential of the framework to advance accessible, scalable, and multimodal embodied intelligence.
核心發現: 核心結果:These results highlight the potential of the framework to advance accessible, scalable, and multimodal embodied intelligence.
Multi-agent imitation learning with function approximation: Linear Markov games and beyond
Authors: Luca Viano, Till Freihaut, Emanuele Nevali et al. | Submitted: 2026-02-26 | arXiv: 2602.22810
Categories: cs.LG
Research Background: In this work, we present the first theoretical analysis of multi-agent imitation learning (MAIL) in linear Markov games where both the transition dynamics and each agent’s reward function are linear in some given features. We demonstrate that by leveraging this structure, it is possible to replace the state-action level “all policy deviation concentrability coefficient” (Freihaut et al., arXiv:2510.09325) with a concentrability coefficient defined at the feature level which can be much smaller than the state-action analog when the features are informative about states’ similarity.
研究背景: 在機器人學習領域,In this work, we present the first theoretical analysis of multi-agent imitation learning (MAIL) in linear Markov games where both the transition dynamics and each agent’s reward f
Technical Approach: In this work, we present the first theoretical analysis of multi-agent imitation learning (MAIL) in linear Markov games where both the transition dynamics and each agent’s reward function are linear in some given features. Building on these theoretical findings, we propose a deep MAIL interactive algorithm which clearly outperforms BC on games such as Tic-Tac-Toe and Connect4.
技術方法: 本文提出的方法:In this work, we present the first theoretical analysis of multi-agent imitation learning (MAIL) in linear Markov games where both the transition dynamics and each agent’s reward function are linear i
Key Takeaway: Building on these theoretical findings, we propose a deep MAIL interactive algorithm which clearly outperforms BC on games such as Tic-Tac-Toe and Connect4.
核心發現: 核心結果:Building on these theoretical findings, we propose a deep MAIL interactive algorithm which clearly outperforms BC on games such as Tic-Tac-Toe and Connect4.
Walking with Robots: Video Analysis of Human-Robot Interactions in Transit Spaces
Authors: Barry Brown, Hannah Pelikan, Mathias Broth | Submitted: 2026-02-26 | arXiv: 2602.23475
Categories: cs.HC
Research Background: The proliferation of robots in public spaces necessitates a deeper understanding of how these robots can interact with those they share the space with. In this paper, we present findings from video analysis of publicly deployed cleaning robots in a transit space, a major commercial airport, using their navigational ‘troubles’ as a tool to document what robots currently lack in interactional competence.
研究背景: 在機器人學習領域,The proliferation of robots in public spaces necessitates a deeper understanding of how these robots can interact with those they share the space with. In this paper, we present fi
Technical Approach: In this paper, we present findings from video analysis of publicly deployed cleaning robots in a transit space, a major commercial airport, using their navigational ‘troubles’ as a tool to document what robots currently lack in interactional competence.
技術方法: 本文提出的方法:In this paper, we present findings from video analysis of publicly deployed cleaning robots in a transit space, a major commercial airport, using their navigational ‘troubles’ as a tool to document wh
Key Takeaway: We demonstrate that these robots, while technically proficient, can disrupt the social order of a space due to their inability to understand core aspects of human movement: mutual adjustment to others, the significance of understanding social groups, and the purpose of different locations.
核心發現: 核心結果:We demonstrate that these robots, while technically proficient, can disrupt the social order of a space due to their inability to understand core aspects of human movement: mutual adjustment to others
EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents
Authors: Wenjia Wang, Liang Pan, Huaijin Pi et al. | Submitted: 2026-02-26 | arXiv: 2602.23205
Categories: cs.CV
Research Background: Human behaviors in the real world naturally encode rich, long-term contextual information that can be leveraged to train embodied agents for perception, understanding, and acting. However, existing capture systems typically rely on costly studio setups and wearable devices, limiting the large-scale collection of scene-conditioned human motion data in the wild.
研究背景: 在機器人學習領域,Human behaviors in the real world naturally encode rich, long-term contextual information that can be leveraged to train embodied agents for perception, understanding, and acting.
Technical Approach: To address this, we propose EmbodMocap, a portable and affordable data collection pipeline using two moving iPhones.
技術方法: 本文提出的方法:To address this, we propose EmbodMocap, a portable and affordable data collection pipeline using two moving iPhones.
Key Takeaway: Experimental results validate the effectiveness of our pipeline and its contributions towards advancing embodied AI research.
核心發現: 核心結果:Experimental results validate the effectiveness of our pipeline and its contributions towards advancing embodied AI research.
Humanoid Robots as First Assistants in Endoscopic Surgery
Authors: Sue Min Cho, Jan Emily Mangulabnan, Han Zhang et al. | Submitted: 2026-02-27 | arXiv: 2602.24156
Categories: cs.RO
Research Background: Humanoid robots have become a focal point of technological ambition, with claims of surgical capability within years in mainstream discourse. These projections are aspirational yet lack empirical grounding.
研究背景: 在機器人學習領域,Humanoid robots have become a focal point of technological ambition, with claims of surgical capability within years in mainstream discourse. These projections are aspirational yet
Technical Approach: These projections are aspirational yet lack empirical grounding. To date, no humanoid has assisted a surgeon through an actual procedure, let alone performed one. The work described here breaks this new ground.
技術方法: 本文提出的方法:These projections are aspirational yet lack empirical grounding. To date, no humanoid has assisted a surgeon through an actual procedure, let alone performed one. The work described here breaks this n
Key Takeaway: This work establishes form-factor feasibility for humanoid surgical assistance while identifying challenges for continued development.
核心發現: 核心結果:This work establishes form-factor feasibility for humanoid surgical assistance while identifying challenges for continued development.
Teleoperated Omni-directional Dual Arm Mobile Manipulation Robotic System with Shared Control for Retail Store
Authors: Rolif Lima, Somdeb Saha, Nijil George et al. | Submitted: 2026-02-27 | arXiv: 2602.23923
Categories: cs.RO
Research Background: The swiftly expanding retail sector is increasingly adopting autonomous mobile robots empowered by artificial intelligence and machine learning algorithms to gain an edge in the competitive market. However, these autonomous robots encounter challenges in adapting to the dynamic nature of retail products, often struggling to operate autonomously in novel situations.
研究背景: 在機器人學習領域,The swiftly expanding retail sector is increasingly adopting autonomous mobile robots empowered by artificial intelligence and machine learning algorithms to gain an edge in the co
Technical Approach: In this study, we introduce an omni-directional dual-arm mobile robot specifically tailored for use in retail environments. Additionally, we propose a tele-operation method that enables shared control between the robot and a human operator.
技術方法: 本文提出的方法:In this study, we introduce an omni-directional dual-arm mobile robot specifically tailored for use in retail environments. Additionally, we propose a tele-operation method that enables shared control
Key Takeaway: We validate the efficacy of the proposed system through testing in a mockup of retail environment, demonstrating its ability to manipulate various commonly encountered retail items using both single and dual-arm coordinated manipulation techniques.
核心發現: 核心結果:We validate the efficacy of the proposed system through testing in a mockup of retail environment, demonstrating its ability to manipulate various commonly encountered retail items using both single a
ABPolicy: Asynchronous B-Spline Flow Policy for Real-Time and Smooth Robotic Manipulation
Authors: Fan Yang, Peiguang Jing, Kaihua Qu et al. | Submitted: 2026-02-27 | arXiv: 2602.23901
Categories: cs.RO, cs.CV
Research Background: Robotic manipulation requires policies that are smooth and responsive to evolving observations. However, synchronous inference in the raw action space introduces several challenges, including intra-chunk jitter, inter-chunk discontinuities, and stop-and-go execution.
研究背景: 在機器人學習領域,Robotic manipulation requires policies that are smooth and responsive to evolving observations. However, synchronous inference in the raw action space introduces several challenges
Technical Approach: We propose ABPolicy, an asynchronous flow-matching policy that operates in a B-spline control-point action space. Second, we introduce bidirectional action prediction coupled with refitting optimization to enforce inter-chunk continuity.
技術方法: 本文提出的方法:We propose ABPolicy, an asynchronous flow-matching policy that operates in a B-spline control-point action space. Second, we introduce bidirectional action prediction coupled with refitting optimizati
Key Takeaway: Empirical results indicate that ABPolicy reduces trajectory jerk, leading to smoother motion and improved performance.
核心發現: 核心結果:Empirical results indicate that ABPolicy reduces trajectory jerk, leading to smoother motion and improved performance.
AoE: Always-on Egocentric Human Video Collection for Embodied AI
Authors: Bowen Yang, Zishuo Li, Yang Sun et al. | Submitted: 2026-02-27 | arXiv: 2602.23893
Categories: cs.CV, cs.RO
Research Background: Embodied foundation models require large-scale, high-quality real-world interaction data for pre-training and scaling. However, existing data collection methods suffer from high infrastructure costs, complex hardware dependencies, and limited interaction scope, making scalable expansion challenging.
研究背景: 在機器人學習領域,Embodied foundation models require large-scale, high-quality real-world interaction data for pre-training and scaling. However, existing data collection methods suffer from high in
Technical Approach: To this end, we propose the Always-on Egocentric (AoE) data collection system, which aims to simplify hardware dependencies by leveraging humans themselves and their smartphones, enabling low-cost, highly efficient, and scene-agnostic real-world interaction data collection to address the challenge of data scarcity. Second, we develop a cross-platform mobile APP that leverages on-device compute for real-time processing, while the cloud hosts automated labeling and filtering pipelines that transform raw videos into high-quality training data.
技術方法: 本文提出的方法:To this end, we propose the Always-on Egocentric (AoE) data collection system, which aims to simplify hardware dependencies by leveraging humans themselves and their smartphones, enabling low-cost, hi
Key Takeaway: We evaluate AoE on data preprocessing quality and downstream tasks, demonstrating that high-quality egocentric data significantly boosts real-world generalization.
核心發現: 核心結果:We evaluate AoE on data preprocessing quality and downstream tasks, demonstrating that high-quality egocentric data significantly boosts real-world generalization.
Hybrid Offline-Online Reinforcement Learning for Sensorless, High-Precision Force Regulation in Surgical Robotic Grasping
Authors: Edoardo Fazzari, Omar Mohamed, Khalfan Hableel et al. | Submitted: 2026-02-27 | arXiv: 2602.23870
Categories: cs.RO
Research Background: Precise grasp force regulation in tendon-driven surgical instruments is fundamentally limited by nonlinear coupling between motor dynamics, transmission compliance, friction, and distal mechanics. Existing solutions typically rely on distal force sensing or analytical compensation, increasing hardware complexity or degrading performance under dynamic motion.
研究背景: 在機器人學習領域,Precise grasp force regulation in tendon-driven surgical instruments is fundamentally limited by nonlinear coupling between motor dynamics, transmission compliance, friction, and d
Technical Approach: We present a sensorless control framework that combines physics-consistent modeling and hybrid reinforcement learning to achieve high-precision distal force regulation in a proximally actuated surgical end-effector. We develop a first-principles digital twin of the da Vinci Xi grasping mechanism that captures coupled electrical, transmission, and jaw dynamics within a unified differential-algebraic formulation. To safely learn control policies in this stiff and highly nonlinear system, we introduce a three-stage pipeline:(i)a receding-horizon CMA-ES oracle that generates dynamically feasible expert trajectories,(ii)fully offline policy learning via Implicit Q-Learning to ensure stable initialization without unsafe exploration, and (iii)online refinement using TD3 for adaptation to on-policy dynamics.
技術方法: 本文提出的方法:We present a sensorless control framework that combines physics-consistent modeling and hybrid reinforcement learning to achieve high-precision distal force regulation in a proximally actuated surgica
Key Takeaway: These results demonstrate that high-fidelity modeling combined with structured offline-online RL can recover precise distal force behavior without additional sensing, offering a scalable and mechanically compatible solution for surgical robotic manipulation.
核心發現: 核心結果:These results demonstrate that high-fidelity modeling combined with structured offline-online RL can recover precise distal force behavior without additional sensing, offering a scalable and mechanica
OmniXtreme: Breaking the Generality Barrier in High-Dynamic Humanoid Control
Authors: Yunshen Wang, Shaohang Zhu, Peiyuan Zhi et al. | Submitted: 2026-02-27 | arXiv: 2602.23843
Categories: cs.RO
Research Background: High-fidelity motion tracking serves as the ultimate litmus test for generalizable, human-level motor skills. However, current policies often hit a “generality barrier”: as motion libraries scale in diversity, tracking fidelity inevitably collapses - especially for real-world deployment of high-dynamic motions.
研究背景: 在機器人學習領域,High-fidelity motion tracking serves as the ultimate litmus test for generalizable, human-level motor skills. However, current policies often hit a “generality barrier”: as motion
Technical Approach: To overcome these challenges, we introduce OmniXtreme, a scalable framework that decouples general motor skill learning from sim-to-real physical skill refinement. Our approach uses a flow-matching policy with high-capacity architectures to scale representation capacity without interference-intensive multi-motion RL optimization, followed by an actuation-aware refinement phase that ensures robust performance on physical hardware.
技術方法: 本文提出的方法:To overcome these challenges, we introduce OmniXtreme, a scalable framework that decouples general motor skill learning from sim-to-real physical skill refinement. Our approach uses a flow-matching po
Key Takeaway: Extensive experiments demonstrate that OmniXtreme maintains high-fidelity tracking across diverse, high-difficulty datasets.
核心發現: 核心結果:Extensive experiments demonstrate that OmniXtreme maintains high-fidelity tracking across diverse, high-difficulty datasets.
StemVLA:An Open-Source Vision-Language-Action Model with Future 3D Spatial Geometry Knowledge and 4D Historical Representation
Authors: Jiasong Xiao, Yutao She, Kai Li et al. | Submitted: 2026-02-27 | arXiv: 2602.23721
Categories: cs.RO, cs.CV
Research Background: Vision-language-action (VLA) models integrate visual observations and language instructions to predict robot actions, demonstrating promising generalization in manipulation tasks. However, most existing approaches primarily rely on direct mappings from 2D visual inputs to action sequences, without explicitly modeling the underlying 3D spatial structure or temporal world dynamics.
研究背景: 在機器人學習領域,Vision-language-action (VLA) models integrate visual observations and language instructions to predict robot actions, demonstrating promising generalization in manipulation tasks.
Technical Approach: To address this limitation, we propose StemVLA, a novel framework that explicitly incorporates both future-oriented 3D spatial knowledge and historical 4D spatiotemporal representations into action prediction.
技術方法: 本文提出的方法:To address this limitation, we propose StemVLA, a novel framework that explicitly incorporates both future-oriented 3D spatial knowledge and historical 4D spatiotemporal representations into action pr
Key Takeaway: Extensive experiments in simulation demonstrate that StemVLA significantly improves long-horizon task success and achieves state-of-the-art performance on the CALVIN ABC-D benchmark [46], achieving an average sequence length of XXX.
核心發現: 核心結果:Extensive experiments in simulation demonstrate that StemVLA significantly improves long-horizon task success and achieves state-of-the-art performance on the CALVIN ABC-D benchmark [46], achieving an
Interpretable Multimodal Gesture Recognition for Drone and Mobile Robot Teleoperation via Log-Likelihood Ratio Fusion
Authors: Seungyeol Baek, Jaspreet Singh, Lala Shakti Swarup Ray et al. | Submitted: 2026-02-27 | arXiv: 2602.23694
Categories: cs.RO, cs.AI
Research Background: Human operators are still frequently exposed to hazardous environments such as disaster zones and industrial facilities, where intuitive and reliable teleoperation of mobile robots and Unmanned Aerial Vehicles (UAVs) is essential. In this context, hands-free teleoperation enhances operator mobility and situational awareness, thereby improving safety in hazardous environments.
研究背景: 在機器人學習領域,Human operators are still frequently exposed to hazardous environments such as disaster zones and industrial facilities, where intuitive and reliable teleoperation of mobile robots
Technical Approach: To overcome these limitations, we propose a multimodal gesture recognition framework that integrates inertial data (accelerometer, gyroscope, and orientation) from Apple Watches on both wrists with capacitive sensing signals from custom gloves. We design a late fusion strategy based on the log-likelihood ratio (LLR), which not only enhances recognition performance but also provides interpretability by quantifying modality-specific contributions. To support this research, we introduce a new dataset of 20 distinct gestures inspired by aircraft marshalling signals, comprising synchronized RGB video, IMU, and capacitive sensor data.
技術方法: 本文提出的方法:To overcome these limitations, we propose a multimodal gesture recognition framework that integrates inertial data (accelerometer, gyroscope, and orientation) from Apple Watches on both wrists with ca
Key Takeaway: Experimental results demonstrate that our framework achieves performance comparable to a state-of-the-art vision-based baseline while significantly reducing computational cost, model size, and training time, making it well suited for real-time robot control.
核心發現: 核心結果:Experimental results demonstrate that our framework achieves performance comparable to a state-of-the-art vision-based baseline while significantly reducing computational cost, model size, and trainin
FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulation
Authors: Yao Li, Peiyuan Tang, Wuyang Zhang et al. | Submitted: 2026-02-27 | arXiv: 2602.23648
Categories: cs.RO
Research Background: Force/torque feedback can substantially improve Vision-Language-Action (VLA) models on contact-rich manipulation, but most existing approaches fuse all modalities at a single operating frequency. This design ignores the mismatched sampling rates of real robot sensors, forcing downsampling of the high-frequency contact cues needed for reactive correction.
研究背景: 在機器人學習領域,Force/torque feedback can substantially improve Vision-Language-Action (VLA) models on contact-rich manipulation, but most existing approaches fuse all modalities at a single opera
Technical Approach: We propose FAVLA, a force-adaptive fast-slow VLA that decouples slow perception planning from fast contact-aware control.
技術方法: 本文提出的方法:We propose FAVLA, a force-adaptive fast-slow VLA that decouples slow perception planning from fast contact-aware control.
Key Takeaway: Extensive experiments on contact-rich tasks demonstrate that FAVLA significantly outperforms baselines, achieving superior reactivity and success rates, especially with a smaller contact force during manipulation.
核心發現: 核心結果:Extensive experiments on contact-rich tasks demonstrate that FAVLA significantly outperforms baselines, achieving superior reactivity and success rates, especially with a smaller contact force during
Multi-Objective Reinforcement Learning for Large-Scale Tote Allocation in Human-Robot Collaborative Fulfillment Centers
Authors: Sikata Sengupta, Guangyi Liu, Omer Gottesman et al. | Submitted: 2026-02-27 | arXiv: 2602.24182
Categories: cs.LG
Research Background: Optimizing the consolidation process in container-based fulfillment centers requires trading off competing objectives such as processing speed, resource usage, and space utilization while adhering to a range of real-world operational constraints. This process involves moving items between containers via a combination of human and robotic workstations to free up space for inbound inventory and increase container utilization.
研究背景: 在機器人學習領域,Optimizing the consolidation process in container-based fulfillment centers requires trading off competing objectives such as processing speed, resource usage, and space utilizatio
Technical Approach: We formulate this problem as a large-scale Multi-Objective Reinforcement Learning (MORL) task with high-dimensional state spaces and dynamic system behavior. Our method builds on recent theoretical advances in solving constrained RL problems via best-response and no-regret dynamics in zero-sum games, enabling principled minimax policy learning. Policy evaluation on realistic warehouse simulations shows that our approach effectively trades off objectives, and we empirically observe that it learns a single policy that simultaneously satisfies all constraints, even if this is not theoretically guaranteed.
技術方法: 本文提出的方法:We formulate this problem as a large-scale Multi-Objective Reinforcement Learning (MORL) task with high-dimensional state spaces and dynamic system behavior. Our method builds on recent theoretical ad
Key Takeaway: These results demonstrate the promise of MORL in solving complex, high-impact decision-making problems in large-scale industrial systems.
核心發現: 核心結果:These results demonstrate the promise of MORL in solving complex, high-impact decision-making problems in large-scale industrial systems.
Action-Geometry Prediction with 3D Geometric Prior for Bimanual Manipulation
Authors: Chongyang Xu, Haipeng Li, Shen Cheng et al. | Submitted: 2026-02-27 | arXiv: 2602.23814
Categories: cs.CV
Research Background: Bimanual manipulation requires policies that can reason about 3D geometry, anticipate how it evolves under action, and generate smooth, coordinated motions. However, existing methods typically rely on 2D features with limited spatial awareness, or require explicit point clouds that are difficult to obtain reliably in real-world settings.
研究背景: 在機器人學習領域,Bimanual manipulation requires policies that can reason about 3D geometry, anticipate how it evolves under action, and generate smooth, coordinated motions. However, existing metho
Technical Approach: We leverage this opportunity and propose a framework that builds bimanual manipulation directly on a pre-trained 3D geometric foundation model. We evaluate our method both in simulation on the RoboTwin benchmark and in real-world robot executions. Our approach consistently outperforms 2D-based and point-cloud-based baselines, achieving state-of-the-art performance in manipulation success, inter-arm coordination, and 3D spatial prediction accuracy.
技術方法: 本文提出的方法:We leverage this opportunity and propose a framework that builds bimanual manipulation directly on a pre-trained 3D geometric foundation model. We evaluate our method both in simulation on the RoboTwi
Key Takeaway: Our approach consistently outperforms 2D-based and point-cloud-based baselines, achieving state-of-the-art performance in manipulation success, inter-arm coordination, and 3D spatial prediction accuracy.
核心發現: 核心結果:Our approach consistently outperforms 2D-based and point-cloud-based baselines, achieving state-of-the-art performance in manipulation success, inter-arm coordination, and 3D spatial prediction accura
UniHM: Unified Dexterous Hand Manipulation with Vision Language Model
Authors: Zhenhao Zhang, Jiaxin Liu, Ye Shi et al. | Submitted: 2026-02-28 | arXiv: 2603.00732
Categories: cs.RO, cs.CV
Research Background: Planning physically feasible dexterous hand manipulation is a central challenge in robotic manipulation and Embodied AI. Prior work typically relies on object-centric cues or precise hand-object interaction sequences, foregoing the rich, compositional guidance of open-vocabulary instruction.
研究背景: 在機器人學習領域,Planning physically feasible dexterous hand manipulation is a central challenge in robotic manipulation and Embodied AI. Prior work typically relies on object-centric cues or preci
Technical Approach: We introduce UniHM, the first framework for unified dexterous hand manipulation guided by free-form language commands. We propose a Unified Hand-Dexterous Tokenizer that maps heterogeneous dexterous-hand morphologies into a single shared codebook, improving cross-dexterous hand generalization and scalability to new morphologies. To ensure physical realism, we introduce a physics-guided dynamic refinement module that performs segment-wise joint optimization under generative and temporal priors, yielding smooth and physically feasible manipulation sequences.
技術方法: 本文提出的方法:We introduce UniHM, the first framework for unified dexterous hand manipulation guided by free-form language commands. We propose a Unified Hand-Dexterous Tokenizer that maps heterogeneous dexterous-h
Key Takeaway: Across multiple datasets and real-world evaluations, UniHM attains state-of-the-art results on both seen and unseen objects and trajectories, demonstrating strong generalization and high physical feasibility.
核心發現: 核心結果:Across multiple datasets and real-world evaluations, UniHM attains state-of-the-art results on both seen and unseen objects and trajectories, demonstrating strong generalization and high physical feas
TGM-VLA: Task-Guided Mixup for Sampling-Efficient and Robust Robotic Manipulation
Authors: Fanqi Pu, Lei Jiang, Wenming Yang | Submitted: 2026-02-28 | arXiv: 2603.00615
Categories: cs.RO
Research Background: The performance of robotic imitation learning is fundamentally limited by data quality and training strategies. Prevalent sampling strategies on RLBench suffer from severe keyframe redundancy and imbalanced temporal distribution, leading to inefficient memory usage and unstable optimization.
研究背景: 在機器人學習領域,The performance of robotic imitation learning is fundamentally limited by data quality and training strategies. Prevalent sampling strategies on RLBench suffer from severe keyframe
Technical Approach: In this work, we propose a novel holistic framework that significantly improves both model performance and training efficiency. Finally, we propose a task-guided mixup technique that dynamically fuses point clouds and action heatmaps according to task instructions, greatly improving robustness to distractors and performance in multi-goal scenarios. Extensive experiments demonstrate that our method achieves state-of-the-art performance with a 90.5% success rate on RLBench and 68.8% on the COLOSSEUM benchmark under challenging interference conditions.
技術方法: 本文提出的方法:In this work, we propose a novel holistic framework that significantly improves both model performance and training efficiency. Finally, we propose a task-guided mixup technique that dynamically fuses
Key Takeaway: Extensive experiments demonstrate that our method achieves state-of-the-art performance with a 90.5% success rate on RLBench and 68.8% on the COLOSSEUM benchmark under challenging interference conditions.
核心發現: 核心結果:Extensive experiments demonstrate that our method achieves state-of-the-art performance with a 90.5% success rate on RLBench and 68.8% on the COLOSSEUM benchmark under challenging interference conditi
LangGap: Diagnosing and Closing the Language Gap in Vision-Language-Action Models
Authors: Yuchen Hou, Lin Zhao | Submitted: 2026-02-28 | arXiv: 2603.00592
Categories: cs.RO, cs.AI, cs.CL, cs.CV, cs.LG
Research Background: Vision-Language-Action (VLA) models achieve over 95% success on standard benchmarks. However, through systematic experiments, we find that current state-of-the-art VLA models largely ignore language instructions.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models achieve over 95% success on standard benchmarks. However, through systematic experiments, we find that current state-of-the-art VLA models large
Technical Approach: This paper constructs the LangGap benchmark, based on a four-dimensional semantic perturbation method — varying instruction semantics while keeping the tabletop layout fixed — revealing language understanding deficits in π0.5.
技術方法: 本文提出的方法:This paper constructs the LangGap benchmark, based on a four-dimensional semantic perturbation method — varying instruction semantics while keeping the tabletop layout fixed — revealing language und
Key Takeaway: Experiments show that targeted data augmentation can partially close the language gap — success rate improves from 0% to 90% with single-task training, and 0% to 28% with multi-task training.
核心發現: 核心結果:Experiments show that targeted data augmentation can partially close the language gap — success rate improves from 0% to 90% with single-task training, and 0% to 28% with multi-task training.
Optimal-Horizon Social Robot Navigation in Heterogeneous Crowds
Authors: Jiamin Shi, Haolin Zhang, Yuchen Yan et al. | Submitted: 2026-02-28 | arXiv: 2603.00507
Categories: cs.RO
Research Background: Navigating social robots in dense, dynamic crowds is challenging due to environmental uncertainty and complex human-robot interactions. While Model Predictive Control (MPC) offers strong real-time performance, its reliance on a fixed prediction horizon limits adaptability to changing environments and social dynamics.
研究背景: 在機器人學習領域,Navigating social robots in dense, dynamic crowds is challenging due to environmental uncertainty and complex human-robot interactions. While Model Predictive Control (MPC) offers
Technical Approach: In this paper, we identify the planning horizon as a socially conditioned decision variable rather than a fixed design choice. Building on this insight, we propose an optimal-horizon social navigation framework that optimizes MPC foresight online according to inferred social context.
技術方法: 本文提出的方法:In this paper, we identify the planning horizon as a socially conditioned decision variable rather than a fixed design choice. Building on this insight, we propose an optimal-horizon social navigation
Key Takeaway: Compared to state-of-the-art baselines, the proposed approach achieves a 6.8% improvement in success rate, reduces collisions by 50%, and shortens navigation time by 19%, with a low timeout rate of 0.8%, validating the necessity of socially optimal planning horizons for efficient and safe robot navigation in crowded environments.
核心發現: 核心結果:Compared to state-of-the-art baselines, the proposed approach achieves a 6.8% improvement in success rate, reduces collisions by 50%, and shortens navigation time by 19%, with a low timeout rate of
Zero-Shot Robotic Manipulation via 3D Gaussian Splatting-Enhanced Multimodal Retrieval-Augmented Generation
Authors: Zilong Xie, Jingyu Gong, Xin Tan et al. | Submitted: 2026-02-28 | arXiv: 2603.00500
Categories: cs.RO
Research Background: Existing end-to-end approaches of robotic manipulation often lack generalization to unseen objects or tasks due to limited data and poor interpretability. While recent Multimodal Large Language Models (MLLMs) demonstrate strong commonsense reasoning, they struggle with geometric and spatial understanding required for pose prediction.
研究背景: 在機器人學習領域,Existing end-to-end approaches of robotic manipulation often lack generalization to unseen objects or tasks due to limited data and poor interpretability. While recent Multimodal L
Technical Approach: In this paper, we propose RobMRAG, a 3D Gaussian Splatting-Enhanced Multimodal Retrieval-Augmented Generation (MRAG) framework for zero-shot robotic manipulation. Extensive experiments show that on a test set containing 30 categories of household objects, our method improves the success rate by 7.76% compared to the best-performing zero-shot baseline under the same setting, and by 6.54% compared to the state-of-the-art supervised baseline.
技術方法: 本文提出的方法:In this paper, we propose RobMRAG, a 3D Gaussian Splatting-Enhanced Multimodal Retrieval-Augmented Generation (MRAG) framework for zero-shot robotic manipulation. Extensive experiments show that on a
Key Takeaway: Our results validate that RobMRAG effectively bridges the gap between high-level semantic reasoning and low-level geometric execution, enabling robotic systems that generalize to unseen objects while remaining inherently interpretable.
核心發現: 核心結果:Our results validate that RobMRAG effectively bridges the gap between high-level semantic reasoning and low-level geometric execution, enabling robotic systems that generalize to unseen objects while
TMR-VLA:Vision-Language-Action Model for Magnetic Motion Control of Tri-leg Silicone-based Soft Robot
Authors: Ruijie Tang, Chi Kit Ng, Kaixuan Wu et al. | Submitted: 2026-02-28 | arXiv: 2603.00420
Categories: cs.RO, cs.AI, eess.SY
Research Background: In-vivo environments, magnetically actuated soft robots offer advantages such as wireless operation and precise control, showing promising potential for painless detection and therapeutic procedures. We developed a trileg magnetically driven soft robot (TMR) whose multi-legged design enables more flexible gaits and diverse motion patterns.
研究背景: 在機器人學習領域,In-vivo environments, magnetically actuated soft robots offer advantages such as wireless operation and precise control, showing promising potential for painless detection and ther
Technical Approach: We developed a trileg magnetically driven soft robot (TMR) whose multi-legged design enables more flexible gaits and diverse motion patterns. To bridge motion type description and specific low-level voltage control, we introduced TMR-VLA, an end-to-end multi-modal system for a trileg magnetic soft robot capable of performing hybrid motion types, which is promising for developing a navigation ability by adapting its shape to language-constrained motion types.
技術方法: 本文提出的方法:We developed a trileg magnetically driven soft robot (TMR) whose multi-legged design enables more flexible gaits and diverse motion patterns. To bridge motion type description and specific low-level v
Key Takeaway: The TMR-VLA reached a 74% average success rate.
核心發現: 核心結果:The TMR-VLA reached a 74% average success rate.
Spherical Latent Motion Prior for Physics-Based Simulated Humanoid Control
Authors: Jing Tan, Weisheng Xu, Xiangrui Jiang et al. | Submitted: 2026-03-01 | arXiv: 2603.01294
Categories: cs.RO
Research Background: Learning motion priors for physics-based humanoid control is an active research topic. Existing approaches mainly include variational autoencoders (VAE) and adversarial motion priors (AMP).
研究背景: 在機器人學習領域,Learning motion priors for physics-based humanoid control is an active research topic. Existing approaches mainly include variational autoencoders (VAE) and adversarial motion prio
Technical Approach: We present the Spherical Latent Motion Prior (SLMP), a two-stage method for learning motion priors.
技術方法: 本文提出的方法:We present the Spherical Latent Motion Prior (SLMP), a two-stage method for learning motion priors.
Key Takeaway: To evaluate SLMP, we collect a two-hour human combat motion capture dataset and show that SLMP preserves fine motion detail without information loss, and random sampling yields semantically valid and stable behaviors.
核心發現: 核心結果:To evaluate SLMP, we collect a two-hour human combat motion capture dataset and show that SLMP preserves fine motion detail without information loss, and random sampling yields semantically valid and
RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Design
Authors: Tianxing Chen, Yuran Wang, Mingleyang Li et al. | Submitted: 2026-03-01 | arXiv: 2603.01229
Categories: cs.RO, cs.AI
Research Background: Robotic manipulation policies have made rapid progress in recent years, yet most existing approaches give limited consideration to memory capabilities. Consequently, they struggle to solve tasks that require reasoning over historical observations and maintaining task-relevant information over time, which are common requirements in real-world manipulation scenarios.
研究背景: 在機器人學習領域,Robotic manipulation policies have made rapid progress in recent years, yet most existing approaches give limited consideration to memory capabilities. Consequently, they struggle
Technical Approach: To address this gap, we introduce RMBench, a simulation benchmark comprising 9 manipulation tasks that span multiple levels of memory complexity, enabling systematic evaluation of policy memory capabilities.
技術方法: 本文提出的方法:To address this gap, we introduce RMBench, a simulation benchmark comprising 9 manipulation tasks that span multiple levels of memory complexity, enabling systematic evaluation of policy memory capabi
Key Takeaway: Through extensive simulation and real-world experiments, we identify memory-related limitations in existing policies and provide empirical insights into how architectural design choices influence memory performance.
核心發現: 核心結果:Through extensive simulation and real-world experiments, we identify memory-related limitations in existing policies and provide empirical insights into how architectural design choices influence memo
Monocular 3D Object Position Estimation with VLMs for Human-Robot Interaction
Authors: Ari Wahl, Dorian Gawlinski, David Przewozny et al. | Submitted: 2026-03-01 | arXiv: 2603.01224
Categories: cs.CV, cs.AI, cs.HC, cs.LG, cs.RO
Research Background: Pre-trained general-purpose Vision-Language Models (VLM) hold the potential to enhance intuitive human-machine interactions due to their rich world knowledge and 2D object detection capabilities. However, VLMs for 3D coordinates detection tasks are rare.
研究背景: 在機器人學習領域,Pre-trained general-purpose Vision-Language Models (VLM) hold the potential to enhance intuitive human-machine interactions due to their rich world knowledge and 2D object detectio
Technical Approach: However, VLMs for 3D coordinates detection tasks are rare. In this work, we investigate interactive abilities of VLMs by returning 3D object positions given a monocular RGB image from a wrist-mounted camera, natural language input, and robot states. We collected and curated a heterogeneous dataset of more than 100,000 images and finetuned a VLM using QLoRA with a custom regression head.
技術方法: 本文提出的方法:However, VLMs for 3D coordinates detection tasks are rare. In this work, we investigate interactive abilities of VLMs by returning 3D object positions given a monocular RGB image from a wrist-mounted
Key Takeaway: Our results demonstrate robust predictive performance with a median MAE of 13 mm on the test set and a five-fold improvement over a simpler baseline without finetuning.
核心發現: 核心結果:Our results demonstrate robust predictive performance with a median MAE of 13 mm on the test set and a five-fold improvement over a simpler baseline without finetuning.
Agent-Based Simulation of Trust Development in Human-Robot Teams: An Empirically-Validated Framework
Authors: Ravi Kalluri | Submitted: 2026-03-01 | arXiv: 2603.01189
Categories: cs.RO, cs.HC
Research Background: This paper presents an empirically grounded agent-based model capturing trust dynamics, workload distribution, and collaborative performance in human-robot teams. The model, implemented in NetLogo 6.4.0, simulates teams of 2—10 agents performing tasks of varying complexity.
研究背景: 在機器人學習領域,This paper presents an empirically grounded agent-based model capturing trust dynamics, workload distribution, and collaborative performance in human-robot teams. The model, implem
Technical Approach: This paper presents an empirically grounded agent-based model capturing trust dynamics, workload distribution, and collaborative performance in human-robot teams.
技術方法: 本文提出的方法:This paper presents an empirically grounded agent-based model capturing trust dynamics, workload distribution, and collaborative performance in human-robot teams.
Key Takeaway: Scenario analysis uncovered trust-performance decoupling: the Trust Recovery scenario achieved the highest productivity (4.29) despite the lowest trust (38.2), while the Unreliable Robot scenario produced the highest trust (73.2) despite the lowest task success (33.4%), establishing calibration error as a critical diagnostic distinct from trust magnitude.
核心發現: 核心結果:Scenario analysis uncovered trust-performance decoupling: the Trust Recovery scenario achieved the highest productivity (4.29) despite the lowest trust (38.2), while the Unreliable Robot scenario prod
A Deployable Bio-inspired Compliant Leg Design for Enhanced Leaping in Quadruped Robots
Authors: Yiyang Chen, Yuxin Liu, Jinzheng Zhou et al. | Submitted: 2026-03-01 | arXiv: 2603.01128
Categories: cs.RO
Research Background: Quadruped robots are becoming increasingly essential for various applications, including industrial inspection and catastrophe search and rescue. These scenarios require robots to possess enhanced agility and obstacle-navigation skills.
研究背景: 在機器人學習領域,Quadruped robots are becoming increasingly essential for various applications, including industrial inspection and catastrophe search and rescue. These scenarios require robots to
Technical Approach: To address this challenge, this paper proposes a bio-inspired method that emulates the energy-storage mechanism found in froghopper legs. We designed a Deployable Compliant Leg (DCL) utilizing a specialized 3D-printed elastic material, Polyether block amide (PEBA), featuring a lightweight internal lattice structure.
技術方法: 本文提出的方法:To address this challenge, this paper proposes a bio-inspired method that emulates the energy-storage mechanism found in froghopper legs. We designed a Deployable Compliant Leg (DCL) utilizing a speci
Key Takeaway: Through finite element analysis (FEA) and experimental validation, we demonstrate a relative performance improvement of 17.1% in vertical jumping height.
核心發現: 核心結果:Through finite element analysis (FEA) and experimental validation, we demonstrate a relative performance improvement of 17.1% in vertical jumping height.
Fast Confidence-Aware Human Prediction via Hardware-accelerated Bayesian Inference for Safe Robot Navigation
Authors: Michael Lu, Minh Bui, Xubo Lyu et al. | Submitted: 2026-03-01 | arXiv: 2603.01122
Categories: cs.RO
Research Background: As robots increasingly integrate into everyday environments, ensuring their safe navigation around humans becomes imperative. Efficient and safe motion planning requires robots to account for human behavior, particularly in constrained spaces such as grocery stores or care homes, where interactions with multiple individuals are common.
研究背景: 在機器人學習領域,As robots increasingly integrate into everyday environments, ensuring their safe navigation around humans becomes imperative. Efficient and safe motion planning requires robots to
Technical Approach: In this work, we present a simple yet novel approach for confidence-aware prediction that treats future predictions as particles. We validate our approach through real-world experiments, demonstrating a robot safely navigating among multiple humans with diverse navigational goals.
技術方法: 本文提出的方法:In this work, we present a simple yet novel approach for confidence-aware prediction that treats future predictions as particles. We validate our approach through real-world experiments, demonstrating
Key Takeaway: Our results highlight the methods potential for robust and efficient human-robot coexistence in dynamic environments.
核心發現: 核心結果:Our results highlight the methods potential for robust and efficient human-robot coexistence in dynamic environments.
Compact Task-Aligned Imitation Learning for Laboratory Automation
Authors: Kanata Suzuki, Hanon Nakamurama, Kana Miyamoto et al. | Submitted: 2026-03-01 | arXiv: 2603.01110
Categories: cs.RO
Research Background: Robotic laboratory automation has traditionally relied on carefully engineered motion pipelines and task-specific hardware interfaces, resulting in high design cost and limited flexibility. While recent imitation learning techniques can generate general robot behaviors, their large model sizes often require high-performance computational resources, limiting applicability in practical laboratory environments.
研究背景: 在機器人學習領域,Robotic laboratory automation has traditionally relied on carefully engineered motion pipelines and task-specific hardware interfaces, resulting in high design cost and limited fle
Technical Approach: In this study, we propose a compact imitation learning framework for laboratory automation using small foundation models.
技術方法: 本文提出的方法:In this study, we propose a compact imitation learning framework for laboratory automation using small foundation models.
Key Takeaway: These results indicate that small foundation models, when properly aligned and integrated with diffusion-based policy learning, can effectively support practical laboratory automation with limited computational resources.
核心發現: 核心結果:These results indicate that small foundation models, when properly aligned and integrated with diffusion-based policy learning, can effectively support practical laboratory automation with limited com
DAM-VLA: A Dynamic Action Model-Based Vision-Language-Action Framework for Robot Manipulation
Authors: Xiongfeng Peng, Jiaqian Yu, Dingzhe Li et al. | Submitted: 2026-03-01 | arXiv: 2603.00926
Categories: cs.RO
Research Background: In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely adapted from pre-trained Vision-Language Models (VLMs), often struggle to reconcile general task adaptability with the specialized precision required for intricate manipulation.
研究背景: 在機器人學習領域,In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. Howeve
Technical Approach: To address this challenge, we propose DAM-VLA, a dynamic action model-based VLA framework.
技術方法: 本文提出的方法:To address this challenge, we propose DAM-VLA, a dynamic action model-based VLA framework.
Key Takeaway: Across extensive evaluations, DAM-VLA achieves superior success rates compared to state-of-the-art VLA methods in simulated (SIMPLER, FurnitureBench) and real-world settings, showing robust generalization from standard pick-and-place to demanding long-horizon and contact-rich tasks.
核心發現: 核心結果:Across extensive evaluations, DAM-VLA achieves superior success rates compared to state-of-the-art VLA methods in simulated (SIMPLER, FurnitureBench) and real-world settings, showing robust generaliza
ProFocus: Proactive Perception and Focused Reasoning in Vision-and-Language Navigation
Authors: Wei Xue, Mingcheng Li, Xuecheng Wu et al. | Submitted: 2026-03-01 | arXiv: 2603.05530
Categories: cs.RO, cs.CV
Research Background: Vision-and-Language Navigation (VLN) requires agents to accurately perceive complex visual environments and reason over navigation instructions and histories. However, existing methods passively process redundant visual inputs and treat all historical contexts indiscriminately, resulting in inefficient perception and unfocused reasoning.
研究背景: 在機器人學習領域,Vision-and-Language Navigation (VLN) requires agents to accurately perceive complex visual environments and reason over navigation instructions and histories. However, existing met
Technical Approach: To address these challenges, we propose \textbf{ProFocus}, a training-free progressive framework that unifies \underline{Pro}active Perception and \underline{Focus}ed Reasoning through collaboration between large language models (LLMs) and vision-language models (VLMs). For focused reasoning, we propose Branch-Diverse Monte Carlo Tree Search (BD-MCTS) to identify top- high-value waypoints from extensive historical candidates.
技術方法: 本文提出的方法:To address these challenges, we propose \textbf{ProFocus}, a training-free progressive framework that unifies \underline{Pro}active Perception and \underline{Focus}ed Reasoning through collaboration b
Key Takeaway: Extensive experiments validate the effectiveness of ProFocus, achieving state-of-the-art performance among zero-shot methods on R2R and REVERIE benchmarks.
核心發現: 核心結果:Extensive experiments validate the effectiveness of ProFocus, achieving state-of-the-art performance among zero-shot methods on R2R and REVERIE benchmarks.
A Novel Reconfigurable Dexterous Hand Based on Triple-Symmetric Bricard Parallel Mechanism
Authors: Chunxu Tian, Zhichao Huang, Hongzeng Li et al. | Submitted: 2026-03-01 | arXiv: 2603.00892
Categories: cs.RO
Research Background: This paper introduces a novel design for a robotic hand based on parallel mechanisms. The proposed hand uses a triple-symmetric Bricard linkage as its reconfigurable palm, enhancing adaptability to objects of varying shapes and sizes.
研究背景: 在機器人學習領域,This paper introduces a novel design for a robotic hand based on parallel mechanisms. The proposed hand uses a triple-symmetric Bricard linkage as its reconfigurable palm, enhancin
Technical Approach: This paper introduces a novel design for a robotic hand based on parallel mechanisms.
技術方法: 本文提出的方法:This paper introduces a novel design for a robotic hand based on parallel mechanisms.
Key Takeaway: The results validate the effectiveness of the design in improving grasping versatility and operational precision, offering a promising solution for advanced robotic manipulation tasks.
核心發現: 核心結果:The results validate the effectiveness of the design in improving grasping versatility and operational precision, offering a promising solution for advanced robotic manipulation tasks.
Characterizing VLA Models: Identifying the Action Generation Bottleneck for Edge AI Architectures
Authors: Manoj Vishwanathan, Suvinay Subramanian, Anand Raghunathan | Submitted: 2026-03-01 | arXiv: 2603.02271
Categories: cs.PF, cs.AI, cs.AR, cs.RO
Research Background: Vision-Language-Action (VLA) models are an emerging class of workloads critical for robotics and embodied AI at the edge. As these models scale, they demonstrate significant capability gains, yet they must be deployed locally to meet the strict latency requirements of real-time applications.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models are an emerging class of workloads critical for robotics and embodied AI at the edge. As these models scale, they demonstrate significant capabi
Technical Approach: This paper characterizes VLA performance on two generations of edge hardware, viz. the Nvidia Jetson Orin and Thor platforms.
技術方法: 本文提出的方法:This paper characterizes VLA performance on two generations of edge hardware, viz. the Nvidia Jetson Orin and Thor platforms.
Key Takeaway: Using MolmoAct-7B, a state-of-the-art VLA model, we identify a primary execution bottleneck: up to 75% of end-to-end latency is consumed by the memory-bound action-generation phase.
核心發現: 核心結果:Using MolmoAct-7B, a state-of-the-art VLA model, we identify a primary execution bottleneck: up to 75% of end-to-end latency is consumed by the memory-bound action-generation phase.
Energy-Based Injury Protection Database: Including Shearing Contact Thresholds for Hand and Finger Using Porcine Surrogates
Authors: Robin Jeanne Kirschner, Anna Huber, Carina M. Micheler et al. | Submitted: 2026-02-23 | arXiv: 2602.20362
Categories: cs.RO
Research Background: While robotics research continues to propose strategies for collision avoidance in human-robot interaction, the reality of constrained environments and future humanoid systems makes contact inevitable. To mitigate injury risks, energy-constraining control approaches are commonly used, often relying on safety thresholds derived from blunt impact data in EN ISO 10218-2:2025.
研究背景: 在機器人學習領域,While robotics research continues to propose strategies for collision avoidance in human-robot interaction, the reality of constrained environments and future humanoid systems make
Technical Approach: To mitigate injury risks, energy-constraining control approaches are commonly used, often relying on safety thresholds derived from blunt impact data in EN ISO 10218-2:2025. However, this dataset does not extend to edged or pointed collisions. Without scalable, clinically grounded datasets covering diverse contact scenarios, safety validation remains limited.
技術方法: 本文提出的方法:To mitigate injury risks, energy-constraining control approaches are commonly used, often relying on safety thresholds derived from blunt impact data in EN ISO 10218-2:2025. However, this dataset does
Key Takeaway: By reevaluating all prior porcine surrogate data, we establish energy thresholds across geometries and contact types, forming the first energy-based Injury Protection Database.
核心發現: 核心結果:By reevaluating all prior porcine surrogate data, we establish energy thresholds across geometries and contact types, forming the first energy-based Injury Protection Database.
CACTO-BIC: Scalable Actor-Critic Learning via Biased Sampling and GPU-Accelerated Trajectory Optimization
Authors: Elisa Alboni, Pietro Noah Crestaz, Elias Fontanari et al. | Submitted: 2026-02-23 | arXiv: 2602.19699
Categories: cs.RO, math.OC
Research Background: Trajectory Optimization (TO) and Reinforcement Learning (RL) offer complementary strengths for solving optimal control problems. TO efficiently computes locally optimal solutions but can struggle with non-convexity, while RL is more robust to non-convexity at the cost of significantly higher computational demands.
研究背景: 在機器人學習領域,Trajectory Optimization (TO) and Reinforcement Learning (RL) offer complementary strengths for solving optimal control problems. TO efficiently computes locally optimal solutions b
Technical Approach: Comparisons with PPO demonstrate that our approach can achieve similar solutions in less time.
技術方法: 本文提出的方法:Comparisons with PPO demonstrate that our approach can achieve similar solutions in less time.
Key Takeaway: Finally, experiments on the AlienGO quadruped robot demonstrate that CACTO-BIC can scale to high-dimensional systems and is suitable for real-time applications.
核心發現: 核心結果:Finally, experiments on the AlienGO quadruped robot demonstrate that CACTO-BIC can scale to high-dimensional systems and is suitable for real-time applications.
Positioning Modular Co-Design in Future HRI Design Research
Authors: Lingyun Chen, Qing Xiao, Zitao Zhang et al. | Submitted: 2026-02-23 | arXiv: 2602.19422
Categories: cs.HC, cs.RO
Research Background: Design-oriented HRI is increasingly interested in robots as long-term companions, yet many designs still assume a fixed form and a stable set of functions. We present an ongoing design research program that treats modularity as a designerly medium - a way to make long-term human-robot relationships discussable and material through co-design.
研究背景: 在機器人學習領域,Design-oriented HRI is increasingly interested in robots as long-term companions, yet many designs still assume a fixed form and a stable set of functions. We present an ongoing de
Technical Approach: We present an ongoing design research program that treats modularity as a designerly medium - a way to make long-term human-robot relationships discussable and material through co-design.
技術方法: 本文提出的方法:We present an ongoing design research program that treats modularity as a designerly medium - a way to make long-term human-robot relationships discussable and material through co-design.
Key Takeaway: We then sketch next steps toward a fabrication-aware, community-extensible modular platform and propose evaluation criteria for designerly HRI work that prioritize expressive adequacy, lifespan plausibility, repairability-in-use, and responsible stewardship - not only usability or performance.
核心發現: 核心結果:We then sketch next steps toward a fabrication-aware, community-extensible modular platform and propose evaluation criteria for designerly HRI work that prioritize expressive adequacy, lifespan plausi
Hilbert-Augmented Reinforcement Learning for Scalable Multi-Robot Coverage and Exploration
Authors: Tamil Selvan Gurunathan, Aryya Gangopadhyay | Submitted: 2026-02-23 | arXiv: 2602.19400
Categories: cs.RO, cs.AI, cs.MA
Research Background: We present a coverage framework that integrates Hilbert space-filling priors into decentralized multi-robot learning and execution. We augment DQN and PPO with Hilbert-based spatial indices to structure exploration and reduce redundancy in sparse-reward environments, and we evaluate scalability in multi-robot grid coverage.
研究背景: 在機器人學習領域,We present a coverage framework that integrates Hilbert space-filling priors into decentralized multi-robot learning and execution. We augment DQN and PPO with Hilbert-based spatia
Technical Approach: We present a coverage framework that integrates Hilbert space-filling priors into decentralized multi-robot learning and execution.
技術方法: 本文提出的方法:We present a coverage framework that integrates Hilbert space-filling priors into decentralized multi-robot learning and execution.
Key Takeaway: These results indicate that geometric priors improve autonomy and scalability for swarm and legged robotics.
核心發現: 核心結果:These results indicate that geometric priors improve autonomy and scalability for swarm and legged robotics.
VLA Knows Its Limits
Authors: Haoxuan Wang, Gengyu Zhang, Yan Yan et al. | Submitted: 2026-02-24 | arXiv: 2602.21445
Categories: cs.RO
Research Background: Action chunking has recently emerged as a standard practice in flow-based Vision-Language-Action (VLA) models. However, the effect and choice of the execution horizon - the number of actions to be executed from each predicted chunk - remains underexplored.
研究背景: 在機器人學習領域,Action chunking has recently emerged as a standard practice in flow-based Vision-Language-Action (VLA) models. However, the effect and choice of the execution horizon - the number
Technical Approach: However, the effect and choice of the execution horizon - the number of actions to be executed from each predicted chunk - remains underexplored. In this work, we first show that varying the execution horizon leads to substantial performance deviations, with performance initially improving and then declining as the horizon increases. To uncover the reasons, we analyze the cross- and self-attention weights in flow-based VLAs and reveal two key phenomena: (i) intra-chunk actions attend invariantly to vision-language tokens, limiting adaptability to environmental changes; and (ii) the initial and terminal action tokens serve as stable anchors, forming latent centers around which intermediate actions are organized.
技術方法: 本文提出的方法:However, the effect and choice of the execution horizon - the number of actions to be executed from each predicted chunk - remains underexplored. In this work, we first show that varying the execution
Key Takeaway: Across simulated and real-world robotic manipulation tasks, AutoHorizon is performant, incurs negligible computational overhead, and generalizes across diverse tasks and flow-based models.
核心發現: 核心結果:Across simulated and real-world robotic manipulation tasks, AutoHorizon is performant, incurs negligible computational overhead, and generalizes across diverse tasks and flow-based models.
ActionReasoning: Robot Action Reasoning in 3D Space with LLM for Robotic Brick Stacking
Authors: Guangming Wang, Qizhen Ying, Yixiong Jing et al. | Submitted: 2026-02-24 | arXiv: 2602.21161
Categories: cs.RO
Research Background: Classical robotic systems typically rely on custom planners designed for constrained environments. While effective in restricted settings, these systems lack generalization capabilities, limiting the scalability of embodied AI and general-purpose robots.
研究背景: 在機器人學習領域,Classical robotic systems typically rely on custom planners designed for constrained environments. While effective in restricted settings, these systems lack generalization capabil
Technical Approach: To address this gap, we propose ActionReasoning, an LLM-driven framework that performs explicit action reasoning to produce physics-consistent, prior-guided decisions for robotic manipulation.
技術方法: 本文提出的方法:To address this gap, we propose ActionReasoning, an LLM-driven framework that performs explicit action reasoning to produce physics-consistent, prior-guided decisions for robotic manipulation.
Key Takeaway: The experiments demonstrate that the proposed multi-agent LLM framework enables stable brick placement while shifting effort from low-level domain-specific coding to high-level tool invocation and prompting, highlighting its potential for broader generalization.
核心發現: 核心結果:The experiments demonstrate that the proposed multi-agent LLM framework enables stable brick placement while shifting effort from low-level domain-specific coding to high-level tool invocation and pro
A Robotic Testing Platform for Pipelined Discovery of Resilient Soft Actuators
Authors: Ang Li, Alexander Yin, Alexander White et al. | Submitted: 2026-02-24 | arXiv: 2602.20963
Categories: cs.RO
Research Background: Short lifetime under high electrical fields hinders the widespread robotic application of linear dielectric elastomer actuators (DEAs). Systematic scanning is difficult due to time-consuming per-sample testing and the high-dimensional parameter space affecting performance.
研究背景: 在機器人學習領域,Short lifetime under high electrical fields hinders the widespread robotic application of linear dielectric elastomer actuators (DEAs). Systematic scanning is difficult due to time
Technical Approach: To address this, we propose an optimization pipeline enabled by a novel testing robot capable of scanning DEA lifetime.
技術方法: 本文提出的方法:To address this, we propose an optimization pipeline enabled by a novel testing robot capable of scanning DEA lifetime.
Key Takeaway: The final product demonstrated resilience on a modular, scalable quadruped walking robot with payload carrying capacity (>100% of its untethered body weight, and >700% of combined actuator weight).
核心發現: 核心結果:The final product demonstrated resilience on a modular, scalable quadruped walking robot with payload carrying capacity (>100% of its untethered body weight, and >700% of combined actuator weight).
Task-oriented grasping for dexterous robots using postural synergies and reinforcement learning
Authors: Dimitrios Dimou, José Santos-Victor, Plinio Moreno | Submitted: 2026-02-24 | arXiv: 2602.20915
Categories: cs.RO
Research Background: In this paper, we address the problem of task-oriented grasping for humanoid robots, emphasizing the need to align with human social norms and task-specific objectives. Existing methods, employ a variety of open-loop and closed-loop approaches but lack an end-to-end solution that can grasp several objects while taking into account the downstream task’s constraints.
研究背景: 在機器人學習領域,In this paper, we address the problem of task-oriented grasping for humanoid robots, emphasizing the need to align with human social norms and task-specific objectives. Existing me
Technical Approach: In this paper, we address the problem of task-oriented grasping for humanoid robots, emphasizing the need to align with human social norms and task-specific objectives.
技術方法: 本文提出的方法:In this paper, we address the problem of task-oriented grasping for humanoid robots, emphasizing the need to align with human social norms and task-specific objectives.
Key Takeaway: By combining data-driven insights from human grasping behavior with learning by exploration provided by reinforcement learning, we can develop humanoid robots capable of context-aware manipulation actions, facilitating collaboration in human-centered environments.
核心發現: 核心結果:By combining data-driven insights from human grasping behavior with learning by exploration provided by reinforcement learning, we can develop humanoid robots capable of context-aware manipulation act
Grasp to Act: Dexterous Grasping for Tool Use in Dynamic Settings
Authors: Harsh Gupta, Mohammad Amin Mirzaee, Wenzhen Yuan | Submitted: 2026-02-24 | arXiv: 2602.20466
Categories: cs.RO
Research Background: Achieving robust grasping with dexterous hands remains challenging, especially when manipulation involves dynamic forces such as impacts, torques, and continuous resistance—situations common in real-world tool use. Existing methods largely optimize grasps for static geometric stability and often fail once external forces arise during manipulation.
研究背景: 在機器人學習領域,Achieving robust grasping with dexterous hands remains challenging, especially when manipulation involves dynamic forces such as impacts, torques, and continuous resistance—situat
Technical Approach: We present Grasp-to-Act, a hybrid system that combines physics-based grasp optimization with reinforcement-learning-based grasp adaptation to maintain stable grasps throughout functional manipulation tasks. Our method synthesizes robust grasp configurations informed by human demonstrations and employs an adaptive controller that residually issues joint corrections to prevent in-hand slip while tracking the object trajectory. Across simulation and real-world hardware trials with a 16-DoF dexterous hand, our method reduces translational and rotational in-hand slip and achieves the highest task completion rates, demonstrating stable functional grasps under dynamic, contact-rich conditions.
技術方法: 本文提出的方法:We present Grasp-to-Act, a hybrid system that combines physics-based grasp optimization with reinforcement-learning-based grasp adaptation to maintain stable grasps throughout functional manipulation
Key Takeaway: Across simulation and real-world hardware trials with a 16-DoF dexterous hand, our method reduces translational and rotational in-hand slip and achieves the highest task completion rates, demonstrating stable functional grasps under dynamic, contact-rich conditions.
核心發現: 核心結果:Across simulation and real-world hardware trials with a 16-DoF dexterous hand, our method reduces translational and rotational in-hand slip and achieves the highest task completion rates, demonstratin
Provably Safe Generative Sampling with Constricting Barrier Functions
Authors: Darshan Gadginmath, Ahmed Allibhoy, Fabio Pasqualetti | Submitted: 2026-02-24 | arXiv: 2602.21429
Categories: cs.LG, cs.AI, eess.SY, math.OC
Research Background: Flow-based generative models, such as diffusion models and flow matching models, have achieved remarkable success in learning complex data distributions. However, a critical gap remains for their deployment in safety-critical domains: the lack of formal guarantees that generated samples will satisfy hard constraints.
研究背景: 在機器人學習領域,Flow-based generative models, such as diffusion models and flow matching models, have achieved remarkable success in learning complex data distributions. However, a critical gap re
Technical Approach: Our framework applies to any pre-trained flow-based generative scheme requiring no retraining or architectural modifications.
技術方法: 本文提出的方法:Our framework applies to any pre-trained flow-based generative scheme requiring no retraining or architectural modifications.
Key Takeaway: Flow-based generative models, such as diffusion models and flow matching models, have achieved remarkable success in learning complex data distributions.
核心發現: 核心結果:Flow-based generative models, such as diffusion models and flow matching models, have achieved remarkable success in learning complex data distributions.
Inner Speech as Behavior Guides: Steerable Imitation of Diverse Behaviors for Human-AI coordination
Authors: Rakshit Trivedi, Kartik Sharma, David C Parkes | Submitted: 2026-02-24 | arXiv: 2602.20517
Categories: cs.AI, cs.CL, cs.LG
Research Background: Effective human-AI coordination requires artificial agents capable of exhibiting and responding to human-like behaviors while adapting to changing contexts. Imitation learning has emerged as one of the prominent approaches to build such agents by training them to mimic human-demonstrated behaviors.
研究背景: 在機器人學習領域,Effective human-AI coordination requires artificial agents capable of exhibiting and responding to human-like behaviors while adapting to changing contexts. Imitation learning has
Technical Approach: Drawing inspiration from the theory of human cognitive processes, where inner speech guides action selection before execution, we propose MIMIC (Modeling Inner Motivations for Imitation and Control), a framework that uses language as an internal representation of behavioral intent.
技術方法: 本文提出的方法:Drawing inspiration from the theory of human cognitive processes, where inner speech guides action selection before execution, we propose MIMIC (Modeling Inner Motivations for Imitation and Control),
Key Takeaway: Experiments across robotic manipulation tasks and human-AI collaboration games demonstrate that MIMIC significantly enhances both behavior diversity and fidelity to human demonstrations while enabling nuanced behavioral steering without training on additional demonstrations.
核心發現: 核心結果:Experiments across robotic manipulation tasks and human-AI collaboration games demonstrate that MIMIC significantly enhances both behavior diversity and fidelity to human demonstrations while enabling
From Perception to Action: An Interactive Benchmark for Vision Reasoning
Authors: Yuhao Wu, Maojia Song, Yihuai Lan et al. | Submitted: 2026-02-24 | arXiv: 2602.21015
Categories: cs.CV
Research Background: Understanding the physical structure is essential for real-world applications such as embodied agents, interactive design, and long-horizon manipulation. Yet, prevailing Vision-Language Model (VLM) evaluations still center on structure-agnostic, single-turn setups (e.g., VQA), which fail to assess agents’ ability to reason about how geometry, contact, and support relations jointly constrain what actions are possible in a dynamic environment.
研究背景: 在機器人學習領域,Understanding the physical structure is essential for real-world applications such as embodied agents, interactive design, and long-horizon manipulation. Yet, prevailing Vision-Lan
Technical Approach: To address this gap, we introduce the Causal Hierarchy of Actions and Interactions (CHAIN) benchmark, an interactive 3D, physics-driven testbed designed to evaluate whether models can understand, plan, and execute structured action sequences grounded in physical constraints.
技術方法: 本文提出的方法:To address this gap, we introduce the Causal Hierarchy of Actions and Interactions (CHAIN) benchmark, an interactive 3D, physics-driven testbed designed to evaluate whether models can understand, plan
Key Takeaway: Our results show that top-performing models still struggle to internalize physical structure and causal constraints, often failing to produce reliable long-horizon plans and cannot robustly translate perceived structure into effective actions.
核心發現: 核心結果:Our results show that top-performing models still struggle to internalize physical structure and causal constraints, often failing to produce reliable long-horizon plans and cannot robustly translate
When to Act, Ask, or Learn: Uncertainty-Aware Policy Steering
Authors: Jessie Yuan, Yilin Wu, Andrea Bajcsy | Submitted: 2026-02-25 | arXiv: 2602.22474
Categories: cs.RO, cs.LG
Research Background: Policy steering is an emerging way to adapt robot behaviors at deployment-time: a learned verifier analyzes low-level action samples proposed by a pre-trained policy (e.g., diffusion policy) and selects only those aligned with the task. While Vision-Language Models (VLMs) are promising general-purpose verifiers due to their reasoning capabilities, existing frameworks often assume these models are well-calibrated.
研究背景: 在機器人學習領域,Policy steering is an emerging way to adapt robot behaviors at deployment-time: a learned verifier analyzes low-level action samples proposed by a pre-trained policy (e.g., diffusi
Technical Approach: We propose uncertainty-aware policy steering (UPS), a framework that jointly reasons about semantic task uncertainty and low-level action feasibility, and selects an uncertainty resolution strategy: execute a high-confidence action, clarify task ambiguity via natural language queries, or ask for action interventions to correct the low-level policy when it is deemed incapable at the task. We leverage conformal prediction to calibrate the composition of the VLM and the pre-trained base policy, providing statistical assurances that the verifier selects the correct strategy. We demonstrate our framework through experiments in simulation and on hardware, showing that UPS can disentangle confident, ambiguous, and incapable scenarios and minimizes expensive user interventions compared to uncalibrated baselines and prior human- or robot-gated continual learning approaches.
技術方法: 本文提出的方法:We propose uncertainty-aware policy steering (UPS), a framework that jointly reasons about semantic task uncertainty and low-level action feasibility, and selects an uncertainty resolution strategy: e
Key Takeaway: We demonstrate our framework through experiments in simulation and on hardware, showing that UPS can disentangle confident, ambiguous, and incapable scenarios and minimizes expensive user interventions compared to uncalibrated baselines and prior human- or robot-gated continual learning approaches.
核心發現: 核心結果:We demonstrate our framework through experiments in simulation and on hardware, showing that UPS can disentangle confident, ambiguous, and incapable scenarios and minimizes expensive user intervention
Detection and Recognition: A Pairwise Interaction Framework for Mobile Service Robots
Authors: Mengyu Liang, Sarah Gillet Schlegel, Iolanda Leite | Submitted: 2026-02-25 | arXiv: 2602.22346
Categories: cs.RO
Research Background: Autonomous mobile service robots, like lawnmowers or cleaning robots, operating in human-populated environments need to reason about local human-human interactions to support safe and socially aware navigation while fulfilling their tasks. For such robots, interaction understanding is not primarily a fine-grained recognition problem, but a perception problem under limited sensing quality and computational resources.
研究背景: 在機器人學習領域,Autonomous mobile service robots, like lawnmowers or cleaning robots, operating in human-populated environments need to reason about local human-human interactions to support safe
Technical Approach: To this end, we adopt a two-stage framework in which candidate interacting pairs are first identified based on lightweight geometric and motion cues, and interaction types are subsequently classified using a relation network.
技術方法: 本文提出的方法:To this end, we adopt a two-stage framework in which candidate interacting pairs are first identified based on lightweight geometric and motion cues, and interaction types are subsequently classified
Key Takeaway: These results suggest that pairwise geometric and motion cues provide a practical basis for interaction perception on mobile service robot providing a promising method for integration into mobile robot navigation stacks in future work.
核心發現: 核心結果:These results suggest that pairwise geometric and motion cues provide a practical basis for interaction perception on mobile service robot providing a promising method for integration into mobile robo
Behavioral Cloning for Robotic Connector Assembly: An Empirical Study
Authors: Andreas Kernbach, Daniel Bargmann, Werner Kraus et al. | Submitted: 2026-02-25 | arXiv: 2602.22100
Categories: cs.RO
Research Background: Automating the assembly of wire harnesses is challenging in automotive, electrical cabinet, and aircraft production, particularly due to deformable cables and a high variance in connector geometries. In addition, connectors must be inserted with limited force to avoid damage, while their poses can vary significantly.
研究背景: 在機器人學習領域,Automating the assembly of wire harnesses is challenging in automotive, electrical cabinet, and aircraft production, particularly due to deformable cables and a high variance in co
Technical Approach: In addition, connectors must be inserted with limited force to avoid damage, while their poses can vary significantly. While humans can do this task intuitively by combining visual and haptic feedback, programming an industrial robot for such a task in an adaptable manner remains difficult. This work presents an empirical study investigating the suitability of behavioral cloning for learning an action prediction model for connector insertion that fuses force-torque sensing with a fixed position camera.
技術方法: 本文提出的方法:In addition, connectors must be inserted with limited force to avoid damage, while their poses can vary significantly. While humans can do this task intuitively by combining visual and haptic feedback
Key Takeaway: The resulting system is then evaluated against five different connector geometries under varying connector poses, achieving an overall insertion success rate of over 90 %.
核心發現: 核心結果:The resulting system is then evaluated against five different connector geometries under varying connector poses, achieving an overall insertion success rate of over 90 %.
Trust in Autonomous Human—Robot Collaboration: Effects of Responsive Interaction Policies
Authors: Shauna Heron, Meng Cheng Lau | Submitted: 2026-02-25 | arXiv: 2603.00154
Categories: cs.RO, cs.HC
Research Background: Trust plays a central role in human—robot collaboration, yet its formation is rarely examined under the constraints of fully autonomous interaction. This pilot study investigated how interaction policy influences trust during in-person collaboration with a social robot operating without Wizard-of-Oz control or scripted repair.
研究背景: 在機器人學習領域,Trust plays a central role in human—robot collaboration, yet its formation is rarely examined under the constraints of fully autonomous interaction. This pilot study investigated
Technical Approach: This pilot study investigated how interaction policy influences trust during in-person collaboration with a social robot operating without Wizard-of-Oz control or scripted repair. Participants completed a multi-stage collaborative task with a mobile robot that autonomously managed spoken-language dialogue, affect inference, and task progression. Two interaction policies were compared: a responsive policy, in which the robot proactively adapted its dialogue and assistance based on inferred interaction state, and a neutral, reactive policy, in which the robot provided only direct, task-relevant responses when prompted.
技術方法: 本文提出的方法:This pilot study investigated how interaction policy influences trust during in-person collaboration with a social robot operating without Wizard-of-Oz control or scripted repair. Participants complet
Key Takeaway: These findings suggest that trust in autonomous human—robot interaction emerges from process-level interaction dynamics and operates within constraints imposed by communication viability, highlighting the importance of evaluating trust under real autonomy conditions when designing interactive robotic systems.
核心發現: 核心結果:These findings suggest that trust in autonomous human—robot interaction emerges from process-level interaction dynamics and operates within constraints imposed by communication viability, highlightin
World Guidance: World Modeling in Condition Space for Action Generation
Authors: Yue Su, Sijin Chen, Haixin Shi et al. | Submitted: 2026-02-25 | arXiv: 2602.22010
Categories: cs.RO, cs.CV
Research Background: Leveraging future observation modeling to facilitate action generation presents a promising avenue for enhancing the capabilities of Vision-Language-Action (VLA) models. However, existing approaches struggle to strike a balance between maintaining efficient, predictable future representations and preserving sufficient fine-grained information to guide precise action generation.
研究背景: 在機器人學習領域,Leveraging future observation modeling to facilitate action generation presents a promising avenue for enhancing the capabilities of Vision-Language-Action (VLA) models. However, e
Technical Approach: To address this limitation, we propose WoG (World Guidance), a framework that maps future observations into compact conditions by injecting them into the action inference pipeline. Extensive experiments across both simulation and real-world environments validate that our method significantly outperforms existing methods based on future prediction.
技術方法: 本文提出的方法:To address this limitation, we propose WoG (World Guidance), a framework that maps future observations into compact conditions by injecting them into the action inference pipeline. Extensive experimen
Key Takeaway: Extensive experiments across both simulation and real-world environments validate that our method significantly outperforms existing methods based on future prediction.
核心發現: 核心結果:Extensive experiments across both simulation and real-world environments validate that our method significantly outperforms existing methods based on future prediction.
Are Foundation Models the Route to Full-Stack Transfer in Robotics?
Authors: Freek Stulp, Samuel Bustamante, João Silvério et al. | Submitted: 2026-02-25 | arXiv: 2602.22001
Categories: cs.RO
Research Background: In humans and robots alike, transfer learning occurs at different levels of abstraction, from high-level linguistic transfer to low-level transfer of motor skills. In this article, we provide an overview of the impact that foundation models and transformer networks have had on these different levels, bringing robots closer than ever to “full-stack transfer”.
研究背景: 在機器人學習領域,In humans and robots alike, transfer learning occurs at different levels of abstraction, from high-level linguistic transfer to low-level transfer of motor skills. In this article,
Technical Approach: In this article, we provide an overview of the impact that foundation models and transformer networks have had on these different levels, bringing robots closer than ever to “full-stack transfer”. Considering LLMs, VLMs and VLAs from a robotic transfer learning perspective allows us to highlight recurring concepts for transfer, beyond specific implementations. We also consider the challenges of data collection and transfer benchmarks for robotics in the age of foundation models.
技術方法: 本文提出的方法:In this article, we provide an overview of the impact that foundation models and transformer networks have had on these different levels, bringing robots closer than ever to “full-stack transfer”. Con
Key Takeaway: Our expectation is that they will certainly stay on this route as a key technology.
核心發現: 核心結果:Our expectation is that they will certainly stay on this route as a key technology.
Enhancing Cellular-enabled Collaborative Robots Planning through GNSS data for SAR Scenarios
Authors: Arnau Romero, Carmen Delgado, Jana Baguer et al. | Submitted: 2026-02-25 | arXiv: 2602.21899
Categories: cs.RO, cs.NI
Research Background: Cellular-enabled collaborative robots are becoming paramount in Search-and-Rescue (SAR) and emergency response. Crucially dependent on resilient mobile network connectivity, they serve as invaluable assets for tasks like rapid victim localization and the exploration of hazardous, otherwise unreachable areas.
研究背景: 在機器人學習領域,Cellular-enabled collaborative robots are becoming paramount in Search-and-Rescue (SAR) and emergency response. Crucially dependent on resilient mobile network connectivity, they s
Technical Approach: To address this, and considering the evolving capabilities of 5G/6G networks, we propose a novel SAR framework that includes Mission Planning and Mission Execution phases and that optimizes robot deployment. By considering parameters such as the exploration area size, terrain elevation, robot fleet size, communication-influenced energy profiles, desired exploration rate, and target response time, our framework determines the minimum number of robots required and their optimal paths to ensure effective coverage and timely data backhaul over mobile networks.
技術方法: 本文提出的方法:To address this, and considering the evolving capabilities of 5G/6G networks, we propose a novel SAR framework that includes Mission Planning and Mission Execution phases and that optimizes robot depl
Key Takeaway: Our results demonstrate the trade-offs between number of robots, explored area, and response time for wheeled and quadruped robots.
核心發現: 核心結果:Our results demonstrate the trade-offs between number of robots, explored area, and response time for wheeled and quadruped robots.
Therapist-Robot-Patient Physical Interaction is Worth a Thousand Words: Enabling Intuitive Therapist Guidance via Remote Haptic Control
Authors: Beatrice Luciani, Alex van den Berg, Matti Lang et al. | Submitted: 2026-02-25 | arXiv: 2602.21783
Categories: cs.RO, cs.LG
Research Background: Robotic systems can enhance the amount and repeatability of physically guided motor training. Yet their real-world adoption is limited, partly due to non-intuitive trainer/therapist-trainee/patient interactions.
研究背景: 在機器人學習領域,Robotic systems can enhance the amount and repeatability of physically guided motor training. Yet their real-world adoption is limited, partly due to non-intuitive trainer/therapis
Technical Approach: To address this gap, we present a haptic teleoperation system for trainers to remotely guide and monitor the movements of a trainee wearing an arm exoskeleton.
技術方法: 本文提出的方法:To address this gap, we present a haptic teleoperation system for trainers to remotely guide and monitor the movements of a trainee wearing an arm exoskeleton.
Key Takeaway: Future work should assess its usability and efficacy for clinical populations in restoring clinicians’ sense of agency during robot-assisted therapy.
核心發現: 核心結果:Future work should assess its usability and efficacy for clinical populations in restoring clinicians’ sense of agency during robot-assisted therapy.
Joint-Aligned Latent Action: Towards Scalable VLA Pretraining in the Wild
Authors: Hao Luo, Ye Wang, Wanpeng Zhang et al. | Submitted: 2026-02-25 | arXiv: 2602.21736
Categories: cs.RO
Research Background: Despite progress, Vision-Language-Action models (VLAs) are limited by a scarcity of large-scale, diverse robot data. While human manipulation videos offer a rich alternative, existing methods are forced to choose between small, precisely-labeled datasets and vast in-the-wild footage with unreliable hand tracking labels.
研究背景: 在機器人學習領域,Despite progress, Vision-Language-Action models (VLAs) are limited by a scarcity of large-scale, diverse robot data. While human manipulation videos offer a rich alternative, exist
Technical Approach: We present JALA, a pretraining framework that learns Jointly-Aligned Latent Actions.
技術方法: 本文提出的方法:We present JALA, a pretraining framework that learns Jointly-Aligned Latent Actions.
Key Takeaway: These results indicate that jointly-aligned latent actions offer a scalable pathway for VLA pretraining from human data.
核心發現: 核心結果:These results indicate that jointly-aligned latent actions offer a scalable pathway for VLA pretraining from human data.
LessMimic: Long-Horizon Humanoid Interaction with Unified Distance Field Representations
Authors: Yutang Lin, Jieming Cui, Yixuan Li et al. | Submitted: 2026-02-25 | arXiv: 2602.21723
Categories: cs.RO
Research Background: Humanoid robots that autonomously interact with physical environments over extended horizons represent a central goal of embodied intelligence. Existing approaches rely on reference motions or task-specific rewards, tightly coupling policies to particular object geometries and precluding multi-skill generalization within a single framework.
研究背景: 在機器人學習領域,Humanoid robots that autonomously interact with physical environments over extended horizons represent a central goal of embodied intelligence. Existing approaches rely on referenc
Technical Approach: Existing approaches rely on reference motions or task-specific rewards, tightly coupling policies to particular object geometries and precluding multi-skill generalization within a single framework. A unified interaction representation enabling reference-free inference, geometric generalization, and long-horizon skill composition within one policy remains an open challenge. Here we show that Distance Field (DF) provides such a representation: LessMimic conditions a single whole-body policy on DF-derived geometric cues—surface distances, gradients, and velocity decompositions—removing the need for motion references, with interaction latents encoded via a Variational Auto-Encoder (VAE) and post-trained using Adversarial Interaction Priors (AIP) under Reinforcement Learning (RL).
技術方法: 本文提出的方法:Existing approaches rely on reference motions or task-specific rewards, tightly coupling policies to particular object geometries and precluding multi-skill generalization within a single framework. A
Key Takeaway: A single LessMimic policy achieves 80—100% success across object scales from 0.4x to 1.6x on PickUp and SitStand where baselines degrade sharply, attains 62.1% success on 5 task instances trajectories, and remains viable up to 40 sequentially composed tasks.
核心發現: 核心結果:A single LessMimic policy achieves 80—100% success across object scales from 0.4x to 1.6x on PickUp and SitStand where baselines degrade sharply, attains 62.1% success on 5 task instances trajectorie
Primary-Fine Decoupling for Action Generation in Robotic Imitation
Authors: Xiaohan Lei, Min Wang, Wengang Zhou et al. | Submitted: 2026-02-25 | arXiv: 2602.21684
Categories: cs.RO, cs.LG
Research Background: Multi-modal distribution in robotic manipulation action sequences poses critical challenges for imitation learning. To this end, existing approaches often model the action space as either a discrete set of tokens or a continuous, latent-variable distribution.
研究背景: 在機器人學習領域,Multi-modal distribution in robotic manipulation action sequences poses critical challenges for imitation learning. To this end, existing approaches often model the action space as
Technical Approach: To this end, existing approaches often model the action space as either a discrete set of tokens or a continuous, latent-variable distribution. To address these limitations, we propose Primary-Fine Decoupling for Action Generation (PF-DAG), a two-stage framework that decouples coarse action consistency from fine-grained variations.
技術方法: 本文提出的方法:To this end, existing approaches often model the action space as either a discrete set of tokens or a continuous, latent-variable distribution. To address these limitations, we propose Primary-Fine De
Key Takeaway: Our work demonstrates that explicit mode-level decoupling enables both robust multi-modal modeling and reactive closed-loop control for robotic manipulation.
核心發現: 核心結果:Our work demonstrates that explicit mode-level decoupling enables both robust multi-modal modeling and reactive closed-loop control for robotic manipulation.
Biomechanical Comparisons Reveal Divergence of Human and Humanoid Gaits
Authors: Luying Feng, Yaochu Jin, Hanze Hu et al. | Submitted: 2026-02-25 | arXiv: 2602.21666
Categories: cs.RO
Research Background: It remains challenging to achieve human-like locomotion in legged robots due to fundamental discrepancies between biological and mechanical structures. Although imitation learning has emerged as a promising approach for generating natural robotic movements, simply replicating joint angle trajectories fails to capture the underlying principles of human motion.
研究背景: 在機器人學習領域,It remains challenging to achieve human-like locomotion in legged robots due to fundamental discrepancies between biological and mechanical structures. Although imitation learning
Technical Approach: Although imitation learning has emerged as a promising approach for generating natural robotic movements, simply replicating joint angle trajectories fails to capture the underlying principles of human motion. This study proposes a Gait Divergence Analysis Framework (GDAF), a unified biomechanical evaluation framework that systematically quantifies kinematic and kinetic discrepancies between humans and bipedal robots. We apply GDAF to systematically compare human and humanoid locomotion across 28 walking speeds.
技術方法: 本文提出的方法:Although imitation learning has emerged as a promising approach for generating natural robotic movements, simply replicating joint angle trajectories fails to capture the underlying principles of huma
Key Takeaway: This work provides a quantitative benchmark for evaluating humanoid locomotion and offers data and versatile tools to support the development of more human-like and energetically efficient locomotion controllers.
核心發現: 核心結果:This work provides a quantitative benchmark for evaluating humanoid locomotion and offers data and versatile tools to support the development of more human-like and energetically efficient locomotion
Multiview Progress Prediction of Robot Activities
Authors: Elena Zoppellari, Federico Becattini, Marco Fiorucci et al. | Submitted: 2026-02-25 | arXiv: 2603.00151
Categories: cs.RO, cs.CV
Research Background: For robots to operate effectively and safely alongside humans, they must be able to understand the progress of ongoing actions. This ability, known as action progress prediction, is critical for tasks ranging from timely assistance to autonomous decision-making.
研究背景: 在機器人學習領域,For robots to operate effectively and safely alongside humans, they must be able to understand the progress of ongoing actions. This ability, known as action progress prediction, i
Technical Approach: In this paper, we propose a multi-view architecture for action progress prediction in robot manipulation tasks.
技術方法: 本文提出的方法:In this paper, we propose a multi-view architecture for action progress prediction in robot manipulation tasks.
Key Takeaway: Experiments on Mobile ALOHA demonstrate the effectiveness of the proposed approach.
核心發現: 核心結果:Experiments on Mobile ALOHA demonstrate the effectiveness of the proposed approach.
Self-Correcting VLA: Online Action Refinement via Sparse World Imagination
Authors: Chenyv Liu, Wentao Tan, Lei Zhu et al. | Submitted: 2026-02-25 | arXiv: 2602.21633
Categories: cs.RO, cs.AI, cs.CV
Research Background: Standard vision-language-action (VLA) models rely on fitting statistical data priors, limiting their robust understanding of underlying physical dynamics. Reinforcement learning enhances physical grounding through exploration yet typically relies on external reward signals that remain isolated from the agent’s internal states.
研究背景: 在機器人學習領域,Standard vision-language-action (VLA) models rely on fitting statistical data priors, limiting their robust understanding of underlying physical dynamics. Reinforcement learning en
Technical Approach: To solve these problems, we propose Self-Correcting VLA (SC-VLA), which achieve self-improvement by intrinsically guiding action refinement through sparse imagination. Then we introduce the online action refinement module to reshape progress-dependent dense rewards, adjusting trajectory orientation based on the predicted sparse future states.
技術方法: 本文提出的方法:To solve these problems, we propose Self-Correcting VLA (SC-VLA), which achieve self-improvement by intrinsically guiding action refinement through sparse imagination. Then we introduce the online act
Key Takeaway: Evaluations on challenging robot manipulation tasks from simulation benchmarks and real-world settings demonstrate that SC-VLA achieve state-of-the-art performance, yielding the highest task throughput with 16% fewer steps and a 9% higher success rate than the best-performing baselines, alongside a 14% gain in real-world experiments.
核心發現: 核心結果:Evaluations on challenging robot manipulation tasks from simulation benchmarks and real-world settings demonstrate that SC-VLA achieve state-of-the-art performance, yielding the highest task throughpu
Tacmap: Bridging the Tactile Sim-to-Real Gap via Geometry-Consistent Penetration Depth Map
Authors: Lei Su, Zhijie Peng, Renyuan Ren et al. | Submitted: 2026-02-25 | arXiv: 2602.21625
Categories: cs.RO
Research Background: Vision-Based Tactile Sensors (VBTS) are essential for achieving dexterous robotic manipulation, yet the tactile sim-to-real gap remains a fundamental bottleneck. Current tactile simulations suffer from a persistent dilemma: simplified geometric projections lack physical authenticity, while high-fidelity Finite Element Methods (FEM) are too computationally prohibitive for large-scale reinforcement learning.
研究背景: 在機器人學習領域,Vision-Based Tactile Sensors (VBTS) are essential for achieving dexterous robotic manipulation, yet the tactile sim-to-real gap remains a fundamental bottleneck. Current tactile si
Technical Approach: In this work, we present Tacmap, a high-fidelity, computationally efficient tactile simulation framework anchored in volumetric penetration depth.
技術方法: 本文提出的方法:In this work, we present Tacmap, a high-fidelity, computationally efficient tactile simulation framework anchored in volumetric penetration depth.
Key Takeaway: Moreover, we validate the utility of Tacmap through an in-hand rotation task, where a policy trained exclusively in simulation achieves zero-shot transfer to a physical robot.
核心發現: 核心結果:Moreover, we validate the utility of Tacmap through an in-hand rotation task, where a policy trained exclusively in simulation achieves zero-shot transfer to a physical robot.
LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policies
Authors: Yue Yang, Shuo Cheng, Yu Fang et al. | Submitted: 2026-02-25 | arXiv: 2602.21531
Categories: cs.RO, cs.AI, cs.CV, cs.LG, eess.SY
Research Background: General-purpose robots must master long-horizon manipulation, defined as tasks involving multiple kinematic structure changes (e.g., attaching or detaching objects) in unstructured environments. While Vision-Language-Action (VLA) models offer the potential to master diverse atomic skills, they struggle with the combinatorial complexity of sequencing them and are prone to cascading failures due to environmental sensitivity.
研究背景: 在機器人學習領域,General-purpose robots must master long-horizon manipulation, defined as tasks involving multiple kinematic structure changes (e.g., attaching or detaching objects) in unstructured
Technical Approach: To address these challenges, we propose LiLo-VLA (Linked Local VLA), a modular framework capable of zero-shot generalization to novel long-horizon tasks without ever being trained on them. Our approach decouples transport from interaction: a Reaching Module handles global motion, while an Interaction Module employs an object-centric VLA to process isolated objects of interest, ensuring robustness against irrelevant visual features and invariance to spatial configurations. We introduce a 21-task simulation benchmark consisting of two challenging suites: LIBERO-Long++ and Ultra-Long.
技術方法: 本文提出的方法:To address these challenges, we propose LiLo-VLA (Linked Local VLA), a modular framework capable of zero-shot generalization to novel long-horizon tasks without ever being trained on them. Our approac
Key Takeaway: Furthermore, real-world evaluations across 8 long-horizon tasks demonstrate an average success rate of 85%.
核心發現: 核心結果:Furthermore, real-world evaluations across 8 long-horizon tasks demonstrate an average success rate of 85%.
Evaluating Zero-Shot and One-Shot Adaptation of Small Language Models in Leader-Follower Interaction
Authors: Rafael R. Baptista, André de Lima Salgado, Ricardo V. Godoy et al. | Submitted: 2026-02-26 | arXiv: 2602.23312
Categories: cs.HC, cs.AI, cs.LG, cs.RO, eess.SY
Research Background: Leader-follower interaction is an important paradigm in human-robot interaction (HRI). Yet, assigning roles in real time remains challenging for resource-constrained mobile and assistive robots.
研究背景: 在機器人學習領域,Leader-follower interaction is an important paradigm in human-robot interaction (HRI). Yet, assigning roles in real time remains challenging for resource-constrained mobile and ass
Technical Approach: In this paper, we present a benchmark of SLMs for leader-follower communication, introducing a novel dataset derived from a published database and augmented with synthetic samples to capture interaction-specific dynamics.
技術方法: 本文提出的方法:In this paper, we present a benchmark of SLMs for leader-follower communication, introducing a novel dataset derived from a published database and augmented with synthetic samples to capture interacti
Key Takeaway: These findings demonstrate that fine-tuned SLMs provide an effective solution for direct role assignment, while highlighting critical trade-offs between dialogue complexity and classification reliability on the edge.
核心發現: 核心結果:These findings demonstrate that fine-tuned SLMs provide an effective solution for direct role assignment, while highlighting critical trade-offs between dialogue complexity and classification reliabil
Mollified Value Learning
Authors: Hrishikesh Viswanath, Juanwu Lu, S. Talha Bukhari et al. | Submitted: 2026-02-26 | arXiv: 2602.23280
Categories: cs.LG, cs.RO
Research Background: Offline goal-conditioned reinforcement learning (GCRL) learns goal-reaching behaviors from static datasets, but accurate value estimation remains challenging under limited state-action coverage. Existing physics-informed approaches address this by imposing pointwise distance-like geometric constraints derived from Hamilton—Jacobi—Bellman (HJB) optimality principles, often through first-order partial differential equations such as the Eikonal equation.
研究背景: 在機器人學習領域,Offline goal-conditioned reinforcement learning (GCRL) learns goal-reaching behaviors from static datasets, but accurate value estimation remains challenging under limited state-ac
Technical Approach: Existing physics-informed approaches address this by imposing pointwise distance-like geometric constraints derived from Hamilton—Jacobi—Bellman (HJB) optimality principles, often through first-order partial differential equations such as the Eikonal equation. However, enforcing local consistency through explicit differential structure can become unstable in complex, high-dimensional environments. Our key insight is to instead reinterpret distance-like constraints as an expectation over a local spatial measure.
技術方法: 本文提出的方法:Existing physics-informed approaches address this by imposing pointwise distance-like geometric constraints derived from Hamilton—Jacobi—Bellman (HJB) optimality principles, often through first-orde
Key Takeaway: Experiments across navigation and high-dimensional robotic manipulation tasks show that MVL learns structured, value representations, improving goal-reaching performance, when used with implicit value representation learning methods.
核心發現: 核心結果:Experiments across navigation and high-dimensional robotic manipulation tasks show that MVL learns structured, value representations, improving goal-reaching performance, when used with implicit value
Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving
Authors: Jiangxin Sun, Feng Xue, Teng Long et al. | Submitted: 2026-02-26 | arXiv: 2602.23259
Categories: cs.CV, cs.AI, cs.RO
Research Background: With advances in imitation learning (IL) and large-scale driving datasets, end-to-end autonomous driving (E2E-AD) has made great progress recently. Currently, IL-based methods have become a mainstream paradigm: models rely on standard driving behaviors given by experts, and learn to minimize the discrepancy between their actions and expert actions.
研究背景: 在機器人學習領域,With advances in imitation learning (IL) and large-scale driving datasets, end-to-end autonomous driving (E2E-AD) has made great progress recently. Currently, IL-based methods have
Technical Approach: Motivated by this, we propose a unified framework named Risk-aware World Model Predictive Control (RaWMPC) to address this generalization dilemma through robust control, without reliance on expert demonstrations. To endow the world model with the ability to predict the outcomes of risky driving behaviors, we design a risk-aware interaction strategy that systematically exposes the world model to hazardous behaviors, making catastrophic outcomes predictable and thus avoidable. Furthermore, to generate low-risk candidate actions at test time, we introduce a self-evaluation distillation method to distill riskavoidance capabilities from the well-trained world model into a generative action proposal network without any expert demonstration.
技術方法: 本文提出的方法:Motivated by this, we propose a unified framework named Risk-aware World Model Predictive Control (RaWMPC) to address this generalization dilemma through robust control, without reliance on expert dem
Key Takeaway: Extensive experiments show that RaWMPC outperforms state-of-the-art methods in both in-distribution and out-of-distribution scenarios, while providing superior decision interpretability.
核心發現: 核心結果:Extensive experiments show that RaWMPC outperforms state-of-the-art methods in both in-distribution and out-of-distribution scenarios, while providing superior decision interpretability.
Grasp, Slide, Roll: Comparative Analysis of Contact Modes for Tactile-Based Shape Reconstruction
Authors: Chung Hee Kim, Shivani Kamtikar, Tye Brady et al. | Submitted: 2026-02-26 | arXiv: 2602.23206
Categories: cs.RO
Research Background: Tactile sensing allows robots to gather detailed geometric information about objects through physical interaction, complementing vision-based approaches. However, efficiently acquiring useful tactile data remains challenging due to the time-consuming nature of physical contact and the need to strategically choose contact locations that maximize information gain while minimizing physical interactions.
研究背景: 在機器人學習領域,Tactile sensing allows robots to gather detailed geometric information about objects through physical interaction, complementing vision-based approaches. However, efficiently acqui
Technical Approach: This paper studies how different contact modes affect object shape reconstruction using a tactile-enabled dexterous gripper. We validate our approach using a UR5e robot arm equipped with an Inspire-Robots Dexterous Hand, showing robust performance across primitive object geometries.
技術方法: 本文提出的方法:This paper studies how different contact modes affect object shape reconstruction using a tactile-enabled dexterous gripper. We validate our approach using a UR5e robot arm equipped with an Inspire-Ro
Key Takeaway: Our results show that the improved tactile sensing efficiency of finger-grazing and palm-rolling translates into faster convergence in shape reconstruction, requiring 34% fewer physical interactions while improving reconstruction accuracy by 55%.
核心發現: 核心結果:Our results show that the improved tactile sensing efficiency of finger-grazing and palm-rolling translates into faster convergence in shape reconstruction, requiring 34% fewer physical interactions w
DigiArm: An Anthropomorphic 3D-Printed Prosthetic Hand with Enhanced Dexterity for Typing Tasks
Authors: Dean Zadok, Tom Naamani, Yuval Bar-Ratson et al. | Submitted: 2026-02-26 | arXiv: 2602.23017
Categories: cs.RO
Research Background: Despite recent advancements, existing prosthetic limbs are unable to replicate the dexterity and intuitive control of the human hand. Current control systems for prosthetic hands are often limited to grasping, and commercial prosthetic hands lack the precision needed for dexterous manipulation or applications that require fine finger motions.
研究背景: 在機器人學習領域,Despite recent advancements, existing prosthetic limbs are unable to replicate the dexterity and intuitive control of the human hand. Current control systems for prosthetic hands a
Technical Approach: This paper presents a low-cost, lightweight, 3D-printed robotic prosthetic hand, specifically engineered for enhanced dexterity with electronic devices such as a computer keyboard or piano, as well as general object manipulation.
技術方法: 本文提出的方法:This paper presents a low-cost, lightweight, 3D-printed robotic prosthetic hand, specifically engineered for enhanced dexterity with electronic devices such as a computer keyboard or piano, as well as
Key Takeaway: We conducted a study to demonstrate how participants can use the robotic hand to perform keyboard typing and piano playing in real time, with different levels of finger and wrist motion.
核心發現: 核心結果:We conducted a study to demonstrate how participants can use the robotic hand to perform keyboard typing and piano playing in real time, with different levels of finger and wrist motion.
A Perspective on Open Challenges in Deformable Object Manipulation
Authors: Ryan Paul McKennaa, John Oyekan | Submitted: 2026-02-26 | arXiv: 2602.22998
Categories: cs.RO
Research Background: Deformable object manipulation (DOM) represents a critical challenge in robotics, with applications spanning healthcare, manufacturing, food processing, and beyond. Unlike rigid objects, deformable objects exhibit infinite dimensionality, dynamic shape changes, and complex interactions with their environment, posing significant hurdles for perception, modeling, and control.
研究背景: 在機器人學習領域,Deformable object manipulation (DOM) represents a critical challenge in robotics, with applications spanning healthcare, manufacturing, food processing, and beyond. Unlike rigid ob
Technical Approach: This paper reviews the state of the art in DOM, focusing on key challenges such as occlusion handling, task generalization, and scalable, real-time solutions.
技術方法: 本文提出的方法:This paper reviews the state of the art in DOM, focusing on key challenges such as occlusion handling, task generalization, and scalable, real-time solutions.
Key Takeaway: By addressing these challenges, DOM research can pave the way for versatile robotic systems capable of handling diverse and dynamic tasks with deformable objects.
核心發現: 核心結果:By addressing these challenges, DOM research can pave the way for versatile robotic systems capable of handling diverse and dynamic tasks with deformable objects.
GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion
Authors: Enda Xiang, Haoxiang Ma, Xinzhu Ma et al. | Submitted: 2026-02-26 | arXiv: 2602.22862
Categories: cs.RO, cs.CV
Research Background: This paper focuses on enhancing the grasping precision and generalization of manipulation policies learned via imitation learning. Diffusion-based policy learning methods have recently become the mainstream approach for robotic manipulation tasks.
研究背景: 在機器人學習領域,This paper focuses on enhancing the grasping precision and generalization of manipulation policies learned via imitation learning. Diffusion-based policy learning methods have rece
Technical Approach: This paper focuses on enhancing the grasping precision and generalization of manipulation policies learned via imitation learning. Furthermore, we introduce a self-supervised reconstruction objective during diffusion to embed the graspness prior: at each reverse diffusion step, we reconstruct wrist-camera images back-projected the graspness from the intermediate representations. Both simulation and real robot experiments demonstrate that our approach significantly outperforms baseline methods and exhibits strong dynamic grasping capabilities.
技術方法: 本文提出的方法:This paper focuses on enhancing the grasping precision and generalization of manipulation policies learned via imitation learning. Furthermore, we introduce a self-supervised reconstruction objective
Key Takeaway: Both simulation and real robot experiments demonstrate that our approach significantly outperforms baseline methods and exhibits strong dynamic grasping capabilities.
核心發現: 核心結果:Both simulation and real robot experiments demonstrate that our approach significantly outperforms baseline methods and exhibits strong dynamic grasping capabilities.
Designing Robots for Families: In-Situ Prototyping for Contextual Reminders on Family Routines
Authors: Michael F. Xu, Enhui Zhao, Yawen Zhang et al. | Submitted: 2026-02-26 | arXiv: 2602.22628
Categories: cs.RO
Research Background: Robots are increasingly entering the daily lives of families, yet their successful integration into domestic life remains a challenge. We explore family routines as a critical entry point for understanding how robots might find a sustainable role in everyday family settings.
研究背景: 在機器人學習領域,Robots are increasingly entering the daily lives of families, yet their successful integration into domestic life remains a challenge. We explore family routines as a critical entr
Technical Approach: We explore family routines as a critical entry point for understanding how robots might find a sustainable role in everyday family settings. Together with each of the ten families, we co-designed robot interactions and behaviors, and a plan for the robot to support their chosen routines, accounting for contextual factors such as timing, participants, locations, and the activities in the environment. We then designed, prototyped, and deployed a mobile social robot as a four-day, in-home user study.
技術方法: 本文提出的方法:We explore family routines as a critical entry point for understanding how robots might find a sustainable role in everyday family settings. Together with each of the ten families, we co-designed robo
Key Takeaway: Based on these insights, we offer design implications for robot-facilitated contextual reminders and discuss broader considerations for designing robots for family settings.
核心發現: 核心結果:Based on these insights, we offer design implications for robot-facilitated contextual reminders and discuss broader considerations for designing robots for family settings.
Metamorphic Testing of Vision-Language Action-Enabled Robots
Authors: Pablo Valle, Sergio Segura, Shaukat Ali et al. | Submitted: 2026-02-26 | arXiv: 2602.22579
Categories: cs.RO, cs.SE
Research Background: Vision-Language-Action (VLA) models are multimodal robotic task controllers that, given an instruction and visual inputs, produce a sequence of low-level control actions (or motor commands) enabling a robot to execute the requested task in the physical environment. These systems face the test oracle problem from multiple perspectives.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models are multimodal robotic task controllers that, given an instruction and visual inputs, produce a sequence of low-level control actions (or motor
Technical Approach: In this paper, we explore whether Metamorphic Testing (MT) can alleviate the test oracle problem in this context. To do so, we propose two metamorphic relation patterns and five metamorphic relations to assess whether changes to the test inputs impact the original trajectory of the VLA-enabled robots.
技術方法: 本文提出的方法:In this paper, we explore whether Metamorphic Testing (MT) can alleviate the test oracle problem in this context. To do so, we propose two metamorphic relation patterns and five metamorphic relations
Key Takeaway: On the other hand, current state-of-the-art oracles typically capture symbolic representations of the world (e.g., robot and object states), enabling the correctness evaluation of a task, but fail to assess other critical aspects, such as the quality with which VLA-enabled robots perform a task.
核心發現: 核心結果:On the other hand, current state-of-the-art oracles typically capture symbolic representations of the world (e.g., robot and object states), enabling the correctness evaluation of a task, but fail to
ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposals
Authors: Xuelu Li, Zhaonan Wang, Xiaogang Wang et al. | Submitted: 2026-02-26 | arXiv: 2602.22666
Categories: cs.CV
Research Background: Reconstructing articulated objects into high-fidelity digital twins is crucial for applications such as robotic manipulation and interactive simulation. Recent self-supervised methods using differentiable rendering frameworks like 3D Gaussian Splatting remain highly sensitive to the initial part segmentation.
研究背景: 在機器人學習領域,Reconstructing articulated objects into high-fidelity digital twins is crucial for applications such as robotic manipulation and interactive simulation. Recent self-supervised meth
Technical Approach: To address these limitations, we propose ArtPro, a novel self-supervised framework that introduces adaptive integration of mobility proposals. Our approach begins with an over-segmentation initialization guided by geometry features and motion priors, generating part proposals with plausible motion hypotheses.
技術方法: 本文提出的方法:To address these limitations, we propose ArtPro, a novel self-supervised framework that introduces adaptive integration of mobility proposals. Our approach begins with an over-segmentation initializat
Key Takeaway: Extensive experiments on both synthetic and real-world objects demonstrate that ArtPro achieves robust reconstruction of complex multi-part objects, significantly outperforming existing methods in accuracy and stability.
核心發現: 核心結果:Extensive experiments on both synthetic and real-world objects demonstrate that ArtPro achieves robust reconstruction of complex multi-part objects, significantly outperforming existing methods in acc
Planning from Observation and Interaction
Authors: Tyler Han, Siyang Shen, Rohan Baijal et al. | Submitted: 2026-02-27 | arXiv: 2602.24121
Categories: cs.RO
Research Background: Observational learning requires an agent to learn to perform a task by referencing only observations of the performed task. This work investigates the equivalent setting in real-world robot learning where access to hand-designed rewards and demonstrator actions are not assumed.
研究背景: 在機器人學習領域,Observational learning requires an agent to learn to perform a task by referencing only observations of the performed task. This work investigates the equivalent setting in real-wo
Technical Approach: This work investigates the equivalent setting in real-world robot learning where access to hand-designed rewards and demonstrator actions are not assumed. To address this data-constrained setting, this work presents a planning-based Inverse Reinforcement Learning (IRL) algorithm for world modeling from observation and interaction alone. Experiments conducted entirely in the real-world demonstrate that this paradigm is effective for learning image-based manipulation tasks from scratch in under an hour, without assuming prior knowledge, pre-training, or data of any kind beyond task observations.
技術方法: 本文提出的方法:This work investigates the equivalent setting in real-world robot learning where access to hand-designed rewards and demonstrator actions are not assumed. To address this data-constrained setting, thi
Key Takeaway: In comparison to existing approaches, including IRL, RL, and Behavior Cloning (BC), which have more restrictive assumptions, the proposed approach demonstrates significantly greater sample efficiency and success rates, enabling a practical path forward for online world modeling and planning from observation and interaction.
核心發現: 核心結果:In comparison to existing approaches, including IRL, RL, and Behavior Cloning (BC), which have more restrictive assumptions, the proposed approach demonstrates significantly greater sample efficiency
OmniTrack: General Motion Tracking via Physics-Consistent Reference
Authors: Yuhan Li, Peiyuan Zhi, Yunshen Wang et al. | Submitted: 2026-02-27 | arXiv: 2602.23832
Categories: cs.RO
Research Background: Learning motion tracking from rich human motion data is a foundational task for achieving general control in humanoid robots, enabling them to perform diverse behaviors. However, discrepancies in morphology and dynamics between humans and robots, combined with data noise, introduce physically infeasible artifacts in reference motions, such as floating and penetration.
研究背景: 在機器人學習領域,Learning motion tracking from rich human motion data is a foundational task for achieving general control in humanoid robots, enabling them to perform diverse behaviors. However, d
Technical Approach: To address these challenges, we introduce OmniTrack, a general tracking framework that explicitly decouples physical feasibility from general motion tracking.
技術方法: 本文提出的方法:To address these challenges, we introduce OmniTrack, a general tracking framework that explicitly decouples physical feasibility from general motion tracking.
Key Takeaway: Additionally, we show that OmniTrack supports human-style stable and dynamic online teleoperation, highlighting its robustness and adaptability to varying user inputs.
核心發現: 核心結果:Additionally, we show that OmniTrack supports human-style stable and dynamic online teleoperation, highlighting its robustness and adaptability to varying user inputs.
SAGE-LLM: Towards Safe and Generalizable LLM Controller with Fuzzy-CBF Verification and Graph-Structured Knowledge Retrieval for UAV Decision
Authors: Wenzhe Zhao, Yang Zhao, Ganchao Liu et al. | Submitted: 2026-02-27 | arXiv: 2602.23719
Categories: cs.RO, cs.AI
Research Background: In UAV dynamic decision, complex and variable hazardous factors pose severe challenges to the generalization capability of algorithms. Despite offering semantic understanding and scene generalization, Large Language Models (LLM) lack domain-specific UAV control knowledge and formal safety assurances, restricting their direct applicability.
研究背景: 在機器人學習領域,In UAV dynamic decision, complex and variable hazardous factors pose severe challenges to the generalization capability of algorithms. Despite offering semantic understanding and s
Technical Approach: To bridge this gap, this paper proposes a train-free two-layer decision architecture based on LLMs, integrating high-level safety planning with low-level precise control.
技術方法: 本文提出的方法:To bridge this gap, this paper proposes a train-free two-layer decision architecture based on LLMs, integrating high-level safety planning with low-level precise control.
Key Takeaway: The proposed framework demonstrates strong extensibility, suggesting its potential for generalization to broader embodied intelligence systems and safety-critical control domains.
核心發現: 核心結果:The proposed framework demonstrates strong extensibility, suggesting its potential for generalization to broader embodied intelligence systems and safety-critical control domains.
VCA: Vision-Click-Action Framework for Precise Manipulation of Segmented Objects in Target Ambiguous Environments
Authors: Donggeon Kim, Seungwon Jan, Hyeonjun Park et al. | Submitted: 2026-02-27 | arXiv: 2602.23583
Categories: cs.RO
Research Background: The reliance on language in Vision-Language-Action (VLA) models introduces ambiguity, cognitive overhead, and difficulties in precise object identification and sequential task execution, particularly in environments with multiple visually similar objects. To address these limitations, we propose Vision-Click-Action (VCA), a framework that replaces verbose textual commands with direct, click-based visual interaction using pretrained segmentation models.
研究背景: 在機器人學習領域,The reliance on language in Vision-Language-Action (VLA) models introduces ambiguity, cognitive overhead, and difficulties in precise object identification and sequential task exec
Technical Approach: To address these limitations, we propose Vision-Click-Action (VCA), a framework that replaces verbose textual commands with direct, click-based visual interaction using pretrained segmentation models.
技術方法: 本文提出的方法:To address these limitations, we propose Vision-Click-Action (VCA), a framework that replaces verbose textual commands with direct, click-based visual interaction using pretrained segmentation models.
Key Takeaway: Experimental results validate that the proposed VCA framework achieves effective instance-level manipulation of specified target objects.
核心發現: 核心結果:Experimental results validate that the proposed VCA framework achieves effective instance-level manipulation of specified target objects.
Actor-Critic Pretraining for Proximal Policy Optimization
Authors: Andreas Kernbach, Amr Elsheikh, Nicolas Grupp et al. | Submitted: 2026-02-27 | arXiv: 2602.23804
Categories: cs.LG
Research Background: Reinforcement learning (RL) actor-critic algorithms enable autonomous learning but often require a large number of environment interactions, which limits their applicability in robotics. Leveraging expert data can reduce the number of required environment interactions.
研究背景: 在機器人學習領域,Reinforcement learning (RL) actor-critic algorithms enable autonomous learning but often require a large number of environment interactions, which limits their applicability in rob
Technical Approach: This paper proposes a pretraining approach for actor-critic algorithms like Proximal Policy Optimization (PPO) that uses expert demonstrations to initialize both networks.
技術方法: 本文提出的方法:This paper proposes a pretraining approach for actor-critic algorithms like Proximal Policy Optimization (PPO) that uses expert demonstrations to initialize both networks.
Key Takeaway: Experimental results show that actor-critic pretraining improves sample efficiency by 86.1% on average compared to no pretraining and by 30.9% to actor-only pretraining.
核心發現: 核心結果:Experimental results show that actor-critic pretraining improves sample efficiency by 86.1% on average compared to no pretraining and by 30.9% to actor-only pretraining.
Keyframe-Guided Structured Rewards for Reinforcement Learning in Long-Horizon Laboratory Robotics
Authors: Yibo Qiu, Shu’ang Sun, Haoliang Ye et al. | Submitted: 2026-02-28 | arXiv: 2603.00719
Categories: cs.RO
Research Background: Long-horizon precision manipulation in laboratory automation, such as pipette tip attachment and liquid transfer, requires policies that respect strict procedural logic while operating in continuous, high-dimensional state spaces. However, existing approaches struggle with reward sparsity, multi-stage structural constraints, and noisy or imperfect demonstrations, leading to inefficient exploration and unstable convergence.
研究背景: 在機器人學習領域,Long-horizon precision manipulation in laboratory automation, such as pipette tip attachment and liquid transfer, requires policies that respect strict procedural logic while opera
Technical Approach: We propose a Keyframe-Guided Reward Generation Framework that automatically extracts kinematics-aware keyframes from demonstrations, generates stage-wise targets via a diffusion-based predictor in latent space, and constructs a geometric progress-based reward to guide online reinforcement learning. Across four real-world laboratory tasks, including high-precision pipette attachment and dynamic liquid transfer, our method achieves an average success rate of 82% after 40—60 minutes of online fine-tuning. Compared with HG-DAgger (42%) and Hil-ConRFT (47%), our approach demonstrates the effectiveness of structured keyframe-guided rewards in overcoming exploration bottlenecks and providing a scalable solution for high-precision, long-horizon robotic laboratory automation.
技術方法: 本文提出的方法:We propose a Keyframe-Guided Reward Generation Framework that automatically extracts kinematics-aware keyframes from demonstrations, generates stage-wise targets via a diffusion-based predictor in lat
Key Takeaway: Compared with HG-DAgger (42%) and Hil-ConRFT (47%), our approach demonstrates the effectiveness of structured keyframe-guided rewards in overcoming exploration bottlenecks and providing a scalable solution for high-precision, long-horizon robotic laboratory automation.
核心發現: 核心結果:Compared with HG-DAgger (42%) and Hil-ConRFT (47%), our approach demonstrates the effectiveness of structured keyframe-guided rewards in overcoming exploration bottlenecks and providing a scalable sol
Hybrid TD3: Overestimation Bias Analysis and Stable Policy Optimization for Hybrid Action Space
Authors: Thanh-Tuan Tran, Thanh Nguyen Canh, Nak Young Chong et al. | Submitted: 2026-03-01 | arXiv: 2603.01302
Categories: cs.RO
Research Background: Reinforcement learning in discrete-continuous hybrid action spaces presents fundamental challenges for robotic manipulation, where high-level task decisions and low-level joint-space execution must be jointly optimized. Existing approaches either discretize continuous components or relax discrete choices into continuous approximations, which suffer from scalability limitations and training instability in high-dimensional action spaces and under domain randomization.
研究背景: 在機器人學習領域,Reinforcement learning in discrete-continuous hybrid action spaces presents fundamental challenges for robotic manipulation, where high-level task decisions and low-level joint-spa
Technical Approach: In this paper, we propose Hybrid TD3, an extension of Twin Delayed Deep Deterministic Policy Gradient (TD3) that natively handles parameterized hybrid action spaces in a principled manner. Building on this analysis, we introduce a weighted clipped Q-learning target that marginalizes over the discrete action distribution, achieving equivalent bias reduction to standard clipped minimization while improving policy smoothness.
技術方法: 本文提出的方法:In this paper, we propose Hybrid TD3, an extension of Twin Delayed Deep Deterministic Policy Gradient (TD3) that natively handles parameterized hybrid action spaces in a principled manner. Building on
Key Takeaway: Experimental results demonstrate that Hybrid TD3 achieves superior training stability and competitive performance against state-of-the-art hybrid action baselines.
核心發現: 核心結果:Experimental results demonstrate that Hybrid TD3 achieves superior training stability and competitive performance against state-of-the-art hybrid action baselines.
Pro-HOI: Perceptive Root-guided Humanoid-Object Interaction
Authors: Yuhang Lin, Jiyuan Shi, Dewei Wang et al. | Submitted: 2026-03-01 | arXiv: 2603.01126
Categories: cs.RO
Research Background: Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI, a generalizable framework for robust humanoid loco-manipulation.
研究背景: 在機器人學習領域,Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanism
Technical Approach: In this work, we introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI, a generalizable framework for robust humanoid loco-manipulation. Second, we propose a novel training framework that conditions the policy on a desired root-trajectory while utilizing reference motion exclusively as a reward.
技術方法: 本文提出的方法:In this work, we introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI, a generalizable framework for robust humanoid loco-manipulation. Second, we propose a novel training framework t
Key Takeaway: Empirical validation on a Unitree G1 robot demonstrates that Pro-HOI significantly outperforms baselines in generalization and robustness, achieving reliable long-horizon execution in complex real-world scenarios.
核心發現: 核心結果:Empirical validation on a Unitree G1 robot demonstrates that Pro-HOI significantly outperforms baselines in generalization and robustness, achieving reliable long-horizon execution in complex real-wor
Minimalist Compliance Control
Authors: Haochen Shi, Songbo Hu, Yifan Hou et al. | Submitted: 2026-03-01 | arXiv: 2603.00913
Categories: cs.RO
Research Background: Compliance control is essential for safe physical interaction, yet its adoption is limited by hardware requirements such as force torque sensors. While recent reinforcement learning approaches aim to bypass these constraints, they often suffer from sim-to-real gaps, lack safety guarantees, and add system complexity.
研究背景: 在機器人學習領域,Compliance control is essential for safe physical interaction, yet its adoption is limited by hardware requirements such as force torque sensors. While recent reinforcement learnin
Technical Approach: We propose Minimalist Compliance Control, which enables compliant behavior using only motor current or voltage signals readily available in modern servos and quasi-direct-drive motors, without force sensors, current control, or learning. Our method is embodiment-agnostic and plug-and-play with diverse high-level planners. We validate our approach on a robot arm, a dexterous hand, and two humanoid robots across multiple contact-rich tasks, using vision-language models, imitation learning, and model-based planning.
技術方法: 本文提出的方法:We propose Minimalist Compliance Control, which enables compliant behavior using only motor current or voltage signals readily available in modern servos and quasi-direct-drive motors, without force s
Key Takeaway: The results demonstrate robust, safe, and compliant interaction across embodiments and planning paradigms.
核心發現: 核心結果:The results demonstrate robust, safe, and compliant interaction across embodiments and planning paradigms.
Generalizing from References using a Multi-Task Reference and Goal-Driven RL Framework
Authors: Jiashun Wang, M. Eva Mungai, He Li et al. | Submitted: 2026-02-23 | arXiv: 2602.20375
Categories: cs.RO
Research Background: Learning agile humanoid behaviors from human motion offers a powerful route to natural, coordinated control, but existing approaches face a persistent trade-off: reference-tracking policies are often brittle outside the demonstration dataset, while purely task-driven Reinforcement Learning (RL) can achieve adaptability at the cost of motion quality. We introduce a unified multi-task RL framework that bridges this gap by treating reference motion as a prior for behavioral shaping rather than a deployment-time constraint.
研究背景: 在機器人學習領域,Learning agile humanoid behaviors from human motion offers a powerful route to natural, coordinated control, but existing approaches face a persistent trade-off: reference-tracking
Technical Approach: We introduce a unified multi-task RL framework that bridges this gap by treating reference motion as a prior for behavioral shaping rather than a deployment-time constraint.
技術方法: 本文提出的方法:We introduce a unified multi-task RL framework that bridges this gap by treating reference motion as a prior for behavioral shaping rather than a deployment-time constraint.
Key Takeaway: Finally, we demonstrate long-horizon behavior generation by composing multiple learned skills, illustrating the flexibility of the learned polices in complex scenarios.
核心發現: 核心結果:Finally, we demonstrate long-horizon behavior generation by composing multiple learned skills, illustrating the flexibility of the learned polices in complex scenarios.
Cross domain Persistent Monitoring for Hybrid Aerial Underwater Vehicles
Authors: Ricardo B. Grando, Victor A. Kich, Alisson H. Kolling et al. | Submitted: 2026-02-23 | arXiv: 2602.21259
Categories: cs.RO
Research Background: Hybrid Unmanned Aerial Underwater Vehicles (HUAUVs) have emerged as platforms capable of operating in both aerial and underwater environments, enabling applications such as inspection, mapping, search, and rescue in challenging scenarios. However, the development of novel methodologies poses significant challenges due to the distinct dynamics and constraints of the air and water domains.
研究背景: 在機器人學習領域,Hybrid Unmanned Aerial Underwater Vehicles (HUAUVs) have emerged as platforms capable of operating in both aerial and underwater environments, enabling applications such as inspect
Technical Approach: In this work, we present persistent monitoring tasks for HUAUVs by combining Deep Reinforcement Learning (DRL) and Transfer Learning to enable cross-domain adaptability. Our approach employs a shared DRL architecture trained on Lidar sensor data (on air) and Sonar data (underwater), demonstrating the feasibility of a unified policy for both environments.
技術方法: 本文提出的方法:In this work, we present persistent monitoring tasks for HUAUVs by combining Deep Reinforcement Learning (DRL) and Transfer Learning to enable cross-domain adaptability. Our approach employs a shared
Key Takeaway: We further show that the methodology presents promising results, taking into account the uncertainty of the environment and the dynamics of multiple mobile targets.
核心發現: 核心結果:We further show that the methodology presents promising results, taking into account the uncertainty of the environment and the dynamics of multiple mobile targets.
Large-scale Photorealistic Outdoor 3D Scene Reconstruction from UAV Imagery Using Gaussian Splatting Techniques
Authors: Christos Maikos, Georgios Angelidis, Georgios Th. Papadopoulos | Submitted: 2026-02-23 | arXiv: 2602.20342
Categories: cs.CV, cs.RO
Research Background: In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency. Unmanned aerial vehicles (UAVs) are extensively used in aerial real-time perception applications.
研究背景: 在機器人學習領域,In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency. Unmanned aerial vehi
Technical Approach: In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency.
技術方法: 本文提出的方法:In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency.
Key Takeaway: Experimental results demonstrate that the proposed method achieves competitive visual fidelity, while delivering significantly higher rendering performance and substantially reduced end-to-end latency, compared to NeRF-based approaches.
核心發現: 核心結果:Experimental results demonstrate that the proposed method achieves competitive visual fidelity, while delivering significantly higher rendering performance and substantially reduced end-to-end latency
MeanFuser: Fast One-Step Multi-Modal Trajectory Generation and Adaptive Reconstruction via MeanFlow for End-to-End Autonomous Driving
Authors: Junli Wang, Yinan Zheng, Xueyi Liu et al. | Submitted: 2026-02-23 | arXiv: 2602.20060
Categories: cs.CV, cs.RO
Research Background: Generative models have shown great potential in trajectory planning. Recent studies demonstrate that anchor-guided generative models are effective in modeling the uncertainty of driving behaviors and improving overall performance.
研究背景: 在機器人學習領域,Generative models have shown great potential in trajectory planning. Recent studies demonstrate that anchor-guided generative models are effective in modeling the uncertainty of dr
Technical Approach: To overcome this limitation, we propose MeanFuser, an end-to-end autonomous driving method that enhances both efficiency and robustness through three key designs. (1) We introduce Gaussian Mixture Noise (GMN) to guide generative sampling, enabling a continuous representation of the trajectory space and eliminating the dependency on discrete anchor vocabularies. (3) We design a lightweight Adaptive Reconstruction Module (ARM) that enables the model to implicitly select from all sampled proposals or reconstruct a new trajectory when none is satisfactory via attention weights.Experiments on the NAVSIM closed-loop benchmark demonstrate that MeanFuser achieves outstanding performance without the supervision of the PDM Score and exceptional inference efficiency, offering a robust and efficient solution for end-to-end autonomous driving.
技術方法: 本文提出的方法:To overcome this limitation, we propose MeanFuser, an end-to-end autonomous driving method that enhances both efficiency and robustness through three key designs. (1) We introduce Gaussian Mixture Noi
Key Takeaway: (3) We design a lightweight Adaptive Reconstruction Module (ARM) that enables the model to implicitly select from all sampled proposals or reconstruct a new trajectory when none is satisfactory via attention weights.Experiments on the NAVSIM closed-loop benchmark demonstrate that MeanFuser achieves outstanding performance without the supervision of the PDM Score and exceptional inference efficiency, offering a robust and efficient solution for end-to-end autonomous driving.
核心發現: 核心結果:(3) We design a lightweight Adaptive Reconstruction Module (ARM) that enables the model to implicitly select from all sampled proposals or reconstruct a new trajectory when none is satisfactory via at
FACTO: Function-space Adaptive Constrained Trajectory Optimization for Robotic Manipulators
Authors: Yichang Feng, Xiao Liang, Minghui Zheng | Submitted: 2026-02-23 | arXiv: 2602.20225
Categories: cs.RO
Research Background: This paper introduces Function-space Adaptive Constrained Trajectory Optimization (FACTO), a new trajectory optimization algorithm for both single- and multi-arm manipulators. Trajectory representations are parameterized as linear combinations of orthogonal basis functions, and optimization is performed directly in the coefficient space.
研究背景: 在機器人學習領域,This paper introduces Function-space Adaptive Constrained Trajectory Optimization (FACTO), a new trajectory optimization algorithm for both single- and multi-arm manipulators. Traj
Technical Approach: This paper introduces Function-space Adaptive Constrained Trajectory Optimization (FACTO), a new trajectory optimization algorithm for both single- and multi-arm manipulators.
技術方法: 本文提出的方法:This paper introduces Function-space Adaptive Constrained Trajectory Optimization (FACTO), a new trajectory optimization algorithm for both single- and multi-arm manipulators.
Key Takeaway: The experimental evaluation of FACTO on Franka robots verifies the feasibility of deployment.
核心發現: 核心結果:The experimental evaluation of FACTO on Franka robots verifies the feasibility of deployment.
Uncertainty-Aware Rank-One MIMO Q Network Framework for Accelerated Offline Reinforcement Learning
Authors: Thanh Nguyen, Tung Luu, Tri Ton et al. | Submitted: 2026-02-23 | arXiv: 2602.19917
Categories: cs.LG, cs.RO
Research Background: Offline reinforcement learning (RL) has garnered significant interest due to its safe and easily scalable paradigm. However, training under this paradigm presents its own challenge: the extrapolation error stemming from out-of-distribution (OOD) data.
研究背景: 在機器人學習領域,Offline reinforcement learning (RL) has garnered significant interest due to its safe and easily scalable paradigm. However, training under this paradigm presents its own challenge
Technical Approach: To address these challenges, this paper introduces an Uncertainty-Aware Rank-One Multi-Input Multi-Output (MIMO) Q Network framework. By incorporating the concept of uncertainty quantification, our framework offers a promising avenue to alleviate extrapolation errors and enhance the efficiency of offline RL.
技術方法: 本文提出的方法:To address these challenges, this paper introduces an Uncertainty-Aware Rank-One Multi-Input Multi-Output (MIMO) Q Network framework. By incorporating the concept of uncertainty quantification, our fr
Key Takeaway: Extensive experimentation on the D4RL benchmark demonstrates that the framework attains state-of-the-art performance while remaining computationally efficient.
核心發現: 核心結果:Extensive experimentation on the D4RL benchmark demonstrates that the framework attains state-of-the-art performance while remaining computationally efficient.
Athena: An Autonomous Open-Hardware Tracked Rescue Robot Platform
Authors: Stefan Fabian, Aljoscha Schmidt, Jonas Süß et al. | Submitted: 2026-02-23 | arXiv: 2602.19898
Categories: cs.RO
Research Background: In disaster response and situation assessment, robots have great potential in reducing the risks to the safety and health of first responders. As the situations encountered and the required capabilities of the robots deployed in such missions differ wildly and are often not known in advance, heterogeneous fleets of robots are needed to cover a wide range of mission requirements.
研究背景: 在機器人學習領域,In disaster response and situation assessment, robots have great potential in reducing the risks to the safety and health of first responders. As the situations encountered and the
Technical Approach: In this paper, we present Athena, an open-hardware rescue ground robot research platform with four individually reconfigurable flippers and a reliable low-cost remote emergency stop (E-Stop) solution.
技術方法: 本文提出的方法:In this paper, we present Athena, an open-hardware rescue ground robot research platform with four individually reconfigurable flippers and a reliable low-cost remote emergency stop (E-Stop) solution.
Key Takeaway: Full CAD & PCB files, as well as all low-level software, are released as open-source contributions.
核心發現: 核心結果:Full CAD & PCB files, as well as all low-level software, are released as open-source contributions.
What Matters for Simulation to Online Reinforcement Learning on Real Robots
Authors: Yarden As, Dhruva Tirumala, René Zurbrügg et al. | Submitted: 2026-02-23 | arXiv: 2602.20220
Categories: cs.RO, cs.AI
Research Background: We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots. Across 100 real-world training runs on three distinct robotic platforms, we systematically ablate algorithmic, systems, and experimental decisions that are typically left implicit in prior work.
研究背景: 在機器人學習領域,We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots. Across 100 real-world training runs on three distinct robotic p
Technical Approach: Across 100 real-world training runs on three distinct robotic platforms, we systematically ablate algorithmic, systems, and experimental decisions that are typically left implicit in prior work. We find that some widely used defaults can be harmful, while a set of robust, readily adopted design choices within standard RL practice yield stable learning across tasks and hardware.
技術方法: 本文提出的方法:Across 100 real-world training runs on three distinct robotic platforms, we systematically ablate algorithmic, systems, and experimental decisions that are typically left implicit in prior work. We fi
Key Takeaway: These results provide the first large-sample empirical study of such design choices, enabling practitioners to deploy online RL with lower engineering effort.
核心發現: 核心結果:These results provide the first large-sample empirical study of such design choices, enabling practitioners to deploy online RL with lower engineering effort.
Denoising Particle Filters: Learning State Estimation with Single-Step Objectives
Authors: Lennart Röstel, Berthold Bäuml | Submitted: 2026-02-23 | arXiv: 2602.19651
Categories: cs.RO, cs.AI, cs.LG
Research Background: Learning-based methods commonly treat state estimation in robotics as a sequence modeling problem. While this paradigm can be effective at maximizing end-to-end performance, models are often difficult to interpret and expensive to train, since training requires unrolling sequences of predictions in time.
研究背景: 在機器人學習領域,Learning-based methods commonly treat state estimation in robotics as a sequence modeling problem. While this paradigm can be effective at maximizing end-to-end performance, models
Technical Approach: As an alternative to end-to-end trained state estimation, we propose a novel particle filtering algorithm in which models are trained from individual state transitions, fully exploiting the Markov property in robotic systems. Importantly, our method offers the desirable composability of classical filtering algorithms, allowing prior information and external sensor models to be incorporated without retraining.
技術方法: 本文提出的方法:As an alternative to end-to-end trained state estimation, we propose a novel particle filtering algorithm in which models are trained from individual state transitions, fully exploiting the Markov pro
Key Takeaway: We evaluate the proposed method on challenging robotic state estimation tasks in simulation, demonstrating competitive performance compared to tuned end-to-end trained baselines.
核心發現: 核心結果:We evaluate the proposed method on challenging robotic state estimation tasks in simulation, demonstrating competitive performance compared to tuned end-to-end trained baselines.
Sample-Efficient Learning with Online Expert Correction for Autonomous Catheter Steering in Endovascular Bifurcation Navigation
Authors: Hao Wang, Tianliang Yao, Bo Lu et al. | Submitted: 2026-02-23 | arXiv: 2602.20216
Categories: cs.RO
Research Background: Robot-assisted endovascular intervention offers a safe and effective solution for remote catheter manipulation, reducing radiation exposure while enabling precise navigation. Reinforcement learning (RL) has recently emerged as a promising approach for autonomous catheter steering; however, conventional methods suffer from sparse reward design and reliance on static vascular models, limiting their sample efficiency and generalization to intraoperative variations.
研究背景: 在機器人學習領域,Robot-assisted endovascular intervention offers a safe and effective solution for remote catheter manipulation, reducing radiation exposure while enabling precise navigation. Reinf
Technical Approach: To overcome these challenges, this paper introduces a sample-efficient RL framework with online expert correction for autonomous catheter steering in endovascular bifurcation navigation.
技術方法: 本文提出的方法:To overcome these challenges, this paper introduces a sample-efficient RL framework with online expert correction for autonomous catheter steering in endovascular bifurcation navigation.
Key Takeaway: These results indicate that combining sample-efficient RL with online expert correction enables reliable and accurate catheter steering, particularly in anatomically challenging bifurcation scenarios critical for endovascular navigation.
核心發現: 核心結果:These results indicate that combining sample-efficient RL with online expert correction enables reliable and accurate catheter steering, particularly in anatomically challenging bifurcation scenarios
Chasing Ghosts: A Simulation-to-Real Olfactory Navigation Stack with Optional Vision Augmentation
Authors: Kordel K. France, Ovidiu Daescu, Latifur Khan et al. | Submitted: 2026-02-23 | arXiv: 2602.19577
Categories: cs.RO
Research Background: Autonomous odor source localization remains a challenging problem for aerial robots due to turbulent airflow, sparse and delayed sensory signals, and strict payload and compute constraints. While prior unmanned aerial vehicle (UAV)-based olfaction systems have demonstrated gas distribution mapping or reactive plume tracing, they rely on predefined coverage patterns, external infrastructure, or extensive sensing and coordination.
研究背景: 在機器人學習領域,Autonomous odor source localization remains a challenging problem for aerial robots due to turbulent airflow, sparse and delayed sensory signals, and strict payload and compute con
Technical Approach: In this work, we present a complete, open-source UAV system for online odor source localization using a minimal sensor suite.
技術方法: 本文提出的方法:In this work, we present a complete, open-source UAV system for online odor source localization using a minimal sensor suite.
Key Takeaway: We validate the proposed system through real-world flight experiments in a large indoor environment using an ethanol source, demonstrating consistent source-finding behavior under realistic airflow conditions.
核心發現: 核心結果:We validate the proposed system through real-world flight experiments in a large indoor environment using an ethanol source, demonstrating consistent source-finding behavior under realistic airflow co
Vision-Based Reasoning with Topology-Encoded Graphs for Anatomical Path Disambiguation in Robot-Assisted Endovascular Navigation
Authors: Jiyuan Zhao, Zhengyu Shi, Wentong Tian et al. | Submitted: 2026-02-23 | arXiv: 2602.20215
Categories: cs.RO
Research Background: Robotic-assisted percutaneous coronary intervention (PCI) is constrained by the inherent limitations of 2D Digital Subtraction Angiography (DSA). Unlike physicians, who can directly manipulate guidewires and integrate tactile feedback with their prior anatomical knowledge, teleoperated robotic systems must rely solely on 2D projections.
研究背景: 在機器人學習領域,Robotic-assisted percutaneous coronary intervention (PCI) is constrained by the inherent limitations of 2D Digital Subtraction Angiography (DSA). Unlike physicians, who can directl
Technical Approach: To address this challenge, we propose a two-stage framework (SCAR-UNet-GAT) for real-time robotic path planning.
技術方法: 本文提出的方法:To address this challenge, we propose a two-stage framework (SCAR-UNet-GAT) for real-time robotic path planning.
Key Takeaway: For path disambiguation, the proposed GAT-based method attained a success rate of 95.0% and a target-arrival success rate of 90.0%, substantially outperforming conventional shortest-path planning (60.0% and 55.0%) and heuristic-based planning (75.0% and 70.0%).
核心發現: 核心結果:For path disambiguation, the proposed GAT-based method attained a success rate of 95.0% and a target-arrival success rate of 90.0%, substantially outperforming conventional shortest-path planning (60.
Cost-Aware Diffusion Active Search
Authors: Arundhati Banerjee, Jeff Schneider | Submitted: 2026-02-23 | arXiv: 2602.19538
Categories: cs.RO, cs.AI, cs.LG
Research Background: Active search for recovering objects of interest through online, adaptive decision making with autonomous agents requires trading off exploration of unknown environments with exploitation of prior observations in the search space. Prior work has proposed information gain and Thompson sampling based myopic, greedy approaches for agents to actively decide query or search locations when the number of targets is unknown.
研究背景: 在機器人學習領域,Active search for recovering objects of interest through online, adaptive decision making with autonomous agents requires trading off exploration of unknown environments with explo
Technical Approach: Instead, in this work, we leverage the sequence modeling abilities of diffusion models to sample lookahead action sequences that balance the exploration-exploitation trade-off for active search without building an exhaustive search tree.
技術方法: 本文提出的方法:Instead, in this work, we leverage the sequence modeling abilities of diffusion models to sample lookahead action sequences that balance the exploration-exploitation trade-off for active search withou
Key Takeaway: Our proposed algorithm outperforms standard baselines in offline reinforcement learning in terms of full recovery rate and is computationally more efficient than tree search in cost-aware active decision making.
核心發現: 核心結果:Our proposed algorithm outperforms standard baselines in offline reinforcement learning in terms of full recovery rate and is computationally more efficient than tree search in cost-aware active decis
Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorial
Authors: Yousef Emami, Hao Zhou, Radha Reddy et al. | Submitted: 2026-02-23 | arXiv: 2602.19534
Categories: cs.RO, cs.AI
Research Background: Uncrewed Aerial Vehicles (UAVs) are widely deployed across diverse applications due to their mobility and agility. Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond conventional optimization-based and learning-based approaches.
研究背景: 在機器人學習領域,Uncrewed Aerial Vehicles (UAVs) are widely deployed across diverse applications due to their mobility and agility. Recent advances in Large Language Models (LLMs) offer a transform
Technical Approach: Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond conventional optimization-based and learning-based approaches. By integrating LLMs into UAV systems, advanced environmental understanding, swarm coordination, mobility optimization, and high-level task reasoning can be achieved, thereby allowing more adaptive and context-aware aerial operations. This survey systematically explores the intersection of LLMs and UAV technologies and proposes a unified framework that consolidates existing architectures, methodologies, and applications for UAVs.
技術方法: 本文提出的方法:Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond conventional optimization-based and learning-based approaches. By integrating LLMs
Key Takeaway: By integrating LLMs into UAV systems, advanced environmental understanding, swarm coordination, mobility optimization, and high-level task reasoning can be achieved, thereby allowing more adaptive and context-aware aerial operations.
核心發現: 核心結果:By integrating LLMs into UAV systems, advanced environmental understanding, swarm coordination, mobility optimization, and high-level task reasoning can be achieved, thereby allowing more adaptive and
Bellman Value Decomposition for Task Logic in Safe Optimal Control
Authors: William Sharpless, Oswin So, Dylan Hirsch et al. | Submitted: 2026-02-23 | arXiv: 2602.19532
Categories: cs.RO, eess.SY
Research Background: Real-world tasks involve nuanced combinations of goal and safety specifications. In high dimensions, the challenge is exacerbated: formal automata become cumbersome, and the combination of sparse rewards tends to require laborious tuning.
研究背景: 在機器人學習領域,Real-world tasks involve nuanced combinations of goal and safety specifications. In high dimensions, the challenge is exacerbated: formal automata become cumbersome, and the combin
Technical Approach: To solve the Value and optimal policy, we propose VDPPO, which embeds the decomposed Value graph into a two-layer neural net, bootstrapping the implicit dependencies. We conduct a variety of simulated and hardware experiments to test our method on complex, high-dimensional tasks involving heterogeneous teams and nonlinear dynamics.
技術方法: 本文提出的方法:To solve the Value and optimal policy, we propose VDPPO, which embeds the decomposed Value graph into a two-layer neural net, bootstrapping the implicit dependencies. We conduct a variety of simulated
Key Takeaway: Ultimately, we find this approach greatly improves performance over existing baselines, balancing safety and liveness automatically.
核心發現: 核心結果:Ultimately, we find this approach greatly improves performance over existing baselines, balancing safety and liveness automatically.
Training Deep Stereo Matching Networks on Tree Branch Imagery: A Benchmark Study for Real-Time UAV Forestry Applications
Authors: Yida Lin, Bing Xue, Mengjie Zhang et al. | Submitted: 2026-02-23 | arXiv: 2602.19763
Categories: cs.CV, eess.IV
Research Background: Autonomous drone-based tree pruning needs accurate, real-time depth estimation from stereo cameras. Depth is computed from disparity maps using , so even small disparity errors cause noticeable depth mistakes at working distances.
研究背景: 在機器人學習領域,Autonomous drone-based tree pruning needs accurate, real-time depth estimation from stereo cameras. Depth is computed from disparity maps using , so even small disparity
Technical Approach: Building on our earlier work that identified DEFOM-Stereo as the best reference disparity generator for vegetation scenes, we present the first study to train and test ten deep stereo matching networks on real tree branch images.
技術方法: 本文提出的方法:Building on our earlier work that identified DEFOM-Stereo as the best reference disparity generator for vegetation scenes, we present the first study to train and test ten deep stereo matching network
Key Takeaway: Using perceptual metrics (SSIM, LPIPS, ViTScore) and structural metrics (SIFT/ORB feature matching), we find that BANet-3D produces the best overall quality (SSIM = 0.883, LPIPS = 0.157), while RAFT-Stereo scores highest on scene-level understanding (ViTScore = 0.799).
核心發現: 核心結果:Using perceptual metrics (SSIM, LPIPS, ViTScore) and structural metrics (SIFT/ORB feature matching), we find that BANet-3D produces the best overall quality (SSIM = 0.883, LPIPS = 0.157), while RAFT-S
Environment-Aware Learning of Smooth GNSS Covariance Dynamics for Autonomous Racing
Authors: Y. Deemo Chen, Arion Zimmermann, Thomas A. Berrueta et al. | Submitted: 2026-02-24 | arXiv: 2602.21366
Categories: cs.RO
Research Background: Ensuring accurate and stable state estimation is a challenging task crucial to safety-critical domains such as high-speed autonomous racing, where measurement uncertainty must be both adaptive to the environment and temporally smooth for control. In this work, we develop a learning-based framework, LACE, capable of directly modeling the temporal dynamics of GNSS measurement covariance.
研究背景: 在機器人學習領域,Ensuring accurate and stable state estimation is a challenging task crucial to safety-critical domains such as high-speed autonomous racing, where measurement uncertainty must be b
Technical Approach: In this work, we develop a learning-based framework, LACE, capable of directly modeling the temporal dynamics of GNSS measurement covariance. We validate our approach on an AV-24 autonomous racecar, demonstrating improved localization performance and smoother covariance estimates in challenging, GNSS-degraded environments.
技術方法: 本文提出的方法:In this work, we develop a learning-based framework, LACE, capable of directly modeling the temporal dynamics of GNSS measurement covariance. We validate our approach on an AV-24 autonomous racecar, d
Key Takeaway: Our results highlight the promise of dynamically modeling the perceived uncertainty in state estimation problems that are tightly coupled with control sensitivity.
核心發現: 核心結果:Our results highlight the promise of dynamically modeling the perceived uncertainty in state estimation problems that are tightly coupled with control sensitivity.
Uncertainty-Aware Diffusion Model for Multimodal Highway Trajectory Prediction via DDIM Sampling
Authors: Marion Neumeier, Niklas Roßberg, Michael Botsch et al. | Submitted: 2026-02-24 | arXiv: 2602.21319
Categories: cs.LG, cs.CV, cs.RO
Research Background: Accurate and uncertainty-aware trajectory prediction remains a core challenge for autonomous driving, driven by complex multi-agent interactions, diverse scene contexts and the inherently stochastic nature of future motion. Diffusion-based generative models have recently shown strong potential for capturing multimodal futures, yet existing approaches such as cVMD suffer from slow sampling, limited exploitation of generative diversity and brittle scenario encodings.
研究背景: 在機器人學習領域,Accurate and uncertainty-aware trajectory prediction remains a core challenge for autonomous driving, driven by complex multi-agent interactions, diverse scene contexts and the inh
Technical Approach: Diffusion-based generative models have recently shown strong potential for capturing multimodal futures, yet existing approaches such as cVMD suffer from slow sampling, limited exploitation of generative diversity and brittle scenario encodings. This work introduces cVMDx, an enhanced diffusion-based trajectory prediction framework that improves efficiency, robustness and multimodal predictive capability. Through DDIM sampling, cVMDx achieves up to a 100x reduction in inference time, enabling practical multi-sample generation for uncertainty estimation.
技術方法: 本文提出的方法:Diffusion-based generative models have recently shown strong potential for capturing multimodal futures, yet existing approaches such as cVMD suffer from slow sampling, limited exploitation of generat
Key Takeaway: Experiments on the publicly available highD dataset show that cVMDx achieves higher accuracy and significantly improved efficiency over cVMD, enabling fully stochastic, multimodal trajectory prediction.
核心發現: 核心結果:Experiments on the publicly available highD dataset show that cVMDx achieves higher accuracy and significantly improved efficiency over cVMD, enabling fully stochastic, multimodal trajectory predictio
Unified Complementarity-Based Contact Modeling and Planning for Soft Robots
Authors: Milad Azizkhani, Yue Chen | Submitted: 2026-02-24 | arXiv: 2602.21316
Categories: cs.RO
Research Background: Soft robots were introduced in large part to enable safe, adaptive interaction with the environment, and this interaction relies fundamentally on contact. However, modeling and planning contact-rich interactions for soft robots remain challenging: dense contact candidates along the body create redundant constraints and rank-deficient LCPs, while the disparity between high stiffness and low friction introduces severe ill-conditioning.
研究背景: 在機器人學習領域,Soft robots were introduced in large part to enable safe, adaptive interaction with the environment, and this interaction relies fundamentally on contact. However, modeling and pla
Technical Approach: We develop a robust Linear Complementarity Problem (LCP) model tailored to discretized soft robots and address these challenges with a three-stage conditioning pipeline: inertial rank selection to remove redundant contacts, Ruiz equilibration to correct scale disparity and ill-conditioning, and lightweight Tikhonov regularization on normal blocks. Building on the same formulation, we introduce a kinematically guided warm-start strategy that enables dynamic trajectory optimization through contact using Mathematical Programs with Complementarity Constraints (MPCC) and demonstrate its effectiveness on contact-rich ball manipulation tasks.
技術方法: 本文提出的方法:We develop a robust Linear Complementarity Problem (LCP) model tailored to discretized soft robots and address these challenges with a three-stage conditioning pipeline: inertial rank selection to rem
Key Takeaway: Building on the same formulation, we introduce a kinematically guided warm-start strategy that enables dynamic trajectory optimization through contact using Mathematical Programs with Complementarity Constraints (MPCC) and demonstrate its effectiveness on contact-rich ball manipulation tasks.
核心發現: 核心結果:Building on the same formulation, we introduce a kinematically guided warm-start strategy that enables dynamic trajectory optimization through contact using Mathematical Programs with Complementarity
Squint: Fast Visual Reinforcement Learning for Sim-to-Real Robotics
Authors: Abdulaziz Almuzairee, Henrik I. Christensen | Submitted: 2026-02-24 | arXiv: 2602.21203
Categories: cs.RO, cs.CV, cs.LG
Research Background: Visual reinforcement learning is appealing for robotics but expensive — off-policy methods are sample-efficient yet slow; on-policy methods parallelize well but waste samples. Recent work has shown that off-policy methods can train faster than on-policy methods in wall-clock time for state-based control.
研究背景: 在機器人學習領域,Visual reinforcement learning is appealing for robotics but expensive — off-policy methods are sample-efficient yet slow; on-policy methods parallelize well but waste samples. Rec
Technical Approach: To address these challenges, we introduce Squint, a visual Soft Actor Critic method that achieves faster wall-clock training than prior visual off-policy and on-policy methods.
技術方法: 本文提出的方法:To address these challenges, we introduce Squint, a visual Soft Actor Critic method that achieves faster wall-clock training than prior visual off-policy and on-policy methods.
Key Takeaway: We evaluate on the SO-101 Task Set, a new suite of eight manipulation tasks in ManiSkill3 with heavy domain randomization, and demonstrate sim-to-real transfer to a real SO-101 robot.
核心發現: 核心結果:We evaluate on the SO-101 Task Set, a new suite of eight manipulation tasks in ManiSkill3 with heavy domain randomization, and demonstrate sim-to-real transfer to a real SO-101 robot.
Efficient Hierarchical Any-Angle Path Planning on Multi-Resolution 3D Grids
Authors: Victor Reijgwart, Cesar Cadena, Roland Siegwart et al. | Submitted: 2026-02-24 | arXiv: 2602.21174
Categories: cs.RO, cs.AI
Research Background: Hierarchical, multi-resolution volumetric mapping approaches are widely used to represent large and complex environments as they can efficiently capture their occupancy and connectivity information. Yet widely used path planning methods such as sampling and trajectory optimization do not exploit this explicit connectivity information, and search-based methods such as A* suffer from scalability issues in large-scale high-resolution maps.
研究背景: 在機器人學習領域,Hierarchical, multi-resolution volumetric mapping approaches are widely used to represent large and complex environments as they can efficiently capture their occupancy and connect
Technical Approach: In this paper, we present a method that has the optimality and completeness properties of any-angle planners while overcoming computational tractability issues common to search-based methods by exploiting multi-resolution representations.
技術方法: 本文提出的方法:In this paper, we present a method that has the optimality and completeness properties of any-angle planners while overcoming computational tractability issues common to search-based methods by exploi
Key Takeaway: Extensive experiments on real and synthetic environments demonstrate the proposed approach’s solution quality and speed, outperforming even sampling-based methods.
核心發現: 核心結果:Extensive experiments on real and synthetic environments demonstrate the proposed approach’s solution quality and speed, outperforming even sampling-based methods.
A Micro-Macro Model of Encounter-Driven Information Diffusion in Robot Swarms
Authors: Davis S. Catherman, Carlo Pinciroli | Submitted: 2026-02-24 | arXiv: 2602.21148
Categories: cs.RO, cs.MA
Research Background: In this paper, we propose the problem of Encounter-Driven Information Diffusion (EDID). In EDID, robots are allowed to exchange information only upon meeting.
研究背景: 在機器人學習領域,In this paper, we propose the problem of Encounter-Driven Information Diffusion (EDID). In EDID, robots are allowed to exchange information only upon meeting.
Technical Approach: In this paper, we propose the problem of Encounter-Driven Information Diffusion (EDID). As a step towards the design of storage and routing algorithms for EDID, in this paper we propose a model of information diffusion that captures the essential dynamics of EDID.
技術方法: 本文提出的方法:In this paper, we propose the problem of Encounter-Driven Information Diffusion (EDID). As a step towards the design of storage and routing algorithms for EDID, in this paper we propose a model of inf
Key Takeaway: We validate the model through extensive robot simulations, in which we consider swarm size, communication range, environment size, and different random motion regimes.
核心發現: 核心結果:We validate the model through extensive robot simulations, in which we consider swarm size, communication range, environment size, and different random motion regimes.
Cooperative-Competitive Team Play of Real-World Craft Robots
Authors: Rui Zhao, Xihui Li, Yizheng Zhang et al. | Submitted: 2026-02-24 | arXiv: 2602.21119
Categories: cs.RO, cs.AI
Research Background: Multi-agent deep Reinforcement Learning (RL) has made significant progress in developing intelligent game-playing agents in recent years. However, the efficient training of collective robots using multi-agent RL and the transfer of learned policies to real-world applications remain open research questions.
研究背景: 在機器人學習領域,Multi-agent deep Reinforcement Learning (RL) has made significant progress in developing intelligent game-playing agents in recent years. However, the efficient training of collect
Technical Approach: To address the challenges of multi-agent sim-to-real transfer, we introduce Out of Distribution State Initialization (OODSI) to mitigate the impact of the sim-to-real gap. We demonstrate the effectiveness of our approach through experiments with a multi-robot car competitive game and a cooperative task in real-world settings.
技術方法: 本文提出的方法:To address the challenges of multi-agent sim-to-real transfer, we introduce Out of Distribution State Initialization (OODSI) to mitigate the impact of the sim-to-real gap. We demonstrate the effective
Key Takeaway: We demonstrate the effectiveness of our approach through experiments with a multi-robot car competitive game and a cooperative task in real-world settings.
核心發現: 核心結果:We demonstrate the effectiveness of our approach through experiments with a multi-robot car competitive game and a cooperative task in real-world settings.
Event-Aided Sharp Radiance Field Reconstruction for Fast-Flying Drones
Authors: Rong Zou, Marco Cannici, Davide Scaramuzza | Submitted: 2026-02-24 | arXiv: 2602.21101
Categories: cs.CV, cs.RO
Research Background: Fast-flying aerial robots promise rapid inspection under limited battery constraints, with direct applications in infrastructure inspection, terrain exploration, and search and rescue. However, high speeds lead to severe motion blur in images and induce significant drift and noise in pose estimates, making dense 3D reconstruction with Neural Radiance Fields (NeRFs) particularly challenging due to their high sensitivity to such degradations.
研究背景: 在機器人學習領域,Fast-flying aerial robots promise rapid inspection under limited battery constraints, with direct applications in infrastructure inspection, terrain exploration, and search and res
Technical Approach: In this work, we present a unified framework that leverages asynchronous event streams alongside motion-blurred frames to reconstruct high-fidelity radiance fields from agile drone flights. By embedding event-image fusion into NeRF optimization and jointly refining event-based visual-inertial odometry priors using both event and frame modalities, our method recovers sharp radiance fields and accurate camera trajectories without ground-truth supervision. We validate our approach on both synthetic data and real-world sequences captured by a fast-flying drone.
技術方法: 本文提出的方法:In this work, we present a unified framework that leverages asynchronous event streams alongside motion-blurred frames to reconstruct high-fidelity radiance fields from agile drone flights. By embeddi
Key Takeaway: Despite highly dynamic drone flights, where RGB frames are severely degraded by motion blur and pose priors become unreliable, our method reconstructs high-fidelity radiance fields and preserves fine scene details, delivering a performance gain of over 50% on real-world data compared to state-of-the-art methods.
核心發現: 核心結果:Despite highly dynamic drone flights, where RGB frames are severely degraded by motion blur and pose priors become unreliable, our method reconstructs high-fidelity radiance fields and preserves fine
Localized Dynamics-Aware Domain Adaption for Off-Dynamics Offline Reinforcement Learning
Authors: Zhangjie Xia, Yu Yang, Pan Xu | Submitted: 2026-02-24 | arXiv: 2602.21072
Categories: cs.LG, cs.AI, cs.RO
Research Background: Off-dynamics offline reinforcement learning (RL) aims to learn a policy for a target domain using limited target data and abundant source data collected under different transition dynamics. Existing methods typically address dynamics mismatch either globally over the state space or via pointwise data filtering; these approaches can miss localized cross-domain similarities or incur high computational cost.
研究背景: 在機器人學習領域,Off-dynamics offline reinforcement learning (RL) aims to learn a policy for a target domain using limited target data and abundant source data collected under different transition
Technical Approach: We propose Localized Dynamics-Aware Domain Adaptation (LoDADA), which exploits localized dynamics mismatch to better reuse source data.
技術方法: 本文提出的方法:We propose Localized Dynamics-Aware Domain Adaptation (LoDADA), which exploits localized dynamics mismatch to better reuse source data.
Key Takeaway: Results show that LoDADA consistently outperforms state-of-the-art off-dynamics offline RL methods by better leveraging localized distribution mismatch.
核心發現: 核心結果:Results show that LoDADA consistently outperforms state-of-the-art off-dynamics offline RL methods by better leveraging localized distribution mismatch.
EKF-Based Depth Camera and Deep Learning Fusion for UAV-Person Distance Estimation and Following in SAR Operations
Authors: Luka Šiktar, Branimir Ćaran, Bojan Šekoranja et al. | Submitted: 2026-02-24 | arXiv: 2602.20958
Categories: cs.RO, cs.AI
Research Background: Search and rescue (SAR) operations require rapid responses to save lives or property. Unmanned Aerial Vehicles (UAVs) equipped with vision-based systems support these missions through prior terrain investigation or real-time assistance during the mission itself.
研究背景: 在機器人學習領域,Search and rescue (SAR) operations require rapid responses to save lives or property. Unmanned Aerial Vehicles (UAVs) equipped with vision-based systems support these missions thro
Technical Approach: As part of the system for automatic people detection and face recognition using deep learning, in this paper we present the fusion of depth camera measurements and monocular camera-to-body distance estimation for robust tracking and following. Our system provides an accurate estimated distance, which has been validated against motion capture ground truth data.
技術方法: 本文提出的方法:As part of the system for automatic people detection and face recognition using deep learning, in this paper we present the fusion of depth camera measurements and monocular camera-to-body distance es
Key Takeaway: Deep learning-based filtering of depth camera data and estimation of camera-to-body distance from a monocular camera are achieved with YOLO-pose, enabling real-time fusion of depth information using the Extended Kalman Filter (EKF) algorithm.
核心發現: 核心結果:Deep learning-based filtering of depth camera data and estimation of camera-to-body distance from a monocular camera are achieved with YOLO-pose, enabling real-time fusion of depth information using t
LST-SLAM: A Stereo Thermal SLAM System for Kilometer-Scale Dynamic Environments
Authors: Zeyu Jiang, Kuan Xu, Changhao Chen | Submitted: 2026-02-24 | arXiv: 2602.20925
Categories: cs.RO, cs.CV
Research Background: Thermal cameras offer strong potential for robot perception under challenging illumination and weather conditions. However, thermal Simultaneous Localization and Mapping (SLAM) remains difficult due to unreliable feature extraction, unstable motion tracking, and inconsistent global pose and map construction, particularly in dynamic large-scale outdoor environments.
研究背景: 在機器人學習領域,Thermal cameras offer strong potential for robot perception under challenging illumination and weather conditions. However, thermal Simultaneous Localization and Mapping (SLAM) rem
Technical Approach: To address these challenges, we propose LST-SLAM, a novel large-scale stereo thermal SLAM system that achieves robust performance in complex, dynamic scenes. Our approach combines self-supervised thermal feature learning, stereo dual-level motion tracking, and geometric pose optimization. Furthermore, we develop an online incremental bag-of-words model for loop closure detection, coupled with global pose optimization to mitigate accumulated drift.
技術方法: 本文提出的方法:To address these challenges, we propose LST-SLAM, a novel large-scale stereo thermal SLAM system that achieves robust performance in complex, dynamic scenes. Our approach combines self-supervised ther
Key Takeaway: Extensive experiments on kilometer-scale dynamic thermal datasets show that LST-SLAM significantly outperforms recent representative SLAM systems, including AirSLAM and DROID-SLAM, in both robustness and accuracy.
核心發現: 核心結果:Extensive experiments on kilometer-scale dynamic thermal datasets show that LST-SLAM significantly outperforms recent representative SLAM systems, including AirSLAM and DROID-SLAM, in both robustness
ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Models
Authors: Jiarong Wei, Anna Rehr, Christian Feist et al. | Submitted: 2026-02-24 | arXiv: 2602.20923
Categories: cs.RO
Research Background: Automated parking is a challenging operational domain for advanced driver assistance systems, requiring robust scene understanding and interaction reasoning. The key challenge is twofold: (i) predict multiple plausible ego intentions according to context and (ii) for each intention, predict the joint responses of surrounding agents, enabling effective what-if decision-making.
研究背景: 在機器人學習領域,Automated parking is a challenging operational domain for advanced driver assistance systems, requiring robust scene understanding and interaction reasoning. The key challenge is t
Technical Approach: We propose ParkDiffusion++, which jointly learns a multi-modal ego intention predictor and an ego-conditioned multi-agent joint trajectory predictor for automated parking. Our approach makes several key contributions. First, we introduce an ego intention tokenizer that predicts a small set of discrete endpoint intentions from agent histories and vectorized map polylines.
技術方法: 本文提出的方法:We propose ParkDiffusion++, which jointly learns a multi-modal ego intention predictor and an ego-conditioned multi-agent joint trajectory predictor for automated parking. Our approach makes several k
Key Takeaway: Extensive evaluations demonstrate that ParkDiffusion++ achieves state-of-the-art performance on the Dragon Lake Parking (DLP) dataset and the Intersections Drone (inD) dataset.
核心發現: 核心結果:Extensive evaluations demonstrate that ParkDiffusion++ achieves state-of-the-art performance on the Dragon Lake Parking (DLP) dataset and the Intersections Drone (inD) dataset.
GeCo-SRT: Geometry-aware Continual Adaptation for Robotic Cross-Task Sim-to-Real Transfer
Authors: Wenbo Yu, Wenke Xia, Weitao Zhang et al. | Submitted: 2026-02-24 | arXiv: 2602.20871
Categories: cs.RO
Research Background: Bridging the sim-to-real gap is important for applying low-cost simulation data to real-world robotic systems. However, previous methods are severely limited by treating each transfer as an isolated endeavor, demanding repeated, costly tuning and wasting prior transfer experience.
研究背景: 在機器人學習領域,Bridging the sim-to-real gap is important for applying low-cost simulation data to real-world robotic systems. However, previous methods are severely limited by treating each trans
Technical Approach: To move beyond isolated sim-to-real, we build a continual cross-task sim-to-real transfer paradigm centered on knowledge accumulation across iterative transfers, thereby enabling effective and efficient adaptation to novel tasks. Thus, we propose GeCo-SRT, a geometry-aware continual adaptation method.
技術方法: 本文提出的方法:To move beyond isolated sim-to-real, we build a continual cross-task sim-to-real transfer paradigm centered on knowledge accumulation across iterative transfers, thereby enabling effective and efficie
Key Takeaway: Leveraging knowledge accumulated during iterative transfer, GeCo-SRT method not only achieves 52% average performance improvement over the baseline, but also demonstrates significant data efficiency for new task adaptation with only 1/6 data.
核心發現: 核心結果:Leveraging knowledge accumulated during iterative transfer, GeCo-SRT method not only achieves 52% average performance improvement over the baseline, but also demonstrates significant data efficiency f
RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction
Authors: Yangfan Zhao, Hanwei Zhang, Ke Huang et al. | Submitted: 2026-02-24 | arXiv: 2602.20807
Categories: cs.CV, cs.RO
Research Background: Combining 3D Gaussian splatting with Simultaneous Localization and Mapping (SLAM) has gained popularity as it enables continuous 3D environment reconstruction during motion. However, existing methods struggle in dynamic environments, particularly moving objects complicate 3D reconstruction and, in turn, hinder reliable tracking.
研究背景: 在機器人學習領域,Combining 3D Gaussian splatting with Simultaneous Localization and Mapping (SLAM) has gained popularity as it enables continuous 3D environment reconstruction during motion. Howeve
Technical Approach: Along this direction, we propose a robust and efficient framework, namely Reweighting Uncertainty in Gaussian Splatting SLAM (RU4D-SLAM) for 4D scene reconstruction, that introduces temporal factors into spatial 3D representation while incorporating uncertainty-aware perception of scene changes, blurred image synthesis, and dynamic scene reconstruction. Furthermore, we propose a semantic-guided reweighting mechanism for per-pixel uncertainty estimation in dynamic scenes, and introduce a learnable opacity weight to support adaptive 4D mapping. Extensive experiments on standard benchmarks demonstrate that our method substantially outperforms state-of-the-art approaches in both trajectory accuracy and 4D scene reconstruction, particularly in dynamic environments with moving objects and low-quality inputs.
技術方法: 本文提出的方法:Along this direction, we propose a robust and efficient framework, namely Reweighting Uncertainty in Gaussian Splatting SLAM (RU4D-SLAM) for 4D scene reconstruction, that introduces temporal factors i
Key Takeaway: Extensive experiments on standard benchmarks demonstrate that our method substantially outperforms state-of-the-art approaches in both trajectory accuracy and 4D scene reconstruction, particularly in dynamic environments with moving objects and low-quality inputs.
核心發現: 核心結果:Extensive experiments on standard benchmarks demonstrate that our method substantially outperforms state-of-the-art approaches in both trajectory accuracy and 4D scene reconstruction, particularly in
Visual Cooperative Drone Tracking for Open-Path Gas Measurements
Authors: Marius Schaab, Alisha Kiefer, Thomas Wiedemann et al. | Submitted: 2026-02-24 | arXiv: 2602.20768
Categories: cs.RO
Research Background: Open-path Tunable Diode Laser Absorption Spectroscopy offers an effective method for measuring, mapping, and monitoring gas concentrations, such as leaking CO2 or methane. Compared to spatial sampling of gas distributions using in-situ sensors, open-path sensors in combination with gas tomography algorithms can cover large outdoor environments faster in a non-invasive way.
研究背景: 在機器人學習領域,Open-path Tunable Diode Laser Absorption Spectroscopy offers an effective method for measuring, mapping, and monitoring gas concentrations, such as leaking CO2 or methane. Compared
Technical Approach: Compared to spatial sampling of gas distributions using in-situ sensors, open-path sensors in combination with gas tomography algorithms can cover large outdoor environments faster in a non-invasive way. However, the requirement of a dedicated reflection surface for the open-path laser makes automating the spatial sampling process challenging. This publication presents a robotic system for collecting open-path measurements, making use of a sensor mounted on a ground-based pan-tilt unit and a small drone carrying a reflector.
技術方法: 本文提出的方法:Compared to spatial sampling of gas distributions using in-situ sensors, open-path sensors in combination with gas tomography algorithms can cover large outdoor environments faster in a non-invasive w
Key Takeaway: Outdoor experiments validated the system’s performance, demonstrating successful autonomous tracking and valid CO2 measurements at distances up to 60 meters.
核心發現: 核心結果:Outdoor experiments validated the system’s performance, demonstrating successful autonomous tracking and valid CO2 measurements at distances up to 60 meters.
Robot Local Planner: A Periodic Sampling-Based Motion Planner with Minimal Waypoints for Home Environments
Authors: Keisuke Takeshita, Takahiro Yamazaki, Tomohiro Ono et al. | Submitted: 2026-02-24 | arXiv: 2602.20645
Categories: cs.RO
Research Background: The objective of this study is to enable fast and safe manipulation tasks in home environments. Specifically, we aim to develop a system that can recognize its surroundings and identify target objects while in motion, enabling it to plan and execute actions accordingly.
研究背景: 在機器人學習領域,The objective of this study is to enable fast and safe manipulation tasks in home environments. Specifically, we aim to develop a system that can recognize its surroundings and ide
Technical Approach: We propose a periodic sampling-based whole-body trajectory planning method, called the “Robot Local Planner (RLP).” This method leverages unique features of home environments to enhance computational efficiency, motion optimality, and robustness against recognition and control errors, all while ensuring safety.
技術方法: 本文提出的方法:We propose a periodic sampling-based whole-body trajectory planning method, called the “Robot Local Planner (RLP).” This method leverages unique features of home environments to enhance computational
Key Takeaway: Moreover, application experiments using a tidy-up task achieved high success rates and short operation times, thereby underscoring its practical feasibility.
核心發現: 核心結果:Moreover, application experiments using a tidy-up task achieved high success rates and short operation times, thereby underscoring its practical feasibility.
HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles
Authors: Yifan Wang, Francesco Pittaluga, Zaid Tasneem et al. | Submitted: 2026-02-24 | arXiv: 2602.21333
Categories: cs.CV
Research Background: Controllable driving scene generation is critical for realistic and scalable autonomous driving simulation, yet existing approaches struggle to jointly achieve photorealism and precise control. We introduce HorizonForge, a unified framework that reconstructs scenes as editable Gaussian Splats and Meshes, enabling fine-grained 3D manipulation and language-driven vehicle insertion.
研究背景: 在機器人學習領域,Controllable driving scene generation is critical for realistic and scalable autonomous driving simulation, yet existing approaches struggle to jointly achieve photorealism and pre
Technical Approach: We introduce HorizonForge, a unified framework that reconstructs scenes as editable Gaussian Splats and Meshes, enabling fine-grained 3D manipulation and language-driven vehicle insertion.
技術方法: 本文提出的方法:We introduce HorizonForge, a unified framework that reconstructs scenes as editable Gaussian Splats and Meshes, enabling fine-grained 3D manipulation and language-driven vehicle insertion.
Key Takeaway: Combining these findings, HorizonForge establishes a simple yet powerful paradigm for photorealistic, controllable driving simulation, achieving an 83.4% user-preference gain and a 25.19% FID improvement over the second best state-of-the-art method.
核心發現: 核心結果:Combining these findings, HorizonForge establishes a simple yet powerful paradigm for photorealistic, controllable driving simulation, achieving an 83.4% user-preference gain and a 25.19% FID improvem
SynthRender and IRIS: Open-Source Framework and Dataset for Bidirectional Sim-Real Transfer in Industrial Object Perception
Authors: Jose Moises Araya-Martinez, Thushar Tom, Adrián Sanchis Reig et al. | Submitted: 2026-02-24 | arXiv: 2602.21141
Categories: cs.CV
Research Background: Object perception is fundamental for tasks such as robotic material handling and quality inspection. However, modern supervised deep-learning models require large annotated datasets for robust automation under semi-uncontrolled conditions; a major barrier for widespread deployment with proprietary industrial parts.
研究背景: 在機器人學習領域,Object perception is fundamental for tasks such as robotic material handling and quality inspection. However, modern supervised deep-learning models require large annotated dataset
Technical Approach: Our method integrates 2D-to-3D Reality-to-Simulation techniques for 3D asset creation from physical parts with programmatic Guided Domain Randomization (GDR) via SynthRender, an open-source synthetic image generation framework. To support evaluation under realistic industrial conditions, we introduce Industrial Real-Sim Imagery Set (IRIS), a 32-class dataset with diverse textures, intra-class variation, strong inter-class similarities, and 19,672 annotations, providing both CAD models and reconstructed meshes for bidirectional sim-to-real benchmarking.
技術方法: 本文提出的方法:Our method integrates 2D-to-3D Reality-to-Simulation techniques for 3D asset creation from physical parts with programmatic Guided Domain Randomization (GDR) via SynthRender, an open-source synthetic
Key Takeaway: Across three industrial benchmarks, the proposed framework achieves highly competitive performance, reaching 99.1% mAP@50 on a public robotics dataset, 98.3% mAP@50 on an automotive benchmark, and 95.3% mAP@50 on IRIS.
核心發現: 核心結果:Across three industrial benchmarks, the proposed framework achieves highly competitive performance, reaching 99.1% mAP@50 on a public robotics dataset, 98.3% mAP@50 on an automotive benchmark, and 95.
Position-Based Flocking for Persistent Alignment without Velocity Sensing
Authors: Hossein B. Jond, Veli Bakırcıoğlu, Logan E. Beaver et al. | Submitted: 2026-02-25 | arXiv: 2602.22154
Categories: cs.RO
Research Background: Coordinated collective motion in bird flocks and fish schools inspires algorithms for cohesive swarm robotics. This paper presents a position-based flocking model that achieves persistent velocity alignment without velocity sensing.
研究背景: 在機器人學習領域,Coordinated collective motion in bird flocks and fish schools inspires algorithms for cohesive swarm robotics. This paper presents a position-based flocking model that achieves per
Technical Approach: This paper presents a position-based flocking model that achieves persistent velocity alignment without velocity sensing.
技術方法: 本文提出的方法:This paper presents a position-based flocking model that achieves persistent velocity alignment without velocity sensing.
Key Takeaway: Experimental results using a team of nine real wheeled mobile robots are also presented.
核心發現: 核心結果:Experimental results using a team of nine real wheeled mobile robots are also presented.
System Design of the Ultra Mobility Vehicle: A Driving, Balancing, and Jumping Bicycle Robot
Authors: Benjamin Bokser, Daniel Gonzalez, Aaron Preston et al. | Submitted: 2026-02-25 | arXiv: 2602.22118
Categories: cs.RO
Research Background: Trials cyclists and mountain bike riders can hop, jump, balance, and drive on one or both wheels. This versatility allows them to achieve speed and energy-efficiency on smooth terrain and agility over rough terrain.
研究背景: 在機器人學習領域,Trials cyclists and mountain bike riders can hop, jump, balance, and drive on one or both wheels. This versatility allows them to achieve speed and energy-efficiency on smooth terr
Technical Approach: Inspired by these athletes, we present the design and control of a robotic platform, Ultra Mobility Vehicle (UMV), which combines a bicycle and a reaction mass to move dynamically with minimal actuated degrees of freedom.
技術方法: 本文提出的方法:Inspired by these athletes, we present the design and control of a robotic platform, Ultra Mobility Vehicle (UMV), which combines a bicycle and a reaction mass to move dynamically with minimal actuate
Key Takeaway: Using a constrained Reinforcement Learning (RL) framework, we demonstrate zero-shot transfer of diverse athletic behaviors, including track-stands, jumps, wheelies, rear wheel hopping, and front flips.
核心發現: 核心結果:Using a constrained Reinforcement Learning (RL) framework, we demonstrate zero-shot transfer of diverse athletic behaviors, including track-stands, jumps, wheelies, rear wheel hopping, and front flips
Parallel Continuous-Time Relative Localization with Augmented Clamped Non-Uniform B-Splines
Authors: Jiadong Lu, Zhehan Li, Tao Han et al. | Submitted: 2026-02-25 | arXiv: 2602.22006
Categories: cs.RO
Research Background: Accurate relative localization is critical for multi-robot cooperation. In robot swarms, measurements from different robots arrive asynchronously and with clock time-offsets.
研究背景: 在機器人學習領域,Accurate relative localization is critical for multi-robot cooperation. In robot swarms, measurements from different robots arrive asynchronously and with clock time-offsets.
Technical Approach: This paper proposes CT-RIO, a novel Continuous-Time Relative-Inertial Odometry framework.
技術方法: 本文提出的方法:This paper proposes CT-RIO, a novel Continuous-Time Relative-Inertial Odometry framework.
Key Takeaway: It consistently outperforms state-of-the-art methods, with improvements of up to 60% under high-speed motion.
核心發現: 核心結果:It consistently outperforms state-of-the-art methods, with improvements of up to 60% under high-speed motion.
Dream-SLAM: Dreaming the Unseen for Active SLAM in Dynamic Environments
Authors: Xiangqi Meng, Pengxu Hou, Zhenjun Zhao et al. | Submitted: 2026-02-25 | arXiv: 2602.21967
Categories: cs.RO, cs.CV
Research Background: In addition to the core tasks of simultaneous localization and mapping (SLAM), active SLAM additionally in- volves generating robot actions that enable effective and efficient exploration of unknown environments. However, existing active SLAM pipelines are limited by three main factors.
研究背景: 在機器人學習領域,In addition to the core tasks of simultaneous localization and mapping (SLAM), active SLAM additionally in- volves generating robot actions that enable effective and efficient expl
Technical Approach: To address these limitations, we propose a novel monocular active SLAM method, Dream-SLAM, which is based on dreaming cross-spatio-temporal images and semantically plausible structures of partially observed dynamic environments.
技術方法: 本文提出的方法:To address these limitations, we propose a novel monocular active SLAM method, Dream-SLAM, which is based on dreaming cross-spatio-temporal images and semantically plausible structures of partially ob
Key Takeaway: Extensive experiments on both public and self-collected datasets demonstrate that Dream-SLAM outperforms state-of-the-art methods in localization accuracy, mapping quality, and exploration efficiency.
核心發現: 核心結果:Extensive experiments on both public and self-collected datasets demonstrate that Dream-SLAM outperforms state-of-the-art methods in localization accuracy, mapping quality, and exploration efficiency.
The Swarm Intelligence Freeway-Urban Trajectories (SWIFTraj) Dataset — Part II: A Graph-Based Approach for Trajectory Connection
Authors: Xinkai Ji, Pan Liu, Ying Yang et al. | Submitted: 2026-02-25 | arXiv: 2602.21954
Categories: physics.soc-ph, cs.RO
Research Background: In Part I of this companion paper series, we introduced SWIFTraj, a new open-source vehicle trajectory dataset collected using a unmanned aerial vehicle (UAV) swarm. The dataset has two distinctive features.
研究背景: 在機器人學習領域,In Part I of this companion paper series, we introduced SWIFTraj, a new open-source vehicle trajectory dataset collected using a unmanned aerial vehicle (UAV) swarm. The dataset ha
Technical Approach: In Part I of this companion paper series, we introduced SWIFTraj, a new open-source vehicle trajectory dataset collected using a unmanned aerial vehicle (UAV) swarm. To address these challenges, this paper proposes a novel graph-based approach for connecting vehicle trajectories captured by a UAV swarm.
技術方法: 本文提出的方法:In Part I of this companion paper series, we introduced SWIFTraj, a new open-source vehicle trajectory dataset collected using a unmanned aerial vehicle (UAV) swarm. To address these challenges, this
Key Takeaway: These results demonstrate the effectiveness of the proposed method in addressing key challenges in UAV-based trajectory connection and highlight its potential for large-scale vehicle trajectory collection.
核心發現: 核心結果:These results demonstrate the effectiveness of the proposed method in addressing key challenges in UAV-based trajectory connection and highlight its potential for large-scale vehicle trajectory collec
Self-Curriculum Model-based Reinforcement Learning for Shape Control of Deformable Linear Objects
Authors: Zhaowei Liang, Song Wang, Zhao Jin et al. | Submitted: 2026-02-25 | arXiv: 2602.21816
Categories: cs.RO
Research Background: Precise shape control of Deformable Linear Objects (DLOs) is crucial in robotic applications such as industrial and medical fields. However, existing methods face challenges in handling complex large deformation tasks, especially those involving opposite curvatures, and lack efficiency and precision.
研究背景: 在機器人學習領域,Precise shape control of Deformable Linear Objects (DLOs) is crucial in robotic applications such as industrial and medical fields. However, existing methods face challenges in han
Technical Approach: To address this, we propose a two-stage framework combining Reinforcement Learning (RL) and online visual servoing. Additionally, we design a self-curriculum goal generation mechanism that dynamically selects intermediate-difficulty goals with high diversity through imagined evaluations, thereby optimizing the policy learning process.
技術方法: 本文提出的方法:To address this, we propose a two-stage framework combining Reinforcement Learning (RL) and online visual servoing. Additionally, we design a self-curriculum goal generation mechanism that dynamically
Key Takeaway: Simulation results show that the proposed method enables efficient policy learning and significantly outperforms mainstream baselines in shape control success rate and precision.
核心發現: 核心結果:Simulation results show that the proposed method enables efficient policy learning and significantly outperforms mainstream baselines in shape control success rate and precision.
Trajectory Generation with Endpoint Regulation and Momentum-Aware Dynamics for Visually Impaired Scenarios
Authors: Yuting Zeng, Manping Fan, You Zhou et al. | Submitted: 2026-02-25 | arXiv: 2602.21691
Categories: cs.RO
Research Background: Trajectory generation for visually impaired scenarios requires smooth and temporally consistent state in structured, low-speed dynamic environments. However, traditional jerk-based heuristic trajectory sampling with independent segment generation and conventional smoothness penalties often lead to unstable terminal behavior and state discontinuities under frequent regenerating.
研究背景: 在機器人學習領域,Trajectory generation for visually impaired scenarios requires smooth and temporally consistent state in structured, low-speed dynamic environments. However, traditional jerk-based
Technical Approach: This paper proposes a trajectory generation approach that integrates endpoint regulation to stabilize terminal states within each segment and momentum-aware dynamics to regularize the evolution of velocity and acceleration for segment consistency.
技術方法: 本文提出的方法:This paper proposes a trajectory generation approach that integrates endpoint regulation to stabilize terminal states within each segment and momentum-aware dynamics to regularize the evolution of vel
Key Takeaway: Experimental results demonstrate reduced acceleration peaks and lower jerk levels with decreased dispersion, smoother velocity and acceleration profiles, more stable endpoint distributions, and fewer infeasible trajectory candidates compared with a baseline planner.
核心發現: 核心結果:Experimental results demonstrate reduced acceleration peaks and lower jerk levels with decreased dispersion, smoother velocity and acceleration profiles, more stable endpoint distributions, and fewer
SunnyParking: Multi-Shot Trajectory Generation and Motion State Awareness for Human-like Parking
Authors: Jishu Miao, Han Chen, Jiankun Zhai et al. | Submitted: 2026-02-25 | arXiv: 2602.21682
Categories: cs.RO
Research Background: Autonomous parking fundamentally differs from on-road driving due to its frequent direction changes and complex maneuvering requirements. However, existing End-to-End (E2E) planning methods often simplify the parking task into a geometric path regression problem, neglecting explicit modeling of the vehicle’s kinematic state.
研究背景: 在機器人學習領域,Autonomous parking fundamentally differs from on-road driving due to its frequent direction changes and complex maneuvering requirements. However, existing End-to-End (E2E) plannin
Technical Approach: In this paper, we propose SunnyParking, a novel dual-branch E2E architecture that achieves motion state awareness by jointly predicting spatial trajectories and discrete motion state sequences (e.g., forward/reverse). Additionally, we introduce a Fourier feature-based representation of target parking slots to overcome the resolution limitations of traditional bird’s-eye view (BEV) approaches, enabling high-precision target interactions. Experimental results demonstrate that our framework generates more robust and human-like trajectories in complex multi-shot parking scenarios, while significantly improving gear-shift point localization accuracy compared to state-of-the-art methods.
技術方法: 本文提出的方法:In this paper, we propose SunnyParking, a novel dual-branch E2E architecture that achieves motion state awareness by jointly predicting spatial trajectories and discrete motion state sequences (e.g.,
Key Takeaway: We open-source a new parking dataset of the CARLA simulator, specifically designed to evaluate full prediction capabilities under complex maneuvers.
核心發現: 核心結果:We open-source a new parking dataset of the CARLA simulator, specifically designed to evaluate full prediction capabilities under complex maneuvers.
Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning
Authors: Tomoya Kawabe, Rin Takano | Submitted: 2026-02-25 | arXiv: 2602.21670
Categories: cs.RO, cs.AI, cs.MA
Research Background: Multi-robot task planning requires decomposing natural-language instructions into executable actions for heterogeneous robot teams. Conventional Planning Domain Definition Language (PDDL) planners provide rigorous guarantees but struggle to handle ambiguous or long-horizon missions, while large language models (LLMs) can interpret instructions and propose plans but may hallucinate or produce infeasible actions.
研究背景: 在機器人學習領域,Multi-robot task planning requires decomposing natural-language instructions into executable actions for heterogeneous robot teams. Conventional Planning Domain Definition Language
Technical Approach: We present a hierarchical multi-agent LLM-based planner with prompt optimization: an upper layer decomposes tasks and assigns them to lower-layer agents, which generate PDDL problems solved by a classical planner.
技術方法: 本文提出的方法:We present a hierarchical multi-agent LLM-based planner with prompt optimization: an upper layer decomposes tasks and assigns them to lower-layer agents, which generate PDDL problems solved by a class
Key Takeaway: An ablation study shows that the hierarchical structure, prompt optimization, and meta-prompt sharing contribute roughly +59, +37, and +4 percentage points to the overall success rate.
核心發現: 核心結果:An ablation study shows that the hierarchical structure, prompt optimization, and meta-prompt sharing contribute roughly +59, +37, and +4 percentage points to the overall success rate.
DAGS-SLAM: Dynamic-Aware 3DGS SLAM via Spatiotemporal Motion Probability and Uncertainty-Aware Scheduling
Authors: Li Zhang, Yu-An Liu, Xijia Jiang et al. | Submitted: 2026-02-25 | arXiv: 2602.21644
Categories: cs.RO
Research Background: Mobile robots and IoT devices demand real-time localization and dense reconstruction under tight compute and energy budgets. While 3D Gaussian Splatting (3DGS) enables efficient dense SLAM, dynamic objects and occlusions still degrade tracking and mapping.
研究背景: 在機器人學習領域,Mobile robots and IoT devices demand real-time localization and dense reconstruction under tight compute and energy budgets. While 3D Gaussian Splatting (3DGS) enables efficient de
Technical Approach: We present DAGS-SLAM, a dynamic-aware 3DGS-SLAM system that maintains a spatiotemporal motion probability (MP) state per Gaussian and triggers semantics on demand via an uncertainty-aware scheduler.
技術方法: 本文提出的方法:We present DAGS-SLAM, a dynamic-aware 3DGS-SLAM system that maintains a spatiotemporal motion probability (MP) state per Gaussian and triggers semantics on demand via an uncertainty-aware scheduler.
Key Takeaway: Experiments on public dynamic RGB-D benchmarks show improved reconstruction and robust tracking while sustaining real-time throughput on a commodity GPU, demonstrating a practical speed-accuracy tradeoff with reduced semantic invocations toward mobile deployment.
核心發現: 核心結果:Experiments on public dynamic RGB-D benchmarks show improved reconstruction and robust tracking while sustaining real-time throughput on a commodity GPU, demonstrating a practical speed-accuracy trade
Learning Agile and Robust Omnidirectional Aerial Motion on Overactuated Tiltable-Quadrotors
Authors: Wentao Zhang, Zhaoqi Ma, Jinjie Li et al. | Submitted: 2026-02-25 | arXiv: 2602.21583
Categories: cs.RO
Research Background: Tilt-rotor aerial robots enable omnidirectional maneuvering through thrust vectoring, but introduce significant control challenges due to the strong coupling between joint and rotor dynamics. While model-based controllers can achieve high motion accuracy under nominal conditions, their robustness and responsiveness often degrade in the presence of disturbances and modeling uncertainties.
研究背景: 在機器人學習領域,Tilt-rotor aerial robots enable omnidirectional maneuvering through thrust vectoring, but introduce significant control challenges due to the strong coupling between joint and roto
Technical Approach: We present a learning-based control framework that enables efficient acquisition of coordinated rotor-joint behaviors for reaching target poses in the space.
技術方法: 本文提出的方法:We present a learning-based control framework that enables efficient acquisition of coordinated rotor-joint behaviors for reaching target poses in the space.
Key Takeaway: Compared with a state-of-the-art NMPC controller, the proposed method achieves comparable six-degree-of-freedom pose tracking accuracy, while demonstrating superior robustness and generalization across diverse tasks, enabling zero-shot deployment on real hardware.
核心發現: 核心結果:Compared with a state-of-the-art NMPC controller, the proposed method achieves comparable six-degree-of-freedom pose tracking accuracy, while demonstrating superior robustness and generalization acros
GFPL: Generative Federated Prototype Learning for Resource-Constrained and Data-Imbalanced Vision Task
Authors: Shiwei Lu, Yuhang He, Jiashuo Li et al. | Submitted: 2026-02-25 | arXiv: 2602.21873
Categories: cs.CV, cs.LG
Research Background: Federated learning (FL) facilitates the secure utilization of decentralized images, advancing applications in medical image recognition and autonomous driving. However, conventional FL faces two critical challenges in real-world deployment: ineffective knowledge fusion caused by model updates biased toward majority-class features, and prohibitive communication overhead due to frequent transmissions of high-dimensional model parameters.
研究背景: 在機器人學習領域,Federated learning (FL) facilitates the secure utilization of decentralized images, advancing applications in medical image recognition and autonomous driving. However, conventiona
Technical Approach: Inspired by the human brain’s efficiency in knowledge integration, we propose a novel Generative Federated Prototype Learning (GFPL) framework to address these issues.
技術方法: 本文提出的方法:Inspired by the human brain’s efficiency in knowledge integration, we propose a novel Generative Federated Prototype Learning (GFPL) framework to address these issues.
Key Takeaway: Extensive experiments on benchmarks show that GFPL improves model accuracy by 3.6% under imbalanced data settings while maintaining low communication cost.
核心發現: 核心結果:Extensive experiments on benchmarks show that GFPL improves model accuracy by 3.6% under imbalanced data settings while maintaining low communication cost.
WeatherCity: Urban Scene Reconstruction with Controllable Multi-Weather Transformation
Authors: Wenhua Wu, Huai Guan, Zhe Liu et al. | Submitted: 2026-02-25 | arXiv: 2602.22096
Categories: cs.CV
Research Background: Editable high-fidelity 4D scenes are crucial for autonomous driving, as they can be applied to end-to-end training and closed-loop simulation. However, existing reconstruction methods are primarily limited to replicating observed scenes and lack the capability for diverse weather simulation.
研究背景: 在機器人學習領域,Editable high-fidelity 4D scenes are crucial for autonomous driving, as they can be applied to end-to-end training and closed-loop simulation. However, existing reconstruction meth
Technical Approach: To address these limitations, we propose \textbf{WeatherCity}, a novel framework for 4D urban scene reconstruction and weather editing. Specifically, we leverage a text-guided image editing model to achieve flexible editing of image weather backgrounds. To tackle the challenge of multi-weather modeling, we introduce a novel weather Gaussian representation based on shared scene features and dedicated weather-specific decoders.
技術方法: 本文提出的方法:To address these limitations, we propose \textbf{WeatherCity}, a novel framework for 4D urban scene reconstruction and weather editing. Specifically, we leverage a text-guided image editing model to a
Key Takeaway: Extensive experiments on multiple datasets and various scenes demonstrate that WeatherCity achieves flexible controllability, high fidelity, and temporal consistency in 4D reconstruction and weather editing.
核心發現: 核心結果:Extensive experiments on multiple datasets and various scenes demonstrate that WeatherCity achieves flexible controllability, high fidelity, and temporal consistency in 4D reconstruction and weather e
PanoEnv: Exploring 3D Spatial Intelligence in Panoramic Environments with Reinforcement Learning
Authors: Zekai Lin, Xu Zheng | Submitted: 2026-02-25 | arXiv: 2602.21992
Categories: cs.CV
Research Background: 360 panoramic images are increasingly used in virtual reality, autonomous driving, and robotics for holistic scene understanding. However, current Vision-Language Models (VLMs) struggle with 3D spatial reasoning on Equirectangular Projection (ERP) images due to geometric distortion and limited 3D supervision.
研究背景: 在機器人學習領域,360 panoramic images are increasingly used in virtual reality, autonomous driving, and robotics for holistic scene understanding. However, current Vision-Language Models (VLMs) str
Technical Approach: We introduce PanoEnv, a large-scale VQA benchmark built from synthetic 3D environments, containing 14.8K questions across five categories (e.g., relative position, volume comparison) grounded in accurate 3D annotations including depth, segmentation, and bounding boxes. To enhance 3D reasoning, we propose a reinforcement learning post-training framework based on Group Relative Policy Optimization (GRPO) with a ground-truth-guided reward that incorporates five geometry-aware strategies such as distance tolerance and spatial consistency.
技術方法: 本文提出的方法:We introduce PanoEnv, a large-scale VQA benchmark built from synthetic 3D environments, containing 14.8K questions across five categories (e.g., relative position, volume comparison) grounded in accur
Key Takeaway: These results demonstrate that PanoEnv-QA and our curriculum-based RL framework effectively instill 3D spatial intelligence in VLMs for omnidirectional perception.
核心發現: 核心結果:These results demonstrate that PanoEnv-QA and our curriculum-based RL framework effectively instill 3D spatial intelligence in VLMs for omnidirectional perception.
Unified Unsupervised and Sparsely-Supervised 3D Object Detection by Semantic Pseudo-Labeling and Prototype Learning
Authors: Yushen He, Lei Zhao, Weidong Chen | Submitted: 2026-02-25 | arXiv: 2602.21484
Categories: cs.CV
Research Background: 3D object detection is essential for autonomous driving and robotic perception, yet its reliance on large-scale manually annotated data limits scalability and adaptability. To reduce annotation dependency, unsupervised and sparsely-supervised paradigms have emerged.
研究背景: 在機器人學習領域,3D object detection is essential for autonomous driving and robotic perception, yet its reliance on large-scale manually annotated data limits scalability and adaptability. To redu
Technical Approach: This paper proposes SPL, a unified training framework for both unsupervised and sparsely-supervised 3D object detection via \underline{S}emantic \underline{P}seudo-labeling and prototype \underline{L}earning.
技術方法: 本文提出的方法:This paper proposes SPL, a unified training framework for both unsupervised and sparsely-supervised 3D object detection via \underline{S}emantic \underline{P}seudo-labeling and prototype \underline{L}
Key Takeaway: Extensive experiments on KITTI and nuScenes datasets demonstrate that SPL significantly outperforms state-of-the-art methods in both settings.
核心發現: 核心結果:Extensive experiments on KITTI and nuScenes datasets demonstrate that SPL significantly outperforms state-of-the-art methods in both settings.
TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving
Authors: Tugrul Gorgulu, Atakan Dag, M. Esat Kalfaoglu et al. | Submitted: 2026-02-26 | arXiv: 2602.23499
Categories: cs.RO, cs.AI
Research Background: Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable. Autonomous driving challenges remain a prominent area of research, requiring further exploration to enhance the perception and planning performance of vehicles.
研究背景: 在機器人學習領域,Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable. Autonomous
Technical Approach: Autonomous driving challenges remain a prominent area of research, requiring further exploration to enhance the perception and planning performance of vehicles. However, existing datasets are often incomplete. For instance, datasets that include perception information generally lack planning data, while planning datasets typically consist of extensive driving sequences where the ego vehicle predominantly drives forward, offering limited behavioral diversity.
技術方法: 本文提出的方法:Autonomous driving challenges remain a prominent area of research, requiring further exploration to enhance the perception and planning performance of vehicles. However, existing datasets are often in
Key Takeaway: Furthermore, we demonstrate its versatility by training various models using our dataset.
核心發現: 核心結果:Furthermore, we demonstrate its versatility by training various models using our dataset.
Simple Models, Real Swimming: Digital Twins for Tendon-Driven Underwater Robots
Authors: Mike Y. Michelis, Nana Obayashi, Josie Hughes et al. | Submitted: 2026-02-26 | arXiv: 2602.23283
Categories: cs.RO
Research Background: Mimicking the graceful motion of swimming animals remains a core challenge in soft robotics due to the complexity of fluid-structure interaction and the difficulty of controlling soft, biomimetic bodies. Existing modeling approaches are often computationally expensive and impractical for complex control or reinforcement learning needed for realistic motions to emerge in robotic systems.
研究背景: 在機器人學習領域,Mimicking the graceful motion of swimming animals remains a core challenge in soft robotics due to the complexity of fluid-structure interaction and the difficulty of controlling s
Technical Approach: In this work, we present a tendon-driven fish robot modeled in an efficient underwater swimmer environment using a simplified, stateless hydrodynamics formulation implemented in the widespread robotics framework MuJoCo.
技術方法: 本文提出的方法:In this work, we present a tendon-driven fish robot modeled in an efficient underwater swimmer environment using a simplified, stateless hydrodynamics formulation implemented in the widespread robotic
Key Takeaway: Due to the simplicity and ease of use of the model and our open-source simulation environment, our results show that even simple, stateless models — when carefully matched to physical data — can serve as effective digital twins for soft underwater robots, opening up new directions for scalable learning and control in aquatic environments.
核心發現: 核心結果:Due to the simplicity and ease of use of the model and our open-source simulation environment, our results show that even simple, stateless models — when carefully matched to physical data — can ser
SPARR: Simulation-based Policies with Asymmetric Real-world Residuals for Assembly
Authors: Yijie Guo, Iretiayo Akinola, Lars Johannsmeier et al. | Submitted: 2026-02-26 | arXiv: 2602.23253
Categories: cs.RO
Research Background: Robotic assembly presents a long-standing challenge due to its requirement for precise, contact-rich manipulation. While simulation-based learning has enabled the development of robust assembly policies, their performance often degrades when deployed in real-world settings due to the sim-to-real gap.
研究背景: 在機器人學習領域,Robotic assembly presents a long-standing challenge due to its requirement for precise, contact-rich manipulation. While simulation-based learning has enabled the development of ro
Technical Approach: In this work, we propose a hybrid approach that combines a simulation-trained base policy with a real-world residual policy to efficiently adapt to real-world variations. Extensive real-world experiments demonstrate that our method, SPARR, achieves near-perfect success rates across diverse two-part assembly tasks.
技術方法: 本文提出的方法:In this work, we propose a hybrid approach that combines a simulation-trained base policy with a real-world residual policy to efficiently adapt to real-world variations. Extensive real-world experime
Key Takeaway: Moreover, SPARR requires no human expertise, in contrast to the state-of-the-art real-world RL approaches that depend heavily on human supervision.
核心發現: 核心結果:Moreover, SPARR requires no human expertise, in contrast to the state-of-the-art real-world RL approaches that depend heavily on human supervision.
FLIGHT: Fibonacci Lattice-based Inference for Geometric Heading in real-Time
Authors: David Dirnfeld, Fabien Delattre, Pedro Miraldo et al. | Submitted: 2026-02-26 | arXiv: 2602.23115
Categories: cs.CV, cs.CG, cs.RO
Research Background: Estimating camera motion from monocular video is a fundamental problem in computer vision, central to tasks such as SLAM, visual odometry, and structure-from-motion. Existing methods that recover the camera’s heading under known rotation, whether from an IMU or an optimization algorithm, tend to perform well in low-noise, low-outlier conditions, but often decrease in accuracy or become computationally expensive as noise and outlier levels increase.
研究背景: 在機器人學習領域,Estimating camera motion from monocular video is a fundamental problem in computer vision, central to tasks such as SLAM, visual odometry, and structure-from-motion. Existing metho
Technical Approach: To address these limitations, we propose a novel generalization of the Hough transform on the unit sphere (S(2)) to estimate the camera’s heading.
技術方法: 本文提出的方法:To address these limitations, we propose a novel generalization of the Hough transform on the unit sphere (S(2)) to estimate the camera’s heading.
Key Takeaway: Additionally, experiments on SLAM show that the proposed method reduces RMSE by correcting the heading during camera pose initialization.
核心發現: 核心結果:Additionally, experiments on SLAM show that the proposed method reduces RMSE by correcting the heading during camera pose initialization.
GeoWorld: Geometric World Models
Authors: Zeyu Zhang, Danning Li, Ian Reid et al. | Submitted: 2026-02-26 | arXiv: 2602.23058
Categories: cs.CV, cs.RO
Research Background: Energy-based predictive world models provide a powerful approach for multi-step visual planning by reasoning over latent energy landscapes rather than generating pixels. However, existing approaches face two major challenges: (i) their latent representations are typically learned in Euclidean space, neglecting the underlying geometric and hierarchical structure among states, and (ii) they struggle with long-horizon prediction, which leads to rapid degradation across extended rollouts.
研究背景: 在機器人學習領域,Energy-based predictive world models provide a powerful approach for multi-step visual planning by reasoning over latent energy landscapes rather than generating pixels. However, e
Technical Approach: To address these challenges, we introduce GeoWorld, a geometric world model that preserves geometric structure and hierarchical relations through a Hyperbolic JEPA, which maps latent representations from Euclidean space onto hyperbolic manifolds.
技術方法: 本文提出的方法:To address these challenges, we introduce GeoWorld, a geometric world model that preserves geometric structure and hierarchical relations through a Hyperbolic JEPA, which maps latent representations f
Key Takeaway: Extensive experiments on CrossTask and COIN demonstrate around 3% SR improvement in 3-step planning and 2% SR improvement in 4-step planning compared to the state-of-the-art V-JEPA 2.
核心發現: 核心結果:Extensive experiments on CrossTask and COIN demonstrate around 3% SR improvement in 3-step planning and 2% SR improvement in 4-step planning compared to the state-of-the-art V-JEPA 2.
Considering Perspectives for Automated Driving Ethics: Collective Risk in Vehicular Motion Planning
Authors: Leon Tolksdorf, Arturo Tejada, Christian Birkner et al. | Submitted: 2026-02-26 | arXiv: 2602.22940
Categories: cs.RO
Research Background: Recent automated vehicle (AV) motion planning strategies evolve around minimizing risk in road traffic. However, they exclusively consider risk from the AV’s perspective and, as such, do not address the ethicality of its decisions for other road users.
研究背景: 在機器人學習領域,Recent automated vehicle (AV) motion planning strategies evolve around minimizing risk in road traffic. However, they exclusively consider risk from the AV’s perspective and, as su
Technical Approach: To test this hypothesis, we propose an AV motion planning strategy that supports switching risk minimization strategies between all road user perspectives.
技術方法: 本文提出的方法:To test this hypothesis, we propose an AV motion planning strategy that supports switching risk minimization strategies between all road user perspectives.
Key Takeaway: We find that the risk from the perspective of other road users can generally be considered different to the risk from the AV’s perspective.
核心發現: 核心結果:We find that the risk from the perspective of other road users can generally be considered different to the risk from the AV’s perspective.
Unleashing the Potential of Diffusion Models for End-to-End Autonomous Driving
Authors: Yinan Zheng, Tianyi Tan, Bin Huang et al. | Submitted: 2026-02-26 | arXiv: 2602.22801
Categories: cs.RO, cs.AI, cs.LG
Research Background: Diffusion models have become a popular choice for decision-making tasks in robotics, and more recently, are also being considered for solving autonomous driving tasks. However, their applications and evaluations in autonomous driving remain limited to simulation-based or laboratory settings.
研究背景: 在機器人學習領域,Diffusion models have become a popular choice for decision-making tasks in robotics, and more recently, are also being considered for solving autonomous driving tasks. However, the
Technical Approach: However, their applications and evaluations in autonomous driving remain limited to simulation-based or laboratory settings. The full strength of diffusion models for large-scale, complex real-world settings, such as End-to-End Autonomous Driving (E2E AD), remains underexplored. In this study, we conducted a systematic and large-scale investigation to unleash the potential of the diffusion models as planners for E2E AD, based on a tremendous amount of real-vehicle data and road testing.
技術方法: 本文提出的方法:However, their applications and evaluations in autonomous driving remain limited to simulation-based or laboratory settings. The full strength of diffusion models for large-scale, complex real-world s
Key Takeaway: Our work demonstrates that diffusion models, when properly designed and trained, can serve as effective and scalable E2E AD planners for complex, real-world autonomous driving tasks.
核心發現: 核心結果:Our work demonstrates that diffusion models, when properly designed and trained, can serve as effective and scalable E2E AD planners for complex, real-world autonomous driving tasks.
Pixel2Catch: Multi-Agent Sim-to-Real Transfer for Agile Manipulation with a Single RGB Camera
Authors: Seongyong Kim, Junhyeon Cho, Kang-Won Lee et al. | Submitted: 2026-02-26 | arXiv: 2602.22733
Categories: cs.RO
Research Background: To catch a thrown object, a robot must be able to perceive the object’s motion and generate control actions in a timely manner. Rather than explicitly estimating the object’s 3D position, this work focuses on a novel approach that recognizes object motion using pixel-level visual information extracted from a single RGB image.
研究背景: 在機器人學習領域,To catch a thrown object, a robot must be able to perceive the object’s motion and generate control actions in a timely manner. Rather than explicitly estimating the object’s 3D po
Technical Approach: Furthermore, to achieve stable learning in a high-DoF system composed of a robot arm equipped with a multi-fingered hand, we design a heterogeneous multi-agent reinforcement learning framework that defines the arm and hand as independent agents with distinct roles.
技術方法: 本文提出的方法:Furthermore, to achieve stable learning in a high-DoF system composed of a robot arm equipped with a multi-fingered hand, we design a heterogeneous multi-agent reinforcement learning framework that de
Key Takeaway: Furthermore, to achieve stable learning in a high-DoF system composed of a robot arm equipped with a multi-fingered hand, we design a heterogeneous multi-agent reinforcement learning framework that defines the arm and hand as independent agents with distinct roles.
核心發現: 核心結果:Furthermore, to achieve stable learning in a high-DoF system composed of a robot arm equipped with a multi-fingered hand, we design a heterogeneous multi-agent reinforcement learning framework that de
Sapling-NeRF: Geo-Localised Sapling Reconstruction in Forests for Ecological Monitoring
Authors: Miguel Ángel Muñoz-Bañón, Nived Chebrolu, Sruthi M. Krishna Moorthy et al. | Submitted: 2026-02-26 | arXiv: 2602.22731
Categories: cs.RO, cs.CV
Research Background: Saplings are key indicators of forest regeneration and overall forest health. However, their fine-scale architectural traits are difficult to capture with existing 3D sensing methods, which make quantitative evaluation difficult.
研究背景: 在機器人學習領域,Saplings are key indicators of forest regeneration and overall forest health. However, their fine-scale architectural traits are difficult to capture with existing 3D sensing metho
Technical Approach: In this paper, we present a pipeline which fuses NeRF, LiDAR SLAM, and GNSS to enable repeatable, geo-localised ecological monitoring of saplings. Our system proposes a three-level representation: (i) coarse Earth-frame localisation using GNSS, (ii) LiDAR-based SLAM for centimetre-accurate localisation and reconstruction, and (iii) NeRF-derived object-centric dense reconstruction of individual saplings.
技術方法: 本文提出的方法:In this paper, we present a pipeline which fuses NeRF, LiDAR SLAM, and GNSS to enable repeatable, geo-localised ecological monitoring of saplings. Our system proposes a three-level representation: (i)
Key Takeaway: We demonstrate that accurate stem skeletons and leaf distributions can be measured for saplings with heights between 0.5m and 2m in situ, giving ecologists access to richer structural and quantitative data for analysing forest dynamics.
核心發現: 核心結果:We demonstrate that accurate stem skeletons and leaf distributions can be measured for saplings with heights between 0.5m and 2m in situ, giving ecologists access to richer structural and quantitative
Robust Helicopter Ship Deck Landing With Guaranteed Timing Using Shrinking-Horizon Model Predictive Control
Authors: Philipp Schitz, Paolo Mercorelli, Johann C. Dauer | Submitted: 2026-02-26 | arXiv: 2602.22714
Categories: cs.RO, eess.SY
Research Background: We present a runtime efficient algorithm for autonomous helicopter landings on moving ship decks based on Shrinking-Horizon Model Predictive Control (SHMPC). First, a suitable planning model capturing the relevant aspects of the full nonlinear helicopter dynamics is derived.
研究背景: 在機器人學習領域,We present a runtime efficient algorithm for autonomous helicopter landings on moving ship decks based on Shrinking-Horizon Model Predictive Control (SHMPC). First, a suitable plan
Technical Approach: We present a runtime efficient algorithm for autonomous helicopter landings on moving ship decks based on Shrinking-Horizon Model Predictive Control (SHMPC). The efficacy of our approach is shown in simulation where all maneuvers achieve a high landing precision in strong winds while satisfying timing and operational constraints with maximum computation times in the millisecond range.
技術方法: 本文提出的方法:We present a runtime efficient algorithm for autonomous helicopter landings on moving ship decks based on Shrinking-Horizon Model Predictive Control (SHMPC). The efficacy of our approach is shown in s
Key Takeaway: The efficacy of our approach is shown in simulation where all maneuvers achieve a high landing precision in strong winds while satisfying timing and operational constraints with maximum computation times in the millisecond range.
核心發現: 核心結果:The efficacy of our approach is shown in simulation where all maneuvers achieve a high landing precision in strong winds while satisfying timing and operational constraints with maximum computation ti
SCOPE: Skeleton Graph-Based Computation-Efficient Framework for Autonomous UAV Exploration
Authors: Kai Li, Shengtao Zheng, Linkun Xiu et al. | Submitted: 2026-02-26 | arXiv: 2602.22707
Categories: cs.RO
Research Background: Autonomous exploration in unknown environments is key for mobile robots, helping them perceive, map, and make decisions in complex areas. However, current methods often rely on frequent global optimization, suffering from high computational latency and trajectory oscillation, especially on resource-constrained edge devices.
研究背景: 在機器人學習領域,Autonomous exploration in unknown environments is key for mobile robots, helping them perceive, map, and make decisions in complex areas. However, current methods often rely on fre
Technical Approach: To address these limitations, we propose SCOPE, a novel framework that incrementally constructs a real-time skeletal graph and introduces Implicit Unknown Region Analysis for efficient spatial reasoning.
技術方法: 本文提出的方法:To address these limitations, we propose SCOPE, a novel framework that incrementally constructs a real-time skeletal graph and introduces Implicit Unknown Region Analysis for efficient spatial reasoni
Key Takeaway: Real-world experiments further validate the system’s robustness and low latency in practical scenarios.
核心發現: 核心結果:Real-world experiments further validate the system’s robustness and low latency in practical scenarios.
Layered Safety: Enhancing Autonomous Collision Avoidance via Multistage CBF Safety Filters
Authors: Erina Yamaguchi, Ryan M. Bena, Gilbert Bahati et al. | Submitted: 2026-02-27 | arXiv: 2603.00338
Categories: cs.RO
Research Background: This paper presents a general end-to-end framework for constructing robust and reliable layered safety filters that can be leveraged to perform dynamic collision avoidance over a broad range of applications using only local perception data. Given a robot-centric point cloud, we begin by constructing an occupancy map which is used to synthesize a Poisson safety function (PSF).
研究背景: 在機器人學習領域,This paper presents a general end-to-end framework for constructing robust and reliable layered safety filters that can be leveraged to perform dynamic collision avoidance over a b
Technical Approach: This paper presents a general end-to-end framework for constructing robust and reliable layered safety filters that can be leveraged to perform dynamic collision avoidance over a broad range of applications using only local perception data. In the first stage, we propose a predictive safety filter to compute optimal safe trajectories based on nominal potentially-unsafe commands.
技術方法: 本文提出的方法:This paper presents a general end-to-end framework for constructing robust and reliable layered safety filters that can be leveraged to perform dynamic collision avoidance over a broad range of applic
Key Takeaway: We further demonstrate the effectiveness and generality of our collision avoidance methodology on multiple legged robot platforms across a variety of real-world dynamic scenarios.
核心發現: 核心結果:We further demonstrate the effectiveness and generality of our collision avoidance methodology on multiple legged robot platforms across a variety of real-world dynamic scenarios.
SafeGen-LLM: Enhancing Safety Generalization in Task Planning for Robotic Systems
Authors: Jialiang Fan, Weizhe Xu, Mengyu Liu et al. | Submitted: 2026-02-27 | arXiv: 2602.24235
Categories: cs.RO, cs.AI
Research Background: Safety-critical task planning in robotic systems remains challenging: classical planners suffer from poor scalability, Reinforcement Learning (RL)-based methods generalize poorly, and base Large Language Models (LLMs) cannot guarantee safety. To address this gap, we propose safety-generalizable large language models, named SafeGen-LLM.
研究背景: 在機器人學習領域,Safety-critical task planning in robotic systems remains challenging: classical planners suffer from poor scalability, Reinforcement Learning (RL)-based methods generalize poorly,
Technical Approach: To address this gap, we propose safety-generalizable large language models, named SafeGen-LLM. Then, we introduce a two-stage post-training framework: Supervised Fine-Tuning (SFT) on a constraint-compliant planning dataset to learn planning syntax and semantics, and Group Relative Policy Optimization (GRPO) guided by fine-grained reward machines derived from formal verification to enforce safety alignment and by curriculum learning to better handle complex tasks.
技術方法: 本文提出的方法:To address this gap, we propose safety-generalizable large language models, named SafeGen-LLM. Then, we introduce a two-stage post-training framework: Supervised Fine-Tuning (SFT) on a constraint-comp
Key Takeaway: Extensive experiments show that SafeGen-LLM achieves strong safety generalization and outperforms frontier proprietary baselines across multi-domain planning tasks and multiple input formats (e.g., PDDLs and natural language).
核心發現: 核心結果:Extensive experiments show that SafeGen-LLM achieves strong safety generalization and outperforms frontier proprietary baselines across multi-domain planning tasks and multiple input formats (e.g., PD
Curriculum Reinforcement Learning for Quadrotor Racing with Random Obstacles
Authors: Fangyu Sun, Fanxing Li, Yu Hu et al. | Submitted: 2026-02-27 | arXiv: 2602.24030
Categories: cs.RO
Research Background: Autonomous drone racing has attracted increasing interest as a research topic for exploring the limits of agile flight. However, existing studies primarily focus on obstacle-free racetracks, while the perception and dynamic challenges introduced by obstacles remain underexplored, often resulting in low success rates and limited robustness in real-world flight.
研究背景: 在機器人學習領域,Autonomous drone racing has attracted increasing interest as a research topic for exploring the limits of agile flight. However, existing studies primarily focus on obstacle-free r
Technical Approach: To this end, we propose a novel vision-based curriculum reinforcement learning framework for training a robust controller capable of addressing unseen obstacles in drone racing. Both hardware-in-the-loop and real-world experiments demonstrate that our method achieves faster lap times and higher success rates than existing approaches, effectively advancing drone racing in obstacle-rich environments.
技術方法: 本文提出的方法:To this end, we propose a novel vision-based curriculum reinforcement learning framework for training a robust controller capable of addressing unseen obstacles in drone racing. Both hardware-in-the-l
Key Takeaway: Both hardware-in-the-loop and real-world experiments demonstrate that our method achieves faster lap times and higher success rates than existing approaches, effectively advancing drone racing in obstacle-rich environments.
核心發現: 核心結果:Both hardware-in-the-loop and real-world experiments demonstrate that our method achieves faster lap times and higher success rates than existing approaches, effectively advancing drone racing in obst
Autonomous Inspection of Power Line Insulators with UAV on an Unmapped Transmission Tower
Authors: Václav Riss, Vít Krátký, Robert Pěnička et al. | Submitted: 2026-02-27 | arXiv: 2602.24011
Categories: cs.RO
Research Background: This paper introduces an online inspection algorithm that enables an autonomous UAV to fly around a transmission tower and obtain detailed inspection images without a prior map of the tower. Our algorithm relies on camera-LiDAR sensor fusion for online detection and localization of insulators.
研究背景: 在機器人學習領域,This paper introduces an online inspection algorithm that enables an autonomous UAV to fly around a transmission tower and obtain detailed inspection images without a prior map of
Technical Approach: This paper introduces an online inspection algorithm that enables an autonomous UAV to fly around a transmission tower and obtain detailed inspection images without a prior map of the tower.
技術方法: 本文提出的方法:This paper introduces an online inspection algorithm that enables an autonomous UAV to fly around a transmission tower and obtain detailed inspection images without a prior map of the tower.
Key Takeaway: Compared to the most relevant approach, the proposed method achieves more than an order of magnitude lower variance in horizontal insulator localization error.
核心發現: 核心結果:Compared to the most relevant approach, the proposed method achieves more than an order of magnitude lower variance in horizontal insulator localization error.
Learning Robust Control Policies for Inverted Pose on Miniature Blimp Robots
Authors: Yuanlin Yang, Lin Hong, Fumin Zhang | Submitted: 2026-02-27 | arXiv: 2602.23972
Categories: cs.RO
Research Background: The ability to achieve and maintain inverted poses is essential for unlocking the full agility of miniature blimp robots (MBRs). However, developing reliable inverted control strategies for MBRs remains challenging due to their complex and underactuated dynamics.
研究背景: 在機器人學習領域,The ability to achieve and maintain inverted poses is essential for unlocking the full agility of miniature blimp robots (MBRs). However, developing reliable inverted control strat
Technical Approach: To address this challenge, we propose a novel framework that enables robust control policy learning for inverted pose on MBRs.
技術方法: 本文提出的方法:To address this challenge, we propose a novel framework that enables robust control policy learning for inverted pose on MBRs.
Key Takeaway: Furthermore, experimental results confirm that the learned policy with a mapping layer enables an MBR to achieve and maintain a fully inverted pose in real-world settings.
核心發現: 核心結果:Furthermore, experimental results confirm that the learned policy with a mapping layer enables an MBR to achieve and maintain a fully inverted pose in real-world settings.
Learning to Build: Autonomous Robotic Assembly of Stable Structures Without Predefined Plans
Authors: Jingwen Wang, Johannes Kirschner, Paul Rolland et al. | Submitted: 2026-02-27 | arXiv: 2602.23934
Categories: cs.RO, cs.LG
Research Background: This paper presents a novel autonomous robotic assembly framework for constructing stable structures without relying on predefined architectural blueprints. Instead of following fixed plans, construction tasks are defined through targets and obstacles, allowing the system to adapt more flexibly to environmental uncertainty and variations during the building process.
研究背景: 在機器人學習領域,This paper presents a novel autonomous robotic assembly framework for constructing stable structures without relying on predefined architectural blueprints. Instead of following fi
Technical Approach: This paper presents a novel autonomous robotic assembly framework for constructing stable structures without relying on predefined architectural blueprints. The results suggest that our framework offers a promising direction for more adaptable and robust robotic construction in real-world environments.
技術方法: 本文提出的方法:This paper presents a novel autonomous robotic assembly framework for constructing stable structures without relying on predefined architectural blueprints. The results suggest that our framework offe
Key Takeaway: The results suggest that our framework offers a promising direction for more adaptable and robust robotic construction in real-world environments.
核心發現: 核心結果:The results suggest that our framework offers a promising direction for more adaptable and robust robotic construction in real-world environments.
TSC: Topology-Conditioned Stackelberg Coordination for Multi-Agent Reinforcement Learning in Interactive Driving
Authors: Xiaotong Zhang, Gang Xiong, Yuanjing Wang et al. | Submitted: 2026-02-27 | arXiv: 2602.23896
Categories: cs.RO
Research Background: Safe and efficient autonomous driving in dense traffic is fundamentally a decentralized multi-agent coordination problem, where interactions at conflict points such as merging and weaving must be resolved reliably under partial observability. With only local and incomplete cues, interaction patterns can change rapidly, often causing unstable behaviors such as oscillatory yielding or unsafe commitments.
研究背景: 在機器人學習領域,Safe and efficient autonomous driving in dense traffic is fundamentally a decentralized multi-agent coordination problem, where interactions at conflict points such as merging and
Technical Approach: To address these limitations, we propose Topology-conditioned Stackelberg Coordination (TSC), a learning framework for decentralized interactive driving under communication-free execution, which extracts a time-varying directed priority graph from braid-inspired weaving relations between trajectories, thereby defining local leader-follower dependencies without constructing a global order of play.
技術方法: 本文提出的方法:To address these limitations, we propose Topology-conditioned Stackelberg Coordination (TSC), a learning framework for decentralized interactive driving under communication-free execution, which extra
Key Takeaway: Experiments across four dense traffic scenarios show that TSC achieves superior performance over representative MARL baselines across key metrics, most notably reducing collisions while maintaining competitive traffic efficiency and control smoothness.
核心發現: 核心結果:Experiments across four dense traffic scenarios show that TSC achieves superior performance over representative MARL baselines across key metrics, most notably reducing collisions while maintaining co
Altitude-Adaptive Vision-Only Geo-Localization for UAVs in GPS-Denied Environments
Authors: Xingyu Shao, Mengfan He, Chunyu Li et al. | Submitted: 2026-02-27 | arXiv: 2602.23872
Categories: cs.CV, cs.RO
Research Background: To address the scale mismatch caused by large altitude variations in UAV visual place recognition, we propose a monocular vision-only altitude-adaptive geo-localization framework. The method first estimates relative altitude from a single downward-looking image by transforming the input into the frequency domain and formulating altitude estimation as a regression-as-classification (RAC) problem.
研究背景: 在機器人學習領域,To address the scale mismatch caused by large altitude variations in UAV visual place recognition, we propose a monocular vision-only altitude-adaptive geo-localization framework.
Technical Approach: To address the scale mismatch caused by large altitude variations in UAV visual place recognition, we propose a monocular vision-only altitude-adaptive geo-localization framework.
技術方法: 本文提出的方法:To address the scale mismatch caused by large altitude variations in UAV visual place recognition, we propose a monocular vision-only altitude-adaptive geo-localization framework.
Key Takeaway: These results indicate that relative altitude estimation provides an effective scale prior for cross-altitude UAV geo-localization and supports GPS-denied coarse initialization without auxiliary range sensors or temporal inputs.
核心發現: 核心結果:These results indicate that relative altitude estimation provides an effective scale prior for cross-altitude UAV geo-localization and supports GPS-denied coarse initialization without auxiliary range
Acceleration-Based Control of Fixed-Wing UAVs for Guidance Applications
Authors: Jixiang Wang, Siyuan Yang, Ziyi Wu et al. | Submitted: 2026-02-27 | arXiv: 2602.23821
Categories: cs.RO
Research Background: Acceleration-commanded guidance laws (e.g., proportional navigation) are attractive for high-level decision making, but their direct deployment on fixed-wing UAVs is challenging because accelerations are not directly actuated and must be realized through attitude and thrust under flight-envelope constraints. This paper presents an acceleration-level outer-loop control framework that converts commanded tangential and normal accelerations into executable body-rate and normalized thrust commands compatible with mainstream autopilots (e.g., PX4/APM).
研究背景: 在機器人學習領域,Acceleration-commanded guidance laws (e.g., proportional navigation) are attractive for high-level decision making, but their direct deployment on fixed-wing UAVs is challenging be
Technical Approach: This paper presents an acceleration-level outer-loop control framework that converts commanded tangential and normal accelerations into executable body-rate and normalized thrust commands compatible with mainstream autopilots (e.g., PX4/APM). For the tangential channel, we introduce an energy-based formulation inspired by total energy control and identify an empirical thrust-energy acceleration relationship directly from flight data, avoiding explicit propulsion modeling or thrust bench calibration.
技術方法: 本文提出的方法:This paper presents an acceleration-level outer-loop control framework that converts commanded tangential and normal accelerations into executable body-rate and normalized thrust commands compatible w
Key Takeaway: Extensive real-flight experiments on a VTOL fixed-wing platform demonstrate accurate acceleration tracking and enable practical implementation of proportional navigation using only body-rate and normalized thrust interfaces.
核心發現: 核心結果:Extensive real-flight experiments on a VTOL fixed-wing platform demonstrate accurate acceleration tracking and enable practical implementation of proportional navigation using only body-rate and norma
Tilt-X: Enabling Compliant Aerial Manipulation through a Tiltable-Extensible Continuum Manipulator
Authors: Anuraj Uthayasooriyan, Krishna Manaswi Digumarti, Jack Breward et al. | Submitted: 2026-02-27 | arXiv: 2602.23576
Categories: cs.RO
Research Background: Aerial manipulators extend the reach and manipulation capabilities of uncrewed multirotor aerial vehicles for inspection, agriculture, sampling, and delivery. Continuum arm aerial manipulation systems offer lightweight, dexterous, and compliant interaction opportunities.
研究背景: 在機器人學習領域,Aerial manipulators extend the reach and manipulation capabilities of uncrewed multirotor aerial vehicles for inspection, agriculture, sampling, and delivery. Continuum arm aerial
Technical Approach: Addressing these limitations, we present Tilt-X, a continuum arm aerial manipulator that integrates a tilting mechanism, a telescopic stage, and a cable-driven continuum section. We present its design and kinematic model and validate it through flight demonstrations.
技術方法: 本文提出的方法:Addressing these limitations, we present Tilt-X, a continuum arm aerial manipulator that integrates a tilting mechanism, a telescopic stage, and a cable-driven continuum section. We present its design
Key Takeaway: Results show stabilisation of end effector pose as the manipulator extends out of the propeller influence zone.
核心發現: 核心結果:Results show stabilisation of end effector pose as the manipulator extends out of the propeller influence zone.
DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancer
Authors: Yuxuan Zhang, Katarína Tóthová, Zian Wang et al. | Submitted: 2026-02-27 | arXiv: 2602.24096
Categories: cs.CV, cs.AI, cs.LG
Research Background: Simulation is essential to the development and evaluation of autonomous robots such as self-driving vehicles. Neural reconstruction is emerging as a promising solution as it enables simulating a wide variety of scenarios from real-world data alone in an automated and scalable way.
研究背景: 在機器人學習領域,Simulation is essential to the development and evaluation of autonomous robots such as self-driving vehicles. Neural reconstruction is emerging as a promising solution as it enable
Technical Approach: To overcome these limitations, we introduce DiffusionHarmonizer, an online generative enhancement framework that transforms renderings from such imperfect scenes into temporally consistent outputs while improving their realism.
技術方法: 本文提出的方法:To overcome these limitations, we introduce DiffusionHarmonizer, an online generative enhancement framework that transforms renderings from such imperfect scenes into temporally consistent outputs whi
Key Takeaway: However, while methods such as NeRF and 3D Gaussian Splatting can produce visually compelling results, they often exhibit artifacts particularly when rendering novel views, and fail to realistically integrate inserted dynamic objects, especially when they were captured from different scenes.
核心發現: 核心結果:However, while methods such as NeRF and 3D Gaussian Splatting can produce visually compelling results, they often exhibit artifacts particularly when rendering novel views, and fail to realistically i
Bandwidth-adaptive Cloud-Assisted 360-Degree 3D Perception for Autonomous Vehicles
Authors: Faisal Hawladera, Rui Meireles, Gamal Elghazaly et al. | Submitted: 2026-02-27 | arXiv: 2602.23871
Categories: cs.CV, cs.LG
Research Background: A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational resources can cause delay issues, particularly in complex urban settings.
研究背景: 在機器人學習領域,A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing req
Technical Approach: To address this, we propose leveraging Vehicle-to-Everything (V2X) communication to partially offload processing to the cloud, where compute resources are abundant, thus reducing overall latency. Our approach utilizes transformer-based models to fuse multi-camera sensor data into a comprehensive Bird’s-Eye View (BEV) representation, enabling accurate 360-degree 3D object detection. To adapt to fluctuating network conditions, we introduce a dynamic optimization algorithm that selects the split point and quantization level to maximize detection accuracy while satisfying real-time latency constraints.
技術方法: 本文提出的方法:To address this, we propose leveraging Vehicle-to-Everything (V2X) communication to partially offload processing to the cloud, where compute resources are abundant, thus reducing overall latency. Our
Key Takeaway: Trace-based evaluation under realistic bandwidth variability shows that this adaptive approach improves accuracy by up to 20 % over static parameterization with the same latency performance.
核心發現: 核心結果:Trace-based evaluation under realistic bandwidth variability shows that this adaptive approach improves accuracy by up to 20 % over static parameterization with the same latency performance.
Vision-Language Semantic Grounding for Multi-Domain Crop-Weed Segmentation
Authors: Nazia Hossain, Xintong Jiang, Yu Tian et al. | Submitted: 2026-02-27 | arXiv: 2602.23677
Categories: cs.CV
Research Background: Fine-grained crop-weed segmentation is essential for enabling targeted herbicide application in precision agriculture. However, existing deep learning models struggle to generalize across heterogeneous agricultural environments due to reliance on dataset-specific visual features.
研究背景: 在機器人學習領域,Fine-grained crop-weed segmentation is essential for enabling targeted herbicide application in precision agriculture. However, existing deep learning models struggle to generalize
Technical Approach: We propose Vision-Language Weed Segmentation (VL-WS), a novel framework that addresses this limitation by grounding pixel-level segmentation in semantically aligned, domain-invariant representations. Experimental results across four benchmark datasets demonstrate the effectiveness of our framework, with VL-WS achieving a mean Dice score of 91.64% and outperforming the CNN baseline by 4.98%.
技術方法: 本文提出的方法:We propose Vision-Language Weed Segmentation (VL-WS), a novel framework that addresses this limitation by grounding pixel-level segmentation in semantically aligned, domain-invariant representations.
Key Takeaway: The largest gains occur on the most challenging weed class, where VL-WS attains 80.45% Dice score compared to 65.03% for the best baseline, representing a 15.42% improvement.
核心發現: 核心結果:The largest gains occur on the most challenging weed class, where VL-WS attains 80.45% Dice score compared to 65.03% for the best baseline, representing a 15.42% improvement.
Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model
Authors: Zihang Wang, Xu Li, Benwu Wang et al. | Submitted: 2026-02-28 | arXiv: 2603.00694
Categories: cs.RO, cs.AI
Research Background: Explainability and transparent decision-making are essential for the safe deployment of autonomous driving systems. Scene captioning summarizes environmental conditions and risk factors in natural language, improving transparency, safety, and human—robot interaction.
研究背景: 在機器人學習領域,Explainability and transparent decision-making are essential for the safe deployment of autonomous driving systems. Scene captioning summarizes environmental conditions and risk fa
Technical Approach: To bridge this gap, we propose Wild-Drive, an efficient framework for off-road scene captioning and path planning.
技術方法: 本文提出的方法:To bridge this gap, we propose Wild-Drive, an efficient framework for off-road scene captioning and path planning.
Key Takeaway: Experiments on OR-C2P dataset and a self-collected dataset show that Wild-Drive outperforms prior LLM-based methods and remains more stable under degraded sensing.
核心發現: 核心結果:Experiments on OR-C2P dataset and a self-collected dataset show that Wild-Drive outperforms prior LLM-based methods and remains more stable under degraded sensing.
Validation of Space Robotics in Underwater Environments via Disturbance Robustness Equivalency
Authors: Joris Verhagen, Elias Krantz, Chelsea Sidrane et al. | Submitted: 2026-02-28 | arXiv: 2603.00628
Categories: cs.RO
Research Background: We present an experimental validation framework for space robotics that leverages underwater environments to approximate microgravity dynamics. While neutral buoyancy conditions make underwater robotics an excellent platform for space robotics validation, there are still dynamical and environmental differences that need to be overcome.
研究背景: 在機器人學習領域,We present an experimental validation framework for space robotics that leverages underwater environments to approximate microgravity dynamics. While neutral buoyancy conditions ma
Technical Approach: We present an experimental validation framework for space robotics that leverages underwater environments to approximate microgravity dynamics. We formulate the motion planning problem such that the original space mission and the validation mission achieve the same disturbance robustness degree.
技術方法: 本文提出的方法:We present an experimental validation framework for space robotics that leverages underwater environments to approximate microgravity dynamics. We formulate the motion planning problem such that the o
Key Takeaway: Our evaluation features a dual-experiment setup: an underwater robot operating under near-neutral buoyancy conditions to validate the planning and control strategy of either an experimental planar spacecraft platform or a CubeSat in a high-fidelity space dynamics simulator.
核心發現: 核心結果:Our evaluation features a dual-experiment setup: an underwater robot operating under near-neutral buoyancy conditions to validate the planning and control strategy of either an experimental planar spa
HydroShear: Hydroelastic Shear Simulation for Tactile Sim-to-Real Reinforcement Learning
Authors: An Dang, Jayjun Lee, Mustafa Mukadam et al. | Submitted: 2026-02-28 | arXiv: 2603.00446
Categories: cs.RO, cs.AI
Research Background: In this paper, we address the problem of tactile sim-to-real policy transfer for contact-rich tasks. Existing methods primarily focus on vision-based sensors and emphasize image rendering quality while providing overly simplistic models of force and shear.
研究背景: 在機器人學習領域,In this paper, we address the problem of tactile sim-to-real policy transfer for contact-rich tasks. Existing methods primarily focus on vision-based sensors and emphasize image re
Technical Approach: In this paper, we address the problem of tactile sim-to-real policy transfer for contact-rich tasks. Here, we present HydroShear, a non-holonomic hydroelastic tactile simulator that advances the state-of-the-art by modeling: a) stick-slip transitions, b) path-dependent force and shear build up, and c) full SE(3) object-sensor interactions. Our approach generates physics-based, computationally efficient force fields from arbitrary watertight geometries while remaining agnostic to the underlying physics engine.
技術方法: 本文提出的方法:In this paper, we address the problem of tactile sim-to-real policy transfer for contact-rich tasks. Here, we present HydroShear, a non-holonomic hydroelastic tactile simulator that advances the state
Key Takeaway: Our method achieves a 93% average success rate, outperforming policies trained on tactile images (34%) and alternative shear simulation methods (58%-61%).
核心發現: 核心結果:Our method achieves a 93% average success rate, outperforming policies trained on tactile images (34%) and alternative shear simulation methods (58%-61%).
ReMoT: Reinforcement Learning with Motion Contrast Triplets
Authors: Cong Wan, Zeyu Guo, Jiangyang Li et al. | Submitted: 2026-02-28 | arXiv: 2603.00461
Categories: cs.CV
Research Background: We present ReMoT, a unified training paradigm to systematically address the fundamental shortcomings of VLMs in spatio-temporal consistency — a critical failure point in navigation, robotics, and autonomous driving. ReMoT integrates two core components: (1) A rule-based automatic framework that generates ReMoT-16K, a large-scale (16.5K triplets) motion-contrast dataset derived from video meta-annotations, surpassing costly manual or model-based generation.
研究背景: 在機器人學習領域,We present ReMoT, a unified training paradigm to systematically address the fundamental shortcomings of VLMs in spatio-temporal consistency — a critical failure point in navigatio
Technical Approach: We present ReMoT, a unified training paradigm to systematically address the fundamental shortcomings of VLMs in spatio-temporal consistency — a critical failure point in navigation, robotics, and autonomous driving.
技術方法: 本文提出的方法:We present ReMoT, a unified training paradigm to systematically address the fundamental shortcomings of VLMs in spatio-temporal consistency — a critical failure point in navigation, robotics, and aut
Key Takeaway: The resulting model achieves state-of-the-art performance on our new benchmark and multiple standard VLM benchmarks, culminating in a remarkable 25.1% performance leap on spatio-temporal reasoning tasks.
核心發現: 核心結果:The resulting model achieves state-of-the-art performance on our new benchmark and multiple standard VLM benchmarks, culminating in a remarkable 25.1% performance leap on spatio-temporal reasoning tas
PointAlign: Feature-Level Alignment Regularization for 3D Vision-Language Models
Authors: Yuanhao Su, Shaofeng Zhang, Xiaosong Jia et al. | Submitted: 2026-02-28 | arXiv: 2603.00412
Categories: cs.CV
Research Background: The development of 3D Vision-Language Models (VLMs), crucial for applications in robotics, autonomous driving, and augmented reality, is severely constrained by the scarcity of paired 3D-text data. Existing methods rely solely on next-token prediction loss, using only language tokens for supervision.
研究背景: 在機器人學習領域,The development of 3D Vision-Language Models (VLMs), crucial for applications in robotics, autonomous driving, and augmented reality, is severely constrained by the scarcity of pai
Technical Approach: To address these limitations, we propose {\mname}, a novel feature-level alignment regularization method. {\mname} explicitly supervises intermediate point cloud tokens to preserve fine-grained 3D geometric-semantic information throughout the language modeling process. Extensive experiments on ModelNet40 and Objaverse datasets demonstrate that our method achieves \textbf{2.08} pp improvement on average for classification tasks, with a substantial \textbf{7.50} pp gain on the challenging open-vocabulary Objaverse classification task and \textbf{4.88} pp improvement on 3D object captioning evaluated by Qwen2-72B-Instruct, validating the effectiveness of {\mname}.
技術方法: 本文提出的方法:To address these limitations, we propose {\mname}, a novel feature-level alignment regularization method. {\mname} explicitly supervises intermediate point cloud tokens to preserve fine-grained 3D geo
Key Takeaway: Extensive experiments on ModelNet40 and Objaverse datasets demonstrate that our method achieves \textbf{2.08} pp improvement on average for classification tasks, with a substantial \textbf{7.50} pp gain on the challenging open-vocabulary Objaverse classification task and \textbf{4.88} pp improvement on 3D object captioning evaluated by Qwen2-72B-Instruct, validating the effectiveness of {\mname}.
核心發現: 核心結果:Extensive experiments on ModelNet40 and Objaverse datasets demonstrate that our method achieves \textbf{2.08} pp improvement on average for classification tasks, with a substantial \textbf{7.50} pp ga
Integrating LTL Constraints into PPO for Safe Reinforcement Learning
Authors: Maifang Zhang, Hang Yu, Qian Zuo et al. | Submitted: 2026-03-01 | arXiv: 2603.01292
Categories: cs.LG, cs.AI, cs.LO, cs.RO
Research Background: This paper proposes Proximal Policy Optimization with Linear Temporal Logic Constraints (PPO-LTL), a framework that integrates safety constraints written in LTL into PPO for safe reinforcement learning. LTL constraints offer rigorous representations of complex safety requirements, such as regulations that broadly exist in robotics, enabling systematic monitoring of safety requirements.
研究背景: 在機器人學習領域,This paper proposes Proximal Policy Optimization with Linear Temporal Logic Constraints (PPO-LTL), a framework that integrates safety constraints written in LTL into PPO for safe r
Technical Approach: This paper proposes Proximal Policy Optimization with Linear Temporal Logic Constraints (PPO-LTL), a framework that integrates safety constraints written in LTL into PPO for safe reinforcement learning.
技術方法: 本文提出的方法:This paper proposes Proximal Policy Optimization with Linear Temporal Logic Constraints (PPO-LTL), a framework that integrates safety constraints written in LTL into PPO for safe reinforcement learnin
Key Takeaway: Extensive experiments on the Zones and CARLA environments show that our PPO-LTL can consistently reduce safety violations, while maintaining competitive performance, against the state-of-the-art methods.
核心發現: 核心結果:Extensive experiments on the Zones and CARLA environments show that our PPO-LTL can consistently reduce safety violations, while maintaining competitive performance, against the state-of-the-art metho
Information-Theoretic Framework for Self-Adapting Model Predictive Controllers
Authors: Wael Hafez, Amir Nazeri | Submitted: 2026-03-01 | arXiv: 2603.01286
Categories: cs.AI, cs.RO
Research Background: Model Predictive Control (MPC) is a vital technique for autonomous systems, like Unmanned Aerial Vehicles (UAVs), enabling optimized motion planning. However, traditional MPC struggles to adapt to real-time changes such as dynamic obstacles and shifting system dynamics, lacking inherent mechanisms for self-monitoring and adaptive optimization.
研究背景: 在機器人學習領域,Model Predictive Control (MPC) is a vital technique for autonomous systems, like Unmanned Aerial Vehicles (UAVs), enabling optimized motion planning. However, traditional MPC strug
Technical Approach: Here, we introduce Entanglement Learning (EL), an information-theoretic framework that enhances MPC adaptability through an Information Digital Twin (IDT).
技術方法: 本文提出的方法:Here, we introduce Entanglement Learning (EL), an information-theoretic framework that enhances MPC adaptability through an Information Digital Twin (IDT).
Key Takeaway: Scalable and leveraging existing infrastructure, this framework improves MPC reliability and robustness across diverse scenarios, extending beyond UAV control to any MPC implementation requiring adaptive performance.
核心發現: 核心結果:Scalable and leveraging existing infrastructure, this framework improves MPC reliability and robustness across diverse scenarios, extending beyond UAV control to any MPC implementation requiring adapt
Certifiable Factor Graph Optimization
Authors: Zhexin Xu, Nikolas R. Sanderson, Hanna Jiamei Zhang et al. | Submitted: 2026-03-01 | arXiv: 2603.01267
Categories: cs.RO, cs.CV
Research Background: We show that the factor graph and certifiable estimation paradigms, which have thus far been treated as essentially independent in the literature, can be naturally synthesized into a unified framework for certifiable factor graph optimization that combines the ease of use of the former with the strong performance guarantees of the latter. The key insight enabling our synthesis is that the core mathematical constructions used to develop certifiable estimators (Shor’s relaxation and Burer-Monteiro factorization) inherit a factor graph structure from the original problem: applying these transformations to a QCQP-representable estimation task with an associated factor graph model yields a lifted problem with identical factor graph connectivity whose constituent variables and factors are simple one-to-one algebraic transformations (lifts) of those appearing in the original QCQP’s factor graph.
研究背景: 在機器人學習領域,We show that the factor graph and certifiable estimation paradigms, which have thus far been treated as essentially independent in the literature, can be naturally synthesized into
Technical Approach: The key insight enabling our synthesis is that the core mathematical constructions used to develop certifiable estimators (Shor’s relaxation and Burer-Monteiro factorization) inherit a factor graph structure from the original problem: applying these transformations to a QCQP-representable estimation task with an associated factor graph model yields a lifted problem with identical factor graph connectivity whose constituent variables and factors are simple one-to-one algebraic transformations (lifts) of those appearing in the original QCQP’s factor graph. This correspondence enables the Riemannian Staircase methodology for certifiable estimation to be easily instantiated and deployed using the same mature, highly-performant factor graph libraries and workflows already ubiquitously employed throughout robotics and computer vision.
技術方法: 本文提出的方法:The key insight enabling our synthesis is that the core mathematical constructions used to develop certifiable estimators (Shor’s relaxation and Burer-Monteiro factorization) inherit a factor graph st
Key Takeaway: Experimental evaluation on a variety of pose graph optimization, landmark SLAM, and range-aided SLAM benchmarks demonstrates that our certifiable factor graph optimization methodology enables the implementation of certifiable estimators that are functionally equivalent to current state-of-the-art hand-designed, problem-specific methods, while dramatically reducing the required implementation effort from the order of months to hours.
核心發現: 核心結果:Experimental evaluation on a variety of pose graph optimization, landmark SLAM, and range-aided SLAM benchmarks demonstrates that our certifiable factor graph optimization methodology enables the impl
riMESA: Consensus ADMM for Real-World Collaborative SLAM
Authors: Daniel McGann, Michael Kaess | Submitted: 2026-03-01 | arXiv: 2603.01178
Categories: cs.RO
Research Background: Collaborative Simultaneous Localization and Mapping (C-SLAM) is a fundamental capability for multi-robot teams as it enables downstream tasks like planning and navigation. However, existing C-SLAM back-end algorithms that are required to solve this problem struggle to address the practical realities of real-world deployments (i.e. communication limitations, outlier measurements, and online operation).
研究背景: 在機器人學習領域,Collaborative Simultaneous Localization and Mapping (C-SLAM) is a fundamental capability for multi-robot teams as it enables downstream tasks like planning and navigation. However,
Technical Approach: In this paper we propose Robust Incremental Manifold Edge-based Separable ADMM (riMESA) — a robust, incremental, and distributed C-SLAM back-end that is resilient to outliers, reliable in the face of limited communication, and can compute accurate state estimates for a multi-robot team in real-time.
技術方法: 本文提出的方法:In this paper we propose Robust Incremental Manifold Edge-based Separable ADMM (riMESA) — a robust, incremental, and distributed C-SLAM back-end that is resilient to outliers, reliable in the face of
Key Takeaway: These experiments demonstrate that riMESA is able to generalize across conditions, produce accurate state estimates, operate in real-time, and outperform the accuracy of prior works by a factor >7x on real-world datasets.
核心發現: 核心結果:These experiments demonstrate that riMESA is able to generalize across conditions, produce accurate state estimates, operate in real-time, and outperform the accuracy of prior works by a factor >7x on
Path Integral Particle Filtering for Hybrid Systems via Saltation Matrices
Authors: Karthik Shaji, Sreeranj Jayadevan, Bo Yuan et al. | Submitted: 2026-03-01 | arXiv: 2603.01176
Categories: cs.RO
Research Background: State estimation for hybrid systems that undergo intermittent contact with their environments, such as extraplanetary robots and satellites undergoing docking operations, is difficult due to the discrete uncertainty propagation during contact. To handle this propagation, this paper presents an optimal-control-based particle filtering method that leverages saltation matrices to map out uncertainty propagation during contact events.
研究背景: 在機器人學習領域,State estimation for hybrid systems that undergo intermittent contact with their environments, such as extraplanetary robots and satellites undergoing docking operations, is diffic
Technical Approach: To handle this propagation, this paper presents an optimal-control-based particle filtering method that leverages saltation matrices to map out uncertainty propagation during contact events. To evaluate the validity and consistency of the proposed approach, this paper tests it against strong baselines on the stochastic dynamics generated by a bouncing ball and spring loaded inverted pendulum.
技術方法: 本文提出的方法:To handle this propagation, this paper presents an optimal-control-based particle filtering method that leverages saltation matrices to map out uncertainty propagation during contact events. To evalua
Key Takeaway: To evaluate the validity and consistency of the proposed approach, this paper tests it against strong baselines on the stochastic dynamics generated by a bouncing ball and spring loaded inverted pendulum.
核心發現: 核心結果:To evaluate the validity and consistency of the proposed approach, this paper tests it against strong baselines on the stochastic dynamics generated by a bouncing ball and spring loaded inverted pendu
D-REX: Differentiable Real-to-Sim-to-Real Engine for Learning Dexterous Grasping
Authors: Haozhe Lou, Mingtong Zhang, Haoran Geng et al. | Submitted: 2026-03-01 | arXiv: 2603.01151
Categories: cs.RO, cs.CV, cs.GR
Research Background: Simulation provides a cost-effective and flexible platform for data generation and policy learning to develop robotic systems. However, bridging the gap between simulation and real-world dynamics remains a significant challenge, especially in physical parameter identification.
研究背景: 在機器人學習領域,Simulation provides a cost-effective and flexible platform for data generation and policy learning to develop robotic systems. However, bridging the gap between simulation and real
Technical Approach: In this work, we introduce a real-to-sim-to-real engine that leverages the Gaussian Splat representations to build a differentiable engine, enabling object mass identification from real-world visual observations and robot control signals, while enabling grasping policy learning simultaneously. Through optimizing the mass of the manipulated object, our method automatically builds high-fidelity and physically plausible digital twins. Additionally, we propose a novel approach to train force-aware grasping policies from limited data by transferring feasible human demonstrations into simulated robot demonstrations.
技術方法: 本文提出的方法:In this work, we introduce a real-to-sim-to-real engine that leverages the Gaussian Splat representations to build a differentiable engine, enabling object mass identification from real-world visual o
Key Takeaway: Through comprehensive experiments, we demonstrate that our engine achieves accurate and robust performance in mass identification across various object geometries and mass values.
核心發現: 核心結果:Through comprehensive experiments, we demonstrate that our engine achieves accurate and robust performance in mass identification across various object geometries and mass values.
An Open-Source Modular Benchmark for Diffusion-Based Motion Planning in Closed-Loop Autonomous Driving
Authors: Yun Li, Simon Thompson, Yidu Zhang et al. | Submitted: 2026-03-01 | arXiv: 2603.01023
Categories: cs.RO, cs.AI
Research Background: Diffusion-based motion planners have achieved state-of-the-art results on benchmarks such as nuPlan, yet their evaluation within closed-loop production autonomous driving stacks remains largely unexplored. Existing evaluations abstract away ROS 2 communication latency and real-time scheduling constraints, while monolithic ONNX deployment freezes all solver parameters at export time.
研究背景: 在機器人學習領域,Diffusion-based motion planners have achieved state-of-the-art results on benchmarks such as nuPlan, yet their evaluation within closed-loop production autonomous driving stacks re
Technical Approach: We present an open-source modular benchmark that addresses both gaps: using ONNX GraphSurgeon, we decompose a monolithic 18,398 node diffusion planner into three independently executable modules and reimplement the DPM-Solver++ denoising loop in native C++.
技術方法: 本文提出的方法:We present an open-source modular benchmark that addresses both gaps: using ONNX GraphSurgeon, we decompose a monolithic 18,398 node diffusion planner into three independently executable modules and r
Key Takeaway: Through systematic comparison of DPM-Solver++ (first- and second-order) and DDIM across six step-count configurations (N in {3, 5, 7, 10, 15, 20}), we show that encoder caching yields a 3.2x latency reduction, and that second-order solving reduces FDE by 41% at N=3 compared to first-order.
核心發現: 核心結果:Through systematic comparison of DPM-Solver++ (first- and second-order) and DDIM across six step-count configurations (N in {3, 5, 7, 10, 15, 20}), we show that encoder caching yields a 3.2x latency r
MiniUGV: A Compact UAV-Deployable Tracked Ground Vehicle with Manipulation Capabilities
Authors: Durgakant Pushp, Swapnil Kalhapure, Shaekh Mohammad Shithil et al. | Submitted: 2026-03-01 | arXiv: 2603.00972
Categories: cs.RO
Research Background: Exploring and inspecting \emph{Hidden Spaces}, defined as environments whose entrances are accessible only to aerial robots but remain unexplored due to geometric constraints, limited flight time, and communication loss, remains a major challenge. We present miniUGV, a compact UAV-deployable tracked ground vehicle that extends UAV capabilities into confined environments.
研究背景: 在機器人學習領域,Exploring and inspecting \emph{Hidden Spaces}, defined as environments whose entrances are accessible only to aerial robots but remain unexplored due to geometric constraints, limi
Technical Approach: We present miniUGV, a compact UAV-deployable tracked ground vehicle that extends UAV capabilities into confined environments.
技術方法: 本文提出的方法:We present miniUGV, a compact UAV-deployable tracked ground vehicle that extends UAV capabilities into confined environments.
Key Takeaway: Experiments demonstrate robust terrain navigation, self-righting, and manipulation of objects up to 3.5 kg, validating miniUGV as a versatile platform for hybrid aerial-ground robotics.
核心發現: 核心結果:Experiments demonstrate robust terrain navigation, self-righting, and manipulation of objects up to 3.5 kg, validating miniUGV as a versatile platform for hybrid aerial-ground robotics.
HierKick: Hierarchical Reinforcement Learning for Vision-Guided Soccer Robot Control
Authors: Yizhi Chen, Zheng Zhang, Zhanxiang Cao et al. | Submitted: 2026-03-01 | arXiv: 2603.00948
Categories: cs.RO
Research Background: Controlling soccer robots involves multi-time-scale decision-making, which requires balancing long-term tactical planning and short-term motion execution. Traditional end-to-end reinforcement learning (RL) methods face challenges in complex dynamic environments.
研究背景: 在機器人學習領域,Controlling soccer robots involves multi-time-scale decision-making, which requires balancing long-term tactical planning and short-term motion execution. Traditional end-to-end re
Technical Approach: This paper proposes HierKick, a vision-guided soccer robot control framework based on dual-frequency hierarchical RL.
技術方法: 本文提出的方法:This paper proposes HierKick, a vision-guided soccer robot control framework based on dual-frequency hierarchical RL.
Key Takeaway: Experimental results show that the success rates of this framework are 95.2% in IsaacGym, 89.8% in Mujoco, and 80% in the real world.
核心發現: 核心結果:Experimental results show that the success rates of this framework are 95.2% in IsaacGym, 89.8% in Mujoco, and 80% in the real world.
DRIFT: Diffusion-based Rule-Inferred For Trajectories
Authors: Jinyang Zhao, Handong Zheng, Yanjiu Zhong et al. | Submitted: 2026-03-01 | arXiv: 2603.00936
Categories: cs.RO
Research Background: Trajectory generation for mobile robots in unstructured environments faces a critical dilemma: balancing kinematic smoothness for safe execution with terminal precision for fine-grained tasks. Existing generative planners often struggle with this trade-off, yielding either smooth but imprecise paths or geometrically accurate but erratic motions.
研究背景: 在機器人學習領域,Trajectory generation for mobile robots in unstructured environments faces a critical dilemma: balancing kinematic smoothness for safe execution with terminal precision for fine-gr
Technical Approach: Existing generative planners often struggle with this trade-off, yielding either smooth but imprecise paths or geometrically accurate but erratic motions. To address the aforementioned shortcomings, this article proposes DRIFT (Diffusion-based Rule-Inferred for Trajectories), a conditional diffusion framework designed to generate high-fidelity reference trajectories by integrating two complementary inductive biases. First, a Relational Inductive Bias, realized via a GNN-based Structured Scene Perception (SSP) module, encodes global topological constraints to ensure holistic smoothness.
技術方法: 本文提出的方法:Existing generative planners often struggle with this trade-off, yielding either smooth but imprecise paths or geometrically accurate but erratic motions. To address the aforementioned shortcomings, t
Key Takeaway: In the end, quantitative results demonstrate that DRIFT reconciles these conflicting objectives, achieving centimeter-level imitation fidelity (0.041m FDE) and competitive smoothness (27.19 Jerk).
核心發現: 核心結果:In the end, quantitative results demonstrate that DRIFT reconciles these conflicting objectives, achieving centimeter-level imitation fidelity (0.041m FDE) and competitive smoothness (27.19 Jerk).
DriveCode: Domain Specific Numerical Encoding for LLM-Based Autonomous Driving
Authors: Zhiye Wang, Yanbo Jiang, Rui Zhou et al. | Submitted: 2026-03-01 | arXiv: 2603.00919
Categories: cs.CV, cs.RO
Research Background: Large language models (LLMs) have shown great promise for autonomous driving. However, discretizing numbers into tokens limits precise numerical reasoning, fails to reflect the positional significance of digits in the training objective, and makes it difficult to achieve both decoding efficiency and numerical precision.
研究背景: 在機器人學習領域,Large language models (LLMs) have shown great promise for autonomous driving. However, discretizing numbers into tokens limits precise numerical reasoning, fails to reflect the pos
Technical Approach: In this paper, we introduce DriveCode, a novel numerical encoding method that represents numbers as dedicated embeddings rather than discrete text tokens.
技術方法: 本文提出的方法:In this paper, we introduce DriveCode, a novel numerical encoding method that represents numbers as dedicated embeddings rather than discrete text tokens.
Key Takeaway: Evaluated on OmniDrive, DriveGPT4, and DriveGPT4-V2 datasets, DriveCode demonstrates superior performance in trajectory prediction and control signal generation, confirming its effectiveness for LLM-based autonomous driving systems.
核心發現: 核心結果:Evaluated on OmniDrive, DriveGPT4, and DriveGPT4-V2 datasets, DriveCode demonstrates superior performance in trajectory prediction and control signal generation, confirming its effectiveness for LLM-b
Hippo: High-performance Interior-Point and Projection-based Solver for Generic Constrained Trajectory Optimization
Authors: Haizhou Zhao, Ludovic Righetti, Majid Khadiv | Submitted: 2026-03-01 | arXiv: 2603.00871
Categories: cs.RO
Research Background: Trajectory optimization is the core of modern model-based robotic control and motion planning. Existing trajectory optimizers, based on sequential quadratic programming (SQP) or differential dynamic programming (DDP), are often limited by their slow computation efficiency, low modeling flexibility, and poor convergence for complex tasks requiring hard constraints.
研究背景: 在機器人學習領域,Trajectory optimization is the core of modern model-based robotic control and motion planning. Existing trajectory optimizers, based on sequential quadratic programming (SQP) or di
Technical Approach: In this paper, we introduce Hippo, a solver that can handle inequality constraints using the interior-point method (IPM) with an adaptive barrier update strategy and hard equality constraints via projection or IPM.
技術方法: 本文提出的方法:In this paper, we introduce Hippo, a solver that can handle inequality constraints using the interior-point method (IPM) with an adaptive barrier update strategy and hard equality constraints via proj
Key Takeaway: Through extensive numerical benchmarks, we show that Hippo is a robust and efficient alternative to existing state-of-the-art solvers for difficult robotic trajectory optimization problems requiring high-quality solutions, such as locomotion and manipulation.
核心發現: 核心結果:Through extensive numerical benchmarks, we show that Hippo is a robust and efficient alternative to existing state-of-the-art solvers for difficult robotic trajectory optimization problems requiring h
PhysMem: Scaling Test-Time Memory for Embodied Physical Reasoning
Authors: Haoyang Li, Yang You, Hao Su et al. | Submitted: 2026-02-23 | arXiv: 2602.20323
Categories: cs.RO, cs.AI
Research Background: Reliable object manipulation requires understanding physical properties that vary across objects and environments. Vision-language model (VLM) planners can reason about friction and stability in general terms; however, they often cannot predict how a specific ball will roll on a particular surface or which stone will provide a stable foundation without direct experience.
研究背景: 在機器人學習領域,Reliable object manipulation requires understanding physical properties that vary across objects and environments. Vision-language model (VLM) planners can reason about friction an
Technical Approach: We present PhysMem, a memory framework that enables VLM robot planners to learn physical principles from interaction at test time, without updating model parameters.
技術方法: 本文提出的方法:We present PhysMem, a memory framework that enables VLM robot planners to learn physical principles from interaction at test time, without updating model parameters.
Key Takeaway: On a controlled brick insertion task, principled abstraction achieves 76% success compared to 23% for direct experience retrieval, and real-world experiments show consistent improvement over 30-minute deployment sessions.
核心發現: 核心結果:On a controlled brick insertion task, principled abstraction achieves 76% success compared to 23% for direct experience retrieval, and real-world experiments show consistent improvement over 30-minute
Smoothly Differentiable and Efficiently Vectorizable Contact Manifold Generation
Authors: Onur Beker, Andreas René Geist, Anselm Paulus et al. | Submitted: 2026-02-23 | arXiv: 2602.20304
Categories: cs.RO
Research Background: Simulating rigid-body dynamics with contact in a fast, massively vectorizable, and smoothly differentiable manner is highly desirable in robotics. An important bottleneck faced by existing differentiable simulation frameworks is contact manifold generation: representing the volume of intersection between two colliding geometries via a discrete set of properly distributed contact points.
研究背景: 在機器人學習領域,Simulating rigid-body dynamics with contact in a fast, massively vectorizable, and smoothly differentiable manner is highly desirable in robotics. An important bottleneck faced by
Technical Approach: Concretely, we propose: i) a representative set of smooth analytical signed distance primitives to implement vertex-face collisions, and ii) a novel differentiable edge-edge collision routine that can provide signed distances and signed contact normals.
技術方法: 本文提出的方法:Concretely, we propose: i) a representative set of smooth analytical signed distance primitives to implement vertex-face collisions, and ii) a novel differentiable edge-edge collision routine that can
Key Takeaway: The proposed framework is evaluated via a set of didactic experiments and benchmarked against the collision detection routine of the well-established Mujoco XLA framework, where we observe a significant speedup.
核心發現: 核心結果:The proposed framework is evaluated via a set of didactic experiments and benchmarked against the collision detection routine of the well-established Mujoco XLA framework, where we observe a significa
NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planning
Authors: Jiahui Fu, Junyu Nan, Lingfeng Sun et al. | Submitted: 2026-02-23 | arXiv: 2602.20119
Categories: cs.RO, cs.AI, cs.CV
Research Background: Solving long-horizon tasks requires robots to integrate high-level semantic reasoning with low-level physical interaction. While vision-language models (VLMs) and video generation models can decompose tasks and imagine outcomes, they often lack the physical grounding necessary for real-world execution.
研究背景: 在機器人學習領域,Solving long-horizon tasks requires robots to integrate high-level semantic reasoning with low-level physical interaction. While vision-language models (VLMs) and video generation
Technical Approach: We introduce NovaPlan, a hierarchical framework that unifies closed-loop VLM and video planning with geometrically grounded robot execution for zero-shot long-horizon manipulation.
技術方法: 本文提出的方法:We introduce NovaPlan, a hierarchical framework that unifies closed-loop VLM and video planning with geometrically grounded robot execution for zero-shot long-horizon manipulation.
Key Takeaway: Our results show that NovaPlan can perform complex assembly tasks and exhibit dexterous error recovery behaviors without any prior demonstrations or training.
核心發現: 核心結果:Our results show that NovaPlan can perform complex assembly tasks and exhibit dexterous error recovery behaviors without any prior demonstrations or training.
To Move or Not to Move: Constraint-based Planning Enables Zero-Shot Generalization for Interactive Navigation
Authors: Apoorva Vashisth, Manav Kulshrestha, Pranav Bakshi et al. | Submitted: 2026-02-23 | arXiv: 2602.20055
Categories: cs.RO, cs.AI, cs.CV
Research Background: Visual navigation typically assumes the existence of at least one obstacle-free path between start and goal, which must be discovered/planned by the robot. However, in real-world scenarios, such as home environments and warehouses, clutter can block all routes.
研究背景: 在機器人學習領域,Visual navigation typically assumes the existence of at least one obstacle-free path between start and goal, which must be discovered/planned by the robot. However, in real-world s
Technical Approach: Targeted at such cases, we introduce the Lifelong Interactive Navigation problem, where a mobile robot with manipulation abilities can move clutter to forge its own path to complete sequential object- placement tasks - each involving placing an given object (eg. To address this lifelong setting - where effects of environment changes accumulate and have long-term effects - we propose an LLM-driven, constraint-based planning framework with active perception. Our framework allows the LLM to reason over a structured scene graph of discovered objects and obstacles, deciding which object to move, where to place it, and where to look next to discover task-relevant information.
技術方法: 本文提出的方法:Targeted at such cases, we introduce the Lifelong Interactive Navigation problem, where a mobile robot with manipulation abilities can move clutter to forge its own path to complete sequential object-
Key Takeaway: We further demonstrate our approach qualitatively on real-world hardware.
核心發現: 核心結果:We further demonstrate our approach qualitatively on real-world hardware.
Hydrodynamic Performance Enhancement of Unmanned Underwater Gliders with Soft Robotic Morphing Wings for Agility Improvement
Authors: A. Giordano, G. De Meurichy, V. Telazzi et al. | Submitted: 2026-02-23 | arXiv: 2602.20054
Categories: cs.RO
Research Background: This work assesses the hydrodynamic efficiency of Underwater Unmanned Vehicles (UUVs) equipped with soft morphing wings compared to conventional rigid wings. Unlike rigid wings, deformable counterparts can alter their aerodynamic properties on demand.
研究背景: 在機器人學習領域,This work assesses the hydrodynamic efficiency of Underwater Unmanned Vehicles (UUVs) equipped with soft morphing wings compared to conventional rigid wings. Unlike rigid wings, de
Technical Approach: Unlike rigid wings, deformable counterparts can alter their aerodynamic properties on demand. Improvements in hydrodynamic efficiency extend a UUV’s operational range and may determine mission feasibility. Structural and Computational Fluid Dynamics (CFD) simulations were conducted for both a soft morphing wing and a UUV incorporating it.
技術方法: 本文提出的方法:Unlike rigid wings, deformable counterparts can alter their aerodynamic properties on demand. Improvements in hydrodynamic efficiency extend a UUV’s operational range and may determine mission feasibi
Key Takeaway: The results show that a UUV employing soft wings achieves 9.75 percent higher overall efficiency than an equivalent vehicle with traditional rigid wings.
核心發現: 核心結果:The results show that a UUV employing soft wings achieves 9.75 percent higher overall efficiency than an equivalent vehicle with traditional rigid wings.
EEG-Driven Intention Decoding: Offline Deep Learning Benchmarking on a Robotic Rover
Authors: Ghadah Alosaimi, Maha Alsayyari, Yixin Sun et al. | Submitted: 2026-02-23 | arXiv: 2602.20041
Categories: cs.RO, cs.CV
Research Background: Brain-computer interfaces (BCIs) provide a hands-free control modality for mobile robotics, yet decoding user intent during real-world navigation remains challenging. This work presents a brain-robot control framework for offline decoding of driving commands during robotic rover operation.
研究背景: 在機器人學習領域,Brain-computer interfaces (BCIs) provide a hands-free control modality for mobile robotics, yet decoding user intent during real-world navigation remains challenging. This work pre
Technical Approach: This work presents a brain-robot control framework for offline decoding of driving commands during robotic rover operation. A 4WD Rover Pro platform was remotely operated by 12 participants who navigated a predefined route using a joystick, executing the commands forward, reverse, left, right, and stop. Electroencephalogram (EEG) signals were recorded with a 16-channel OpenBCI cap and aligned with motor actions at Delta = 0 ms and future prediction horizons (Delta > 0 ms).
技術方法: 本文提出的方法:This work presents a brain-robot control framework for offline decoding of driving commands during robotic rover operation. A 4WD Rover Pro platform was remotely operated by 12 participants who naviga
Key Takeaway: ShallowConvNet achieved the highest performance for both action prediction and intent prediction.
核心發現: 核心結果:ShallowConvNet achieved the highest performance for both action prediction and intent prediction.
Contextual Safety Reasoning and Grounding for Open-World Robots
Authors: Zachary Ravichandran, David Snyder, Alexander Robey et al. | Submitted: 2026-02-23 | arXiv: 2602.19983
Categories: cs.RO, cs.AI
Research Background: Robots are increasingly operating in open-world environments where safe behavior depends on context: the same hallway may require different navigation strategies when crowded versus empty, or during an emergency versus normal operations. Traditional safety approaches enforce fixed constraints in user-specified contexts, limiting their ability to handle the open-ended contextual variability of real-world deployment.
研究背景: 在機器人學習領域,Robots are increasingly operating in open-world environments where safe behavior depends on context: the same hallway may require different navigation strategies when crowded versu
Technical Approach: Traditional safety approaches enforce fixed constraints in user-specified contexts, limiting their ability to handle the open-ended contextual variability of real-world deployment. We address this gap via CORE, a safety framework that enables online contextual reasoning, grounding, and enforcement without prior knowledge of the environment (e.g., maps or safety specifications). CORE uses a vision-language model (VLM) to continuously reason about context-dependent safety rules directly from visual observations, grounds these rules in the physical environment, and enforces the resulting spatially-defined safe sets via control barrier functions.
技術方法: 本文提出的方法:Traditional safety approaches enforce fixed constraints in user-specified contexts, limiting their ability to handle the open-ended contextual variability of real-world deployment. We address this gap
Key Takeaway: We provide probabilistic safety guarantees for CORE that account for perceptual uncertainty, and we demonstrate through simulation and real-world experiments that CORE enforces contextually appropriate behavior in unseen environments, significantly outperforming prior semantic safety methods that lack online contextual reasoning.
核心發現: 核心結果:We provide probabilistic safety guarantees for CORE that account for perceptual uncertainty, and we demonstrate through simulation and real-world experiments that CORE enforces contextually appropriat
Scaling Law of Neural Koopman Operators
Authors: Abulikemu Abuduweili, Yuyang Pang, Feihan Li et al. | Submitted: 2026-02-23 | arXiv: 2602.19943
Categories: cs.RO
Research Background: Data-driven neural Koopman operator theory has emerged as a powerful tool for linearizing and controlling nonlinear robotic systems. However, the performance of these data-driven models fundamentally depends on the trade-off between sample size and model dimensions, a relationship for which the scaling laws have remained unclear.
研究背景: 在機器人學習領域,Data-driven neural Koopman operator theory has emerged as a powerful tool for linearizing and controlling nonlinear robotic systems. However, the performance of these data-driven m
Technical Approach: This paper establishes a rigorous framework to address this challenge by deriving and empirically validating scaling laws that connect sample size, latent space dimension, and downstream control quality. Based on the theoretical results, we introduce two lightweight regularizers for the neural Koopman operator: a covariance loss to help stabilize the learned latent features and an inverse control loss to ensure the model aligns with physical actuation.
技術方法: 本文提出的方法:This paper establishes a rigorous framework to address this challenge by deriving and empirically validating scaling laws that connect sample size, latent space dimension, and downstream control quali
Key Takeaway: Together, our results provide a simple recipe for allocating effort between data collection and model capacity when learning Koopman dynamics for control.
核心發現: 核心結果:Together, our results provide a simple recipe for allocating effort between data collection and model capacity when learning Koopman dynamics for control.
Towards Dexterous Embodied Manipulation via Deep Multi-Sensory Fusion and Sparse Expert Scaling
Authors: Yirui Sun, Guangyu Zhuge, Keliang Liu et al. | Submitted: 2026-02-23 | arXiv: 2602.19764
Categories: cs.RO
Research Background: Realizing dexterous embodied manipulation necessitates the deep integration of heterogeneous multimodal sensory inputs. However, current vision-centric paradigms often overlook the critical force and geometric feedback essential for complex tasks.
研究背景: 在機器人學習領域,Realizing dexterous embodied manipulation necessitates the deep integration of heterogeneous multimodal sensory inputs. However, current vision-centric paradigms often overlook the
Technical Approach: This paper presents DeMUSE, a Deep Multimodal Unified Sparse Experts framework leveraging a Diffusion Transformer to integrate RGB, depth, and 6-axis force into a unified serialized stream.
技術方法: 本文提出的方法:This paper presents DeMUSE, a Deep Multimodal Unified Sparse Experts framework leveraging a Diffusion Transformer to integrate RGB, depth, and 6-axis force into a unified serialized stream.
Key Takeaway: Achieving success rates of 83.2% and 72.5% in simulation and real-world trials, DeMUSE demonstrates state-of-the-art performance, validating the necessity of deep multi-sensory integration for complex physical interactions.
核心發現: 核心結果:Achieving success rates of 83.2% and 72.5% in simulation and real-world trials, DeMUSE demonstrates state-of-the-art performance, validating the necessity of deep multi-sensory integration for complex
Scalable Low-Density Distributed Manipulation Using an Interconnected Actuator Array
Authors: Bailey Dacre, Rodrigo Moreno, Jørn Lambertsen et al. | Submitted: 2026-02-23 | arXiv: 2602.19653
Categories: cs.RO
Research Background: Distributed Manipulator Systems, composed of arrays of robotic actuators necessitate dense actuator arrays to effectively manipulate small objects. This paper presents a system composed of modular 3-DoF robotic tiles interconnected by a compliant surface layer, forming a continuous, controllable manipulation surface.
研究背景: 在機器人學習領域,Distributed Manipulator Systems, composed of arrays of robotic actuators necessitate dense actuator arrays to effectively manipulate small objects. This paper presents a system com
Technical Approach: This paper presents a system composed of modular 3-DoF robotic tiles interconnected by a compliant surface layer, forming a continuous, controllable manipulation surface.
技術方法: 本文提出的方法:This paper presents a system composed of modular 3-DoF robotic tiles interconnected by a compliant surface layer, forming a continuous, controllable manipulation surface.
Key Takeaway: The approach is validated experimentally using a minimal 2 X 2 prototype, demonstrating the successful manipulation of objects with varied shapes and sizes.
核心發現: 核心結果:The approach is validated experimentally using a minimal 2 X 2 prototype, demonstrating the successful manipulation of objects with varied shapes and sizes.
Anticipate, Adapt, Act: A Hybrid Framework for Task Planning
Authors: Nabanita Dash, Ayush Kaura, Shivam Singh et al. | Submitted: 2026-02-23 | arXiv: 2602.19518
Categories: cs.RO
Research Background: Anticipating and adapting to failures is a key capability robots need to collaborate effectively with humans in complex domains. This continues to be a challenge despite the impressive performance of state of the art AI planning systems and Large Language Models (LLMs) because of the uncertainty associated with the tasks and their outcomes.
研究背景: 在機器人學習領域,Anticipating and adapting to failures is a key capability robots need to collaborate effectively with humans in complex domains. This continues to be a challenge despite the impres
Technical Approach: Toward addressing this challenge, we present a hybrid framework that integrates the generic prediction capabilities of an LLM with the probabilistic sequential decision-making capability of Relational Dynamic Influence Diagram Language.
技術方法: 本文提出的方法:Toward addressing this challenge, we present a hybrid framework that integrates the generic prediction capabilities of an LLM with the probabilistic sequential decision-making capability of Relational
Key Takeaway: Experimental evaluation in the VirtualHome 3D simulation environment demonstrates substantial improvement in performance compared with state of the art baselines.
核心發現: 核心結果:Experimental evaluation in the VirtualHome 3D simulation environment demonstrates substantial improvement in performance compared with state of the art baselines.
DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces
Authors: Li Zhang, Mingyu Mei, Ailing Wang et al. | Submitted: 2026-02-23 | arXiv: 2602.19565
Categories: cs.CV, cs.AI
Research Background: Articulated object pose estimation is a core task in embodied AI. Existing methods typically regress poses in a continuous space, but often struggle with 1) navigating a large, complex search space and 2) failing to incorporate intrinsic kinematic constraints.
研究背景: 在機器人學習領域,Articulated object pose estimation is a core task in embodied AI. Existing methods typically regress poses in a continuous space, but often struggle with 1) navigating a large, com
Technical Approach: In this work, we introduce DICArt (DIsCrete Diffusion for Articulation Pose Estimation), a novel framework that formulates pose estimation as a conditional discrete diffusion process. To improve modeling fidelity, we propose a flexible flow decider that dynamically determines whether each token should be denoised or reset, effectively balancing the real and noise distributions during diffusion.
技術方法: 本文提出的方法:In this work, we introduce DICArt (DIsCrete Diffusion for Articulation Pose Estimation), a novel framework that formulates pose estimation as a conditional discrete diffusion process. To improve model
Key Takeaway: Experimental results demonstrate its superior performance and robustness.
核心發現: 核心結果:Experimental results demonstrate its superior performance and robustness.
Event-Driven On-Sensor Locomotion Mode Recognition Using a Shank-Mounted IMU with Embedded Machine Learning for Exoskeleton Control
Authors: Mohammadsaleh Razmi, Iman Shojaei | Submitted: 2026-02-24 | arXiv: 2602.21418
Categories: cs.RO
Research Background: This work presents a wearable human activity recognition (HAR) system that performs real-time inference directly inside a shank-mounted inertial measurement unit (IMU) to support low-latency control of a lower-limb exoskeleton. Unlike conventional approaches that continuously stream raw inertial data to a microcontroller for classification, the proposed system executes activity recognition at the sensor level using the embedded Machine Learning Core (MLC) of the STMicroelectronics LSM6DSV16X IMU, allowing the host microcontroller to remain in a low-power state and read only the recognized activity label from IMU registers.
研究背景: 在機器人學習領域,This work presents a wearable human activity recognition (HAR) system that performs real-time inference directly inside a shank-mounted inertial measurement unit (IMU) to support l
Technical Approach: While the system generalizes to multiple human activities, this paper focuses on three representative locomotion modes - stance, level walking, and stair ascent - using data collected from adult participants.
技術方法: 本文提出的方法:While the system generalizes to multiple human activities, this paper focuses on three representative locomotion modes - stance, level walking, and stair ascent - using data collected from adult parti
Key Takeaway: This interrupt-driven, on-sensor inference architecture reduces computation and communication overhead while preserving battery energy and improving robustness in distinguishing level walking from stair ascent for torque-assist control.
核心發現: 核心結果:This interrupt-driven, on-sensor inference architecture reduces computation and communication overhead while preserving battery energy and improving robustness in distinguishing level walking from sta
Autonomous Sea Turtle Robot for Marine Fieldwork
Authors: Zach J. Patterson, Emily Sologuren, Levi Cai et al. | Submitted: 2026-02-24 | arXiv: 2602.21389
Categories: cs.RO
Research Background: Autonomous robots can transform how we observe marine ecosystems, but close-range operation in reefs and other cluttered habitats remains difficult. Vehicles must maneuver safely near animals and fragile structures while coping with currents, variable illumination and limited sensing.
研究背景: 在機器人學習領域,Autonomous robots can transform how we observe marine ecosystems, but close-range operation in reefs and other cluttered habitats remains difficult. Vehicles must maneuver safely n
Technical Approach: Here we present a sea turtle-inspired autonomous underwater robot that closed the gap between bioinspired locomotion and field-ready autonomy through a tightly integrated, vision-driven control stack.
技術方法: 本文提出的方法:Here we present a sea turtle-inspired autonomous underwater robot that closed the gap between bioinspired locomotion and field-ready autonomy through a tightly integrated, vision-driven control stack.
Key Takeaway: Together, these results establish a practical route toward soft-rigid hybrid, bioinspired underwater robots capable of minimally disruptive exploration and close-range monitoring in sensitive ecosystems.
核心發現: 核心結果:Together, these results establish a practical route toward soft-rigid hybrid, bioinspired underwater robots capable of minimally disruptive exploration and close-range monitoring in sensitive ecosyste
CableRobotGraphSim: A Graph Neural Network for Modeling Partially Observable Cable-Driven Robot Dynamics
Authors: Nelson Chen, William R. Johnson, Rebecca Kramer-Bottiglio et al. | Submitted: 2026-02-24 | arXiv: 2602.21331
Categories: cs.RO
Research Background: General-purpose simulators have accelerated the development of robots. Traditional simulators based on first-principles, however, typically require full-state observability or depend on parameter search for system identification.
研究背景: 在機器人學習領域,General-purpose simulators have accelerated the development of robots. Traditional simulators based on first-principles, however, typically require full-state observability or depe
Technical Approach: Traditional simulators based on first-principles, however, typically require full-state observability or depend on parameter search for system identification. This work presents \texttt{CableRobotGraphSim}, a novel Graph Neural Network (GNN) model for cable-driven robots that aims to address shortcomings of prior simulation solutions. By representing cable-driven robots as graphs, with the rigid-bodies as nodes and the cables and contacts as edges, this model can quickly and accurately match the properties of other simulation models and real robots, while ingesting only partially observable inputs.
技術方法: 本文提出的方法:Traditional simulators based on first-principles, however, typically require full-state observability or depend on parameter search for system identification. This work presents \texttt{CableRobotGrap
Key Takeaway: This model is further integrated with a Model Predictive Path Integral (MPPI) controller for closed-loop navigation, which showcases the model’s speed and accuracy.
核心發現: 核心結果:This model is further integrated with a Model Predictive Path Integral (MPPI) controller for closed-loop navigation, which showcases the model’s speed and accuracy.
Learning Dynamic Rope Manipulation Using Task-Level Iterative Learning Control
Authors: Krishna Suresh, Chris Atkeson | Submitted: 2026-02-24 | arXiv: 2602.21302
Categories: cs.RO
Research Background: We introduce a Task-Level Iterative Learning Control method for dynamic manipulation of ropes. We demonstrate this method on a non-planar rope manipulation task called the flying knot.
研究背景: 在機器人學習領域,We introduce a Task-Level Iterative Learning Control method for dynamic manipulation of ropes. We demonstrate this method on a non-planar rope manipulation task called the flying k
Technical Approach: We introduce a Task-Level Iterative Learning Control method for dynamic manipulation of ropes.
技術方法: 本文提出的方法:We introduce a Task-Level Iterative Learning Control method for dynamic manipulation of ropes.
Key Takeaway: Learning achieves a 100% success rate within 10 trials on all ropes.
核心發現: 核心結果:Learning achieves a 100% success rate within 10 trials on all ropes.
Surface-based Manipulation Using Tunable Compliant Porous-Elastic Soft Sensing
Authors: Gayatri Indukumar, Muhammad Awais, Diana Cafiso et al. | Submitted: 2026-02-24 | arXiv: 2602.21028
Categories: cs.RO
Research Background: There is a growing need for soft robotic platforms that perform gentle, precise handling of a wide variety of objects. Existing surface-based manipulation systems, however, lack the compliance and tactile feedback needed for delicate handling.
研究背景: 在機器人學習領域,There is a growing need for soft robotic platforms that perform gentle, precise handling of a wide variety of objects. Existing surface-based manipulation systems, however, lack th
Technical Approach: Existing surface-based manipulation systems, however, lack the compliance and tactile feedback needed for delicate handling. This work introduces the COmpliant Porous-Elastic Soft Sensing (COPESS) integrated with inductive sensors for adaptive object manipulation and localised sensing. The design features a tunable lattice layer that simultaneously modulates mechanical compliance and sensing performance.
技術方法: 本文提出的方法:Existing surface-based manipulation systems, however, lack the compliance and tactile feedback needed for delicate handling. This work introduces the COmpliant Porous-Elastic Soft Sensing (COPESS) int
Key Takeaway: Experiments demonstrate that by easily adjusting one parameter, the lattice density, from 7 % to 20 %, it is possible to significantly alter the sensitivity and operational force range (about -23x and 9x, respectively).
核心發現: 核心結果:Experiments demonstrate that by easily adjusting one parameter, the lattice density, from 7 % to 20 %, it is possible to significantly alter the sensitivity and operational force range (about -23x and
SODA-CitrON: Static Object Data Association by Clustering Multi-Modal Sensor Detections Online
Authors: Jan Nausner, Kilian Wohlleben, Michael Hubner | Submitted: 2026-02-24 | arXiv: 2602.22243
Categories: cs.RO
Research Background: The online fusion and tracking of static objects from heterogeneous sensor detections is a fundamental problem in robotics, autonomous systems, and environmental mapping. Although classical data association approaches such as JPDA are well suited for dynamic targets, they are less effective for static objects observed intermittently and with heterogeneous uncertainties, where motion models provide minimal discriminative power with respect to clutter.
研究背景: 在機器人學習領域,The online fusion and tracking of static objects from heterogeneous sensor detections is a fundamental problem in robotics, autonomous systems, and environmental mapping. Although
Technical Approach: In this paper, we propose a novel method for static object data association by clustering multi-modal sensor detections online (SODA-CitrON), while simultaneously estimating positions and maintaining persistent tracks for an unknown number of objects.
技術方法: 本文提出的方法:In this paper, we propose a novel method for static object data association by clustering multi-modal sensor detections online (SODA-CitrON), while simultaneously estimating positions and maintaining
Key Takeaway: The results demonstrate that SODA-CitrON consistently outperforms the compared methods in terms of F1 score, position RMSE, MOTP, and MOTA in the static object mapping scenarios studied.
核心發現: 核心結果:The results demonstrate that SODA-CitrON consistently outperforms the compared methods in terms of F1 score, position RMSE, MOTP, and MOTA in the static object mapping scenarios studied.
Acoustic Feedback for Closed-Loop Force Control in Robotic Grinding
Authors: Zongyuan Zhang, Christopher Lehnert, Will N. Browne et al. | Submitted: 2026-02-24 | arXiv: 2602.20596
Categories: cs.RO
Research Background: Acoustic feedback is a critical indicator for assessing the contact condition between the tool and the workpiece when humans perform grinding tasks with rotary tools. In contrast, robotic grinding systems typically rely on force sensing, with acoustic information largely ignored.
研究背景: 在機器人學習領域,Acoustic feedback is a critical indicator for assessing the contact condition between the tool and the workpiece when humans perform grinding tasks with rotary tools. In contrast,
Technical Approach: This paper introduces a low-cost Acoustic Feedback Robotic Grinding System (AFRG) that captures audio signals with a contact microphone, estimates grinding force from the audio in real time, and enables closed-loop force control of the grinding process.
技術方法: 本文提出的方法:This paper introduces a low-cost Acoustic Feedback Robotic Grinding System (AFRG) that captures audio signals with a contact microphone, estimates grinding force from the audio in real time, and enabl
Key Takeaway: Compared with conventional force-sensing approaches, AFRG achieves a 4-fold improvement in consistency across different grinding disc conditions.
核心發現: 核心結果:Compared with conventional force-sensing approaches, AFRG achieves a 4-fold improvement in consistency across different grinding disc conditions.
Interaction-aware Representation Modeling with Co-occurrence Consistency for Egocentric Hand-Object Parsing
Authors: Yuejiao Su, Yi Wang, Lei Yao et al. | Submitted: 2026-02-24 | arXiv: 2602.20597
Categories: cs.CV
Research Background: A fine-grained understanding of egocentric human-environment interactions is crucial for developing next-generation embodied agents. One fundamental challenge in this area involves accurately parsing hands and active objects.
研究背景: 在機器人學習領域,A fine-grained understanding of egocentric human-environment interactions is crucial for developing next-generation embodied agents. One fundamental challenge in this area involves
Technical Approach: To address these issues, we propose an end-to-end Interaction-aware Transformer (InterFormer), which integrates three key components, i.e., a Dynamic Query Generator (DQG), a Dual-context Feature Selector (DFS), and the Conditional Co-occurrence (CoCo) loss.
技術方法: 本文提出的方法:To address these issues, we propose an end-to-end Interaction-aware Transformer (InterFormer), which integrates three key components, i.e., a Dynamic Query Generator (DQG), a Dual-context Feature Sele
Key Takeaway: Our model achieves state-of-the-art performance on both the EgoHOS and the challenging out-of-distribution mini-HOI4D datasets, demonstrating its effectiveness and strong generalization ability.
核心發現: 核心結果:Our model achieves state-of-the-art performance on both the EgoHOS and the challenging out-of-distribution mini-HOI4D datasets, demonstrating its effectiveness and strong generalization ability.
An interactive enhanced driving dataset for autonomous driving
Authors: Haojie Feng, Peizhi Zhang, Mengjie Tian et al. | Submitted: 2026-02-24 | arXiv: 2602.20575
Categories: cs.CV
Research Background: The evolution of autonomous driving towards full automation demands robust interactive capabilities; however, the development of Vision-Language-Action (VLA) models is constrained by the sparsity of interactive scenarios and inadequate multimodal alignment in existing data. To this end, this paper proposes the Interactive Enhanced Driving Dataset (IEDD).
研究背景: 在機器人學習領域,The evolution of autonomous driving towards full automation demands robust interactive capabilities; however, the development of Vision-Language-Action (VLA) models is constrained
Technical Approach: To this end, this paper proposes the Interactive Enhanced Driving Dataset (IEDD). We develop a scalable pipeline to mine million-level interactive segments from naturalistic driving data based on interactive trajectories, and design metrics to quantify the interaction processes.
技術方法: 本文提出的方法:To this end, this paper proposes the Interactive Enhanced Driving Dataset (IEDD). We develop a scalable pipeline to mine million-level interactive segments from naturalistic driving data based on inte
Key Takeaway: Benchmark results evaluating ten mainstream Vision Language Models (VLMs) are provided to demonstrate the dataset’s reuse value in assessing and fine-tuning the reasoning capabilities of autonomous driving models.
核心發現: 核心結果:Benchmark results evaluating ten mainstream Vision Language Models (VLMs) are provided to demonstrate the dataset’s reuse value in assessing and fine-tuning the reasoning capabilities of autonomous dr
Hierarchical Trajectory Planning of Floating-Base Multi-Link Robot for Maneuvering in Confined Environments
Authors: Yicheng Chen, Jinjie Li, Haokun Liu et al. | Submitted: 2026-02-25 | arXiv: 2602.22459
Categories: cs.RO, eess.SY
Research Background: Floating-base multi-link robots can change their shape during flight, making them well-suited for applications in confined environments such as autonomous inspection and search and rescue. However, trajectory planning for such systems remains an open challenge because the problem lies in a high-dimensional, constraint-rich space where collision avoidance must be addressed together with kinematic limits and dynamic feasibility.
研究背景: 在機器人學習領域,Floating-base multi-link robots can change their shape during flight, making them well-suited for applications in confined environments such as autonomous inspection and search and
Technical Approach: Second, we design a local trajectory planner that optimizes each segment in parallel with differentiable objectives and constraints, systematically enforcing kinematic feasibility and maintaining dynamic feasibility by avoiding control singularities.
技術方法: 本文提出的方法:Second, we design a local trajectory planner that optimizes each segment in parallel with differentiable objectives and constraints, systematically enforcing kinematic feasibility and maintaining dyna
Key Takeaway: To the best of our knowledge, this is the first planning framework for floating-base multi-link robots that has been demonstrated on a real robot to generate continuous, collision-free, and dynamically feasible trajectories directly from raw point-cloud inputs, without relying on handcrafted obstacle models.
核心發現: 核心結果:To the best of our knowledge, this is the first planning framework for floating-base multi-link robots that has been demonstrated on a real robot to generate continuous, collision-free, and dynamicall
Force Policy: Learning Hybrid Force-Position Control Policy under Interaction Frame for Contact-Rich Manipulation
Authors: Hongjie Fang, Shirun Tang, Mingyu Mei et al. | Submitted: 2026-02-25 | arXiv: 2602.22088
Categories: cs.RO
Research Background: Contact-rich manipulation demands human-like integration of perception and force feedback: vision should guide task progress, while high-frequency interaction control must stabilize contact under uncertainty. Existing learning-based policies often entangle these roles in a monolithic network, trading off global generalization against stable local refinement, while control-centric approaches typically assume a known task structure or learn only controller parameters rather than the structure itself.
研究背景: 在機器人學習領域,Contact-rich manipulation demands human-like integration of perception and force feedback: vision should guide task progress, while high-frequency interaction control must stabiliz
Technical Approach: In this paper, we formalize a physically grounded interaction frame, an instantaneous local basis that decouples force regulation from motion execution, and propose a method to recover it from demonstrations.
技術方法: 本文提出的方法:In this paper, we formalize a physically grounded interaction frame, an instantaneous local basis that decouples force regulation from motion execution, and propose a method to recover it from demonst
Key Takeaway: Real-world experiments across diverse contact-rich tasks show consistent gains over strong baselines, with more robust contact establishment, more accurate force regulation, and reliable generalization to novel objects with varied geometries and physical properties, ultimately improving both contact stability and execution quality.
核心發現: 核心結果:Real-world experiments across diverse contact-rich tasks show consistent gains over strong baselines, with more robust contact establishment, more accurate force regulation, and reliable generalizatio
SPOC: Safety-Aware Planning Under Partial Observability And Physical Constraints
Authors: Hyungmin Kim, Hobeom Jeon, Dohyung Kim et al. | Submitted: 2026-02-25 | arXiv: 2602.21595
Categories: cs.RO
Research Background: Embodied Task Planning with large language models faces safety challenges in real-world environments, where partial observability and physical constraints must be respected. Existing benchmarks often overlook these critical factors, limiting their ability to evaluate both feasibility and safety.
研究背景: 在機器人學習領域,Embodied Task Planning with large language models faces safety challenges in real-world environments, where partial observability and physical constraints must be respected. Existi
Technical Approach: We introduce SPOC, a benchmark for safety-aware embodied task planning, which integrates strict partial observability, physical constraints, step-by-step planning, and goal-condition-based evaluation.
技術方法: 本文提出的方法:We introduce SPOC, a benchmark for safety-aware embodied task planning, which integrates strict partial observability, physical constraints, step-by-step planning, and goal-condition-based evaluation.
Key Takeaway: Experiments with state-of-the-art LLMs reveal that current models struggle to ensure safety-aware planning, particularly under implicit constraints.
核心發現: 核心結果:Experiments with state-of-the-art LLMs reveal that current models struggle to ensure safety-aware planning, particularly under implicit constraints.
Vector Fields for Path Following on Lie Groups with Application in Robot Control
Authors: Felipe Bartelt, Luciano C. A. Pimenta, Weijia Yao et al. | Submitted: 2026-02-25 | arXiv: 2602.21450
Categories: cs.RO, eess.SY
Research Background: Many robotic systems allow independent control of position and orientation (pose), including omnidirectional aerial vehicles, underwater robots, and manipulator end-effectors. In many applications, these systems must follow a continuous sequence of poses, leading to either trajectory-tracking or path following formulations.
研究背景: 在機器人學習領域,Many robotic systems allow independent control of position and orientation (pose), including omnidirectional aerial vehicles, underwater robots, and manipulator end-effectors. In m
Technical Approach: In this paper, we develop a general vector-field framework for path following on connected matrix Lie groups, of which SE(3) is a prominent special case.
技術方法: 本文提出的方法:In this paper, we develop a general vector-field framework for path following on connected matrix Lie groups, of which SE(3) is a prominent special case.
Key Takeaway: Experiments with a robotic manipulator tracking complex pose paths demonstrate the effectiveness of the approach.
核心發現: 核心結果:Experiments with a robotic manipulator tracking complex pose paths demonstrate the effectiveness of the approach.
Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Prediction
Authors: Changqing Zhou, Yueru Luo, Changhao Chen | Submitted: 2026-02-25 | arXiv: 2602.21552
Categories: cs.CV
Research Background: Accurate 3D scene understanding is essential for embodied intelligence, with occupancy prediction emerging as a key task for reasoning about both objects and free space. Existing approaches largely rely on depth priors (e.g., DepthAnything) but make only limited use of 3D cues, restricting performance and generalization.
研究背景: 在機器人學習領域,Accurate 3D scene understanding is essential for embodied intelligence, with occupancy prediction emerging as a key task for reasoning about both objects and free space. Existing a
Technical Approach: We present GPOcc, a framework that leverages generalizable visual geometry priors (GPs) for monocular occupancy prediction. Our method extends surface points inward along camera rays to generate volumetric samples, which are represented as Gaussian primitives for probabilistic occupancy inference.
技術方法: 本文提出的方法:We present GPOcc, a framework that leverages generalizable visual geometry priors (GPs) for monocular occupancy prediction. Our method extends surface points inward along camera rays to generate volum
Key Takeaway: These results highlight that GPOcc leverages geometry priors more effectively and efficiently.
核心發現: 核心結果:These results highlight that GPOcc leverages geometry priors more effectively and efficiently.
V-MORALS: Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space
Authors: Faiz Aladin, Ashwin Balasubramanian, Lars Lindemann et al. | Submitted: 2026-02-26 | arXiv: 2602.23524
Categories: cs.RO, cs.CV, cs.LG
Research Background: Reachability analysis has become increasingly important in robotics to distinguish safe from unsafe states. Unfortunately, existing reachability and safety analysis methods often fall short, as they typically require known system dynamics or large datasets to estimate accurate system models, are computationally expensive, and assume full state information.
研究背景: 在機器人學習領域,Reachability analysis has become increasingly important in robotics to distinguish safe from unsafe states. Unfortunately, existing reachability and safety analysis methods often f
Technical Approach: This paper presents Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space (V-MORALS). Using this learned latent space, our method is able to generate well-defined Morse Graphs, from which we can compute ROAs for various systems and controllers.
技術方法: 本文提出的方法:This paper presents Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space (V-MORALS). Using this learned latent space, our method is able to generate well-defined Mors
Key Takeaway: Our project website is at: https://v-morals.onrender.com.
核心發現: 核心結果:Our project website is at: https://v-morals.onrender.com.
Refining Almost-Safe Value Functions on the Fly
Authors: Sander Tonkens, Sosuke Kojima, Chenhao Liu et al. | Submitted: 2026-02-26 | arXiv: 2602.23478
Categories: cs.RO, eess.SY
Research Background: Control Barrier Functions (CBFs) are a powerful tool for ensuring robotic safety, but designing or learning valid CBFs for complex systems is a significant challenge. While Hamilton-Jacobi Reachability provides a formal method for synthesizing safe value functions, it scales poorly and is typically performed offline, limiting its applicability in dynamic environments.
研究背景: 在機器人學習領域,Control Barrier Functions (CBFs) are a powerful tool for ensuring robotic safety, but designing or learning valid CBFs for complex systems is a significant challenge. While Hamilto
Technical Approach: This paper bridges the gap between offline synthesis and online adaptation. We introduce refineCBF for refining an approximate CBF - whether analytically derived, learned, or even unsafe - via warm-started HJ reachability. Our experiments validate our framework’s primary contribution: in-the-loop, real-time adaptation, in simulation (with detailed value function analysis) and on physical hardware.
技術方法: 本文提出的方法:This paper bridges the gap between offline synthesis and online adaptation. We introduce refineCBF for refining an approximate CBF - whether analytically derived, learned, or even unsafe - via warm-st
Key Takeaway: Our experiments on ground vehicles and quadcopters show that our framework can successfully adapt to sudden environmental changes, such as new obstacles and unmodeled wind disturbances, providing a practical path toward deploying formally guaranteed safety in real-world settings.
核心發現: 核心結果:Our experiments on ground vehicles and quadcopters show that our framework can successfully adapt to sudden environmental changes, such as new obstacles and unmodeled wind disturbances, providing a pr
Printed helicoids with embedded air channels make sensorized segments for soft continuum robots
Authors: Annan Zhang, Hanna Matusik, Miguel Flores-Acton et al. | Submitted: 2026-02-26 | arXiv: 2602.23457
Categories: cs.RO
Research Background: Soft robots enable safe, adaptive interaction with complex environments but remain difficult to sense and control due to their highly deformable structures. Architected soft materials such as helicoid lattices offer tunable stiffness and strength but are challenging to instrument because of their sparse geometry.
研究背景: 在機器人學習領域,Soft robots enable safe, adaptive interaction with complex environments but remain difficult to sense and control due to their highly deformable structures. Architected soft materi
Technical Approach: We introduce a fabrication method for embedding air channels into helicoid-based soft continuum robots.
技術方法: 本文提出的方法:We introduce a fabrication method for embedding air channels into helicoid-based soft continuum robots.
Key Takeaway: To demonstrate the platform’s scalability, we construct and mechanically evaluate a meter-scale, 14-DoF cable-driven soft arm capable of open-loop trajectory tracking and object grasping, with tactile-based stiffness detection demonstrated using the gripper sensors.
核心發現: 核心結果:To demonstrate the platform’s scalability, we construct and mechanically evaluate a meter-scale, 14-DoF cable-driven soft arm capable of open-loop trajectory tracking and object grasping, with tactile
Marinarium: a New Arena to Bring Maritime Robotics Closer to Shore
Authors: Ignacio Torroba, David Dorner, Victor Nan Fernandez-Ayala et al. | Submitted: 2026-02-26 | arXiv: 2602.23053
Categories: cs.RO
Research Background: This paper presents the Marinarium, a modular and stand-alone underwater research facility designed to provide a realistic testbed for maritime and space-analog robotic experimentation in a resource-efficient manner. The Marinarium combines a fully instrumented underwater and aerial operational volume, extendable via a retractable roof for real-weather conditions, a digital twin in the SMaRCSim simulator and tight integration with a space robotics laboratory.
研究背景: 在機器人學習領域,This paper presents the Marinarium, a modular and stand-alone underwater research facility designed to provide a realistic testbed for maritime and space-analog robotic experimenta
Technical Approach: This paper presents the Marinarium, a modular and stand-alone underwater research facility designed to provide a realistic testbed for maritime and space-analog robotic experimentation in a resource-efficient manner.
技術方法: 本文提出的方法:This paper presents the Marinarium, a modular and stand-alone underwater research facility designed to provide a realistic testbed for maritime and space-analog robotic experimentation in a resource-e
Key Takeaway: Finally, we demonstrate the potential of underwater surrogates for spacecraft navigation validation by executing spatiotemporally identical inspection tasks on a planar space-robot emulator and a neutrally buoyant \gls{rov}.
核心發現: 核心結果:Finally, we demonstrate the potential of underwater surrogates for spacecraft navigation validation by executing spatiotemporally identical inspection tasks on a planar space-robot emulator and a neut
Automated Robotic Needle Puncture for Percutaneous Dilatational Tracheostomy
Authors: Yuan Tang, Bruno V. Adorno, Brendan A. McGrath et al. | Submitted: 2026-02-26 | arXiv: 2602.22952
Categories: cs.RO
Research Background: Percutaneous dilatational tracheostomy (PDT) is frequently performed on patients in intensive care units for prolonged mechanical ventilation. The needle puncture, as the most critical step of PDT, could lead to adverse consequences such as major bleeding and posterior tracheal wall perforation if performed inaccurately.
研究背景: 在機器人學習領域,Percutaneous dilatational tracheostomy (PDT) is frequently performed on patients in intensive care units for prolonged mechanical ventilation. The needle puncture, as the most crit
Technical Approach: To improve the accuracy and reduce the difficulty of the PDT procedure, we propose a system that automates the needle insertion using a velocity-controlled robotic manipulator.
技術方法: 本文提出的方法:To improve the accuracy and reduce the difficulty of the PDT procedure, we propose a system that automates the needle insertion using a velocity-controlled robotic manipulator.
Key Takeaway: Simulations were performed to validate the controller’s implementation, and then four hundred PDT punctures were performed on a mannequin to evaluate the position and angular accuracy.
核心發現: 核心結果:Simulations were performed to validate the controller’s implementation, and then four hundred PDT punctures were performed on a mannequin to evaluate the position and angular accuracy.
Performance and Experimental Analysis of Strain-based Models for Continuum Robots
Authors: Annika Delucchi, Vincenzo Di Paola, Andreas Müller et al. | Submitted: 2026-02-26 | arXiv: 2602.22854
Categories: cs.RO
Research Background: Although strain-based models have been widely adopted in robotics, no comparison beyond the uniform bending test is commonly recognized to assess their performance. In addition, the increasing effort in prototyping continuum robots highlights the need to assess the applicability of these models and the necessity of comprehensive performance evaluation.
研究背景: 在機器人學習領域,Although strain-based models have been widely adopted in robotics, no comparison beyond the uniform bending test is commonly recognized to assess their performance. In addition, th
Technical Approach: In addition, the increasing effort in prototyping continuum robots highlights the need to assess the applicability of these models and the necessity of comprehensive performance evaluation. To address this gap, this work investigates the shape reconstruction abilities of a third-order strain interpolation method, examining its ability to capture both individual and combined deformation effects. These results are compared and discussed against the Geometric-Variable Strain approach.
技術方法: 本文提出的方法:In addition, the increasing effort in prototyping continuum robots highlights the need to assess the applicability of these models and the necessity of comprehensive performance evaluation. To address
Key Takeaway: The experiments demonstrate good agreement between the model predictions and observed shapes, with average error of 0.58% of the rod length and average computational time of 0.32s per configuration, outperforming existing models.
核心發現: 核心結果:The experiments demonstrate good agreement between the model predictions and observed shapes, with average error of 0.58% of the rod length and average computational time of 0.32s per configuration, o
EgoMoD: Predicting Global Maps of Dynamics from Local Egocentric Observations
Authors: Iacopo Catalano, David Morilla-Cabello, Jorge Pena-Queralta et al. | Submitted: 2026-02-26 | arXiv: 2603.00167
Categories: cs.RO
Research Background: Efficient navigation in dynamic environments requires anticipating how motion patterns evolve beyond the robot’s immediate perceptual range, enabling preemptive rather than purely reactive planning in crowded scenes. Maps of Dynamics (MoDs) offer a structured representation of motion tendencies in space useful for long-term global planning, but constructing them traditionally requires global environment observations over extended periods of time.
研究背景: 在機器人學習領域,Efficient navigation in dynamic environments requires anticipating how motion patterns evolve beyond the robot’s immediate perceptual range, enabling preemptive rather than purely
Technical Approach: We introduce EgoMoD, the first approach that learns to predict future MoDs directly from short egocentric video clips collected during robot operation. Our method learns to infer environment-wide motion tendencies from local dynamic cues using a video- and pose-conditioned architecture trained with MoDs computed from external observations as privileged supervision, allowing local observations to serve as predictive signals of global motion structure.
技術方法: 本文提出的方法:We introduce EgoMoD, the first approach that learns to predict future MoDs directly from short egocentric video clips collected during robot operation. Our method learns to infer environment-wide moti
Key Takeaway: Experiments in large simulated environments show that EgoMoD accurately predicts future MoDs under limited observability, while evaluation with real images showcases its zero-shot transferability to real systems.
核心發現: 核心結果:Experiments in large simulated environments show that EgoMoD accurately predicts future MoDs under limited observability, while evaluation with real images showcases its zero-shot transferability to r
Monocular Open Vocabulary Occupancy Prediction for Indoor Scenes
Authors: Changqing Zhou, Yueru Luo, Han Zhang et al. | Submitted: 2026-02-26 | arXiv: 2602.22667
Categories: cs.CV
Research Background: Open-vocabulary 3D occupancy is vital for embodied agents, which need to understand complex indoor environments where semantic categories are abundant and evolve beyond fixed taxonomies. While recent work has explored open-vocabulary occupancy in outdoor driving scenarios, such methods transfer poorly indoors, where geometry is denser, layouts are more intricate, and semantics are far more fine-grained.
研究背景: 在機器人學習領域,Open-vocabulary 3D occupancy is vital for embodied agents, which need to understand complex indoor environments where semantic categories are abundant and evolve beyond fixed taxon
Technical Approach: Our framework builds upon 3D Language-Embedded Gaussians, which serve as a unified intermediate representation coupling fine-grained 3D geometry with a language-aligned semantic embedding. On the geometry side, we find that existing Gaussian-to-Occupancy operators fail to converge under such weak supervision, and we introduce an opacity-aware, Poisson-based approach that stabilizes volumetric aggregation. On Occ-ScanNet, our framework achieves 59.50 IoU and 21.05 mIoU in the open-vocabulary setting, surpassing all existing occupancy methods in IoU and outperforming prior open-vocabulary approaches by a large margin in mIoU.
技術方法: 本文提出的方法:Our framework builds upon 3D Language-Embedded Gaussians, which serve as a unified intermediate representation coupling fine-grained 3D geometry with a language-aligned semantic embedding. On the geom
Key Takeaway: On Occ-ScanNet, our framework achieves 59.50 IoU and 21.05 mIoU in the open-vocabulary setting, surpassing all existing occupancy methods in IoU and outperforming prior open-vocabulary approaches by a large margin in mIoU.
核心發現: 核心結果:On Occ-ScanNet, our framework achieves 59.50 IoU and 21.05 mIoU in the open-vocabulary setting, surpassing all existing occupancy methods in IoU and outperforming prior open-vocabulary approaches by a
Acoustic Sensing for Universal Jamming Grippers
Authors: Lion Weber, Theodor Wienert, Martin Splettstößer et al. | Submitted: 2026-02-27 | arXiv: 2603.00351
Categories: cs.RO, cs.AI, cs.LG, cs.SD
Research Background: Universal jamming grippers excel at grasping unknown objects due to their compliant bodies. Traditional tactile sensors can compromise this compliance, reducing grasping performance.
研究背景: 在機器人學習領域,Universal jamming grippers excel at grasping unknown objects due to their compliant bodies. Traditional tactile sensors can compromise this compliance, reducing grasping performanc
Technical Approach: We present acoustic sensing as a form of morphological sensing, where the gripper’s soft body itself becomes the sensor.
技術方法: 本文提出的方法:We present acoustic sensing as a form of morphological sensing, where the gripper’s soft body itself becomes the sensor.
Key Takeaway: Finally, we demonstrate that disentangled acoustic representations can be learned, improving robustness to irrelevant acoustic variations.
核心發現: 核心結果:Finally, we demonstrate that disentangled acoustic representations can be learned, improving robustness to irrelevant acoustic variations.
Modeling PWM-Time-SOC Interaction in a Simulated Robot
Authors: Vidyut Pradeep, Shirantha Welikala | Submitted: 2026-02-27 | arXiv: 2603.00319
Categories: cs.RO, eess.SY
Research Background: Accurate prediction of battery state of charge is needed for autonomous robots to plan movements without using up all available power. This work develops a physics and data-informed model from a simulation that predicts SOC depletion as a function of time and PWM duty cycle for a simulated 4-wheel Arduino robot.
研究背景: 在機器人學習領域,Accurate prediction of battery state of charge is needed for autonomous robots to plan movements without using up all available power. This work develops a physics and data-informe
Technical Approach: This work develops a physics and data-informed model from a simulation that predicts SOC depletion as a function of time and PWM duty cycle for a simulated 4-wheel Arduino robot. A forward-motion simulation incorporating motor electrical characteristics (resistance, inductance, back-EMF, torque constant) and mechanical dynamics (mass, drag, rolling resistance, wheel radius) was used to generate SOC time-series data across PWM values from 1-100%. Sparse Identification of Nonlinear Dynamics (SINDy), combined with least-squares regression, was applied to construct a unified nonlinear model that captures SOC(t, p).
技術方法: 本文提出的方法:This work develops a physics and data-informed model from a simulation that predicts SOC depletion as a function of time and PWM duty cycle for a simulated 4-wheel Arduino robot. A forward-motion simu
Key Takeaway: The framework allows for energy-aware planning for similar robots and can be extended to incorporate arbitrary initial SOC levels and environment-dependent parameters for real-world deployment.
核心發現: 核心結果:The framework allows for energy-aware planning for similar robots and can be extended to incorporate arbitrary initial SOC levels and environment-dependent parameters for real-world deployment.
Evaluating Accuracy of Vine Robot Shape Sensing with Distributed Inertial Measurement Units
Authors: Alexis E. Laudenslager, Antonio Alvarez Valdivia, Nathaniel Hanson et al. | Submitted: 2026-02-27 | arXiv: 2602.24202
Categories: cs.RO
Research Background: Soft, tip-extending vine robots are well suited for navigating tight, debris-filled environments, making them ideal for urban search and rescue. Sensing the full shape of a vine robot’s body is helpful both for localizing information from other sensors placed along the robot body and for determining the robot’s configuration within the space being explored.
研究背景: 在機器人學習領域,Soft, tip-extending vine robots are well suited for navigating tight, debris-filled environments, making them ideal for urban search and rescue. Sensing the full shape of a vine ro
Technical Approach: Sensing the full shape of a vine robot’s body is helpful both for localizing information from other sensors placed along the robot body and for determining the robot’s configuration within the space being explored. Prior approaches have localized vine robot tips using a single inertial measurement unit (IMU) combined with force sensing or length estimation, while one method demonstrated full-body shape sensing using distributed IMUs on a passively steered robot in controlled maze environments. However, the accuracy of distributed IMU-based shape sensing under active steering, varying robot lengths, and different sensor spacings has not been systematically quantified.
技術方法: 本文提出的方法:Sensing the full shape of a vine robot’s body is helpful both for localizing information from other sensors placed along the robot body and for determining the robot’s configuration within the space b
Key Takeaway: These results demonstrate the feasibility of distributed IMU-based shape sensing for vine robots while highlighting key limitations and opportunities for improved modeling and algorithmic integration for field deployment.
核心發現: 核心結果:These results demonstrate the feasibility of distributed IMU-based shape sensing for vine robots while highlighting key limitations and opportunities for improved modeling and algorithmic integration
How IMU Drift Influences Multi-Radar Inertial Odometry for Ground Robots in Subterranean Terrains
Authors: Moumita Mukherjee, Magnus Norén, Anton Koval et al. | Submitted: 2026-02-27 | arXiv: 2602.24192
Categories: cs.RO
Research Background: Reliable radar inertial odometry (RIO) requires mitigating IMU bias drift, a challenge that intensifies in subterranean environments due to extreme temperatures and gravity-induced accelerations. Cost-effective IMUs such as the Pixhawk, when paired with FMCW TI IWR6843AOP EVM radars, suffer from drift-induced degradation compounded by sparse, noisy, and flickering radar returns, making fusion less stable than LiDAR-based odometry.
研究背景: 在機器人學習領域,Reliable radar inertial odometry (RIO) requires mitigating IMU bias drift, a challenge that intensifies in subterranean environments due to extreme temperatures and gravity-induced
Technical Approach: To address these challenges, we propose a two-stage MRIO framework that combines an IMU bias estimator for resilient localization and mapping in GPS-denied subterranean environments affected by smoke.
技術方法: 本文提出的方法:To address these challenges, we propose a two-stage MRIO framework that combines an IMU bias estimator for resilient localization and mapping in GPS-denied subterranean environments affected by smoke.
Key Takeaway: In subterranean field trials, MRIO delivers robust localization and mapping, outperforming EKF-RIO.
核心發現: 核心結果:In subterranean field trials, MRIO delivers robust localization and mapping, outperforming EKF-RIO.
Robust Skills, Brittle Grounding: Diagnosing Restricted Generalization in Vision-Language Action Policies via Multi-Object Picking
Authors: David Emukpere, Romain Deffayet, Jean-Michel Renders | Submitted: 2026-02-27 | arXiv: 2602.24143
Categories: cs.RO
Research Background: Vision-language action (VLA) policies often report strong manipulation benchmark performance with relatively few demonstrations, but it remains unclear whether this reflects robust language-to-object grounding or reliance on object—location correlations that do not transfer beyond the training distribution. We present a controlled multi-object picking study that progressively increases object placement variability up to full workspace randomization and evaluates held-out object—location pairings that break familiar associations without increasing spatial difficulty.
研究背景: 在機器人學習領域,Vision-language action (VLA) policies often report strong manipulation benchmark performance with relatively few demonstrations, but it remains unclear whether this reflects robust
Technical Approach: We present a controlled multi-object picking study that progressively increases object placement variability up to full workspace randomization and evaluates held-out object—location pairings that break familiar associations without increasing spatial difficulty.
技術方法: 本文提出的方法:We present a controlled multi-object picking study that progressively increases object placement variability up to full workspace randomization and evaluates held-out object—location pairings that br
Key Takeaway: Across these stress tests and data scaling, we find that for representative VLA policies, including SmolVLA and , execution of the manipulation primitive remains substantially more reliable than instruction-conditioned task success in harder regimes, suggesting that manipulation skill acquisition is decoupled from instruction following.
核心發現: 核心結果:Across these stress tests and data scaling, we find that for representative VLA policies, including SmolVLA and , execution of the manipulation primitive remains substantially more reliable t
Geometry-based pneumatic actuators for soft robotics
Authors: Rui Chen, Daniele Leonardis, Domenico Chiaradia et al. | Submitted: 2026-02-27 | arXiv: 2602.24104
Categories: cs.RO
Research Background: Soft pneumatic actuators enable safe human-machine interaction with lightweight and powerful applied parts. On the other side, they suffer design limitations as regards complex actuation patterns, including minimum bending radii, multi-states capabilities and structural stability.
研究背景: 在機器人學習領域,Soft pneumatic actuators enable safe human-machine interaction with lightweight and powerful applied parts. On the other side, they suffer design limitations as regards complex act
Technical Approach: We present geometry-based pneumatic actuators (GPAs), a design and implementation approach that introduces constraint layers with configurable CNC heat-sealed chambers.
技術方法: 本文提出的方法:We present geometry-based pneumatic actuators (GPAs), a design and implementation approach that introduces constraint layers with configurable CNC heat-sealed chambers.
Key Takeaway: We demonstrate versatility of the GPAs approach through three applications: a 49 g wrist exoskeleton reducing muscle activity by up to 51%, a 30.8 g haptic interface delivering 8 N force feedback with fast response, and a 208 g bipedal robot achieving multi-gait locomotion.
核心發現: 核心結果:We demonstrate versatility of the GPAs approach through three applications: a 49 g wrist exoskeleton reducing muscle activity by up to 51%, a 30.8 g haptic interface delivering 8 N force feedback with
Physics-Embedded Neural ODEs for Learning Antagonistic Pneumatic Artificial Muscle Dynamics
Authors: Xinyao Wang, Jonathan Realmuto | Submitted: 2026-02-27 | arXiv: 2602.23670
Categories: cs.RO, eess.SY
Research Background: Pneumatic artificial muscles (PAMs) enable compliant actuation for soft wearable, assistive, and interactive robots. When arranged antagonistically, PAMs can provide variable impedance through co-contraction but exhibit coupled, nonlinear, and hysteretic dynamics that challenge modeling and control.
研究背景: 在機器人學習領域,Pneumatic artificial muscles (PAMs) enable compliant actuation for soft wearable, assistive, and interactive robots. When arranged antagonistically, PAMs can provide variable imped
Technical Approach: This paper presents a hybrid neural ordinary differential equation (Neural ODE) framework that embeds physical structure into a learned model of antagonistic PAM dynamics.
技術方法: 本文提出的方法:This paper presents a hybrid neural ordinary differential equation (Neural ODE) framework that embeds physical structure into a learned model of antagonistic PAM dynamics.
Key Takeaway: Experimental validation demonstrates reliable stiffness control across 126-176 N/mm and consistent impedance behavior across operating velocities, in contrast to a static model, which shows degraded stiffness consistency at higher velocities.
核心發現: 核心結果:Experimental validation demonstrates reliable stiffness control across 126-176 N/mm and consistent impedance behavior across operating velocities, in contrast to a static model, which shows degraded s
SpikingTac: A Miniaturized Neuromorphic Visuotactile Sensor for High-Precision Dynamic Tactile Imprint Tracking
Authors: Tianyu Jiang, Chaofan Zhang, Shaolin Zhang et al. | Submitted: 2026-02-27 | arXiv: 2602.23654
Categories: cs.RO
Research Background: High-speed event-driven tactile sensors are essential for achieving human-like dynamic manipulation, yet their integration is often limited by the bulkiness of standard event cameras. This paper presents SpikingTac, a miniaturized, highly integrated neuromorphic tactile sensor featuring a custom standalone event camera module, achieved with a total material cost of less than $150.
研究背景: 在機器人學習領域,High-speed event-driven tactile sensors are essential for achieving human-like dynamic manipulation, yet their integration is often limited by the bulkiness of standard event camer
Technical Approach: This paper presents SpikingTac, a miniaturized, highly integrated neuromorphic tactile sensor featuring a custom standalone event camera module, achieved with a total material cost of less than $150. Addressing the viscoelastic hysteresis of silicone elastomers, we propose a hysteresis-aware incremental update law with a spatial gain damping mechanism.
技術方法: 本文提出的方法:This paper presents SpikingTac, a miniaturized, highly integrated neuromorphic tactile sensor featuring a custom standalone event camera module, achieved with a total material cost of less than $150.
Key Takeaway: Furthermore, the sensor achieves sub-millimeter geometric accuracy, with Root Mean Square Error (RMSE) of 0.0952mm in localization and 0.0452mm in radius measurement.
核心發現: 核心結果:Furthermore, the sensor achieves sub-millimeter geometric accuracy, with Root Mean Square Error (RMSE) of 0.0952mm in localization and 0.0452mm in radius measurement.
MicroPush: A Simulator and Benchmark for Contact-Rich Cell Pushing and Assembly with a Magnetic Rolling Microrobot
Authors: Yanda Yang, Sambeeta Das | Submitted: 2026-02-27 | arXiv: 2602.23607
Categories: cs.RO, eess.SY
Research Background: Magnetic rolling microrobots enable gentle manipulation in confined microfluidic environments, yet autonomy for contact-rich behaviors such as cell pushing and multi-target assembly remains difficult to develop and evaluate reproducibly. We present MicroPush, an open-source simulator and benchmark suite for magnetic rolling microrobots in cluttered 2D scenes.
研究背景: 在機器人學習領域,Magnetic rolling microrobots enable gentle manipulation in confined microfluidic environments, yet autonomy for contact-rich behaviors such as cell pushing and multi-target assembl
Technical Approach: We present MicroPush, an open-source simulator and benchmark suite for magnetic rolling microrobots in cluttered 2D scenes.
技術方法: 本文提出的方法:We present MicroPush, an open-source simulator and benchmark suite for magnetic rolling microrobots in cluttered 2D scenes.
Key Takeaway: Results show that controller stability dominates performance under flow disturbances, while planner choice can influence command smoothness over long-horizon sequences via waypoint progression.
核心發現: 核心結果:Results show that controller stability dominates performance under flow disturbances, while planner choice can influence command smoothness over long-horizon sequences via waypoint progression.
KEEP: A KV-Cache-Centric Memory Management System for Efficient Embodied Planning
Authors: Zebin Yang, Tong Xie, Baotong Lu et al. | Submitted: 2026-02-27 | arXiv: 2602.23592
Categories: cs.RO, cs.AI, cs.SE
Research Background: Memory-augmented Large Language Models (LLMs) have demonstrated remarkable capability for complex and long-horizon embodied planning. By keeping track of past experiences and environmental states, memory enables LLMs to maintain a global view, thereby avoiding repetitive exploration.
研究背景: 在機器人學習領域,Memory-augmented Large Language Models (LLMs) have demonstrated remarkable capability for complex and long-horizon embodied planning. By keeping track of past experiences and envir
Technical Approach: In this paper, we propose KEEP, a KV-cache-centric memory management system for efficient embodied planning.
技術方法: 本文提出的方法:In this paper, we propose KEEP, a KV-cache-centric memory management system for efficient embodied planning.
Key Takeaway: Compared with the KV re-computation method CacheBlend (EuroSys’25), KEEP shows 4.13% success rate improvement and 1.90x time-to-first-token (TTFT) reduction.
核心發現: 核心結果:Compared with the KV re-computation method CacheBlend (EuroSys’25), KEEP shows 4.13% success rate improvement and 1.90x time-to-first-token (TTFT) reduction.
U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generation
Authors: Xiang Deng, Feng Gao, Yong Zhang et al. | Submitted: 2026-02-27 | arXiv: 2602.23739
Categories: cs.CV
Research Background: Full-stack multimodal interaction in real-time is a central goal in building intelligent embodied agents capable of natural, dynamic communication. However, existing systems are either limited to unimodal generation or suffer from degraded reasoning and poor cross-modal alignment, preventing coherent and perceptually grounded interactions.
研究背景: 在機器人學習領域,Full-stack multimodal interaction in real-time is a central goal in building intelligent embodied agents capable of natural, dynamic communication. However, existing systems are ei
Technical Approach: In this work, we introduce U-Mind, the first unified system for high-intelligence multimodal dialogue that supports real-time generation and jointly models language, speech, motion, and video synthesis within a single interactive loop.
技術方法: 本文提出的方法:In this work, we introduce U-Mind, the first unified system for high-intelligence multimodal dialogue that supports real-time generation and jointly models language, speech, motion, and video synthesi
Key Takeaway: Extensive experiments demonstrate that U-Mind achieves state-of-the-art performance on a range of multimodal interaction tasks, including question answering, instruction following, and motion generation, paving the way toward intelligent, immersive conversational agents.
核心發現: 核心結果:Extensive experiments demonstrate that U-Mind achieves state-of-the-art performance on a range of multimodal interaction tasks, including question answering, instruction following, and motion generati
Online Generation of Collision-Free Trajectories in Dynamic Environments
Authors: Nermin Covic, Bakir Lacevic | Submitted: 2026-02-28 | arXiv: 2603.00759
Categories: cs.RO
Research Background: In this paper, we present an online method for converting an arbitrary geometric path represented by a sequence of states, generated by any planner (e.g., sampling-based planners like RRT or PRM, search-based planners like ARA*, etc.), into a corresponding kinematically feasible, jerk-limited trajectory. The method generates a sequence of quintic/quartic splines that can be discretized at a user-specified control rate, and then streamed to a low-level robot controller.
研究背景: 在機器人學習領域,In this paper, we present an online method for converting an arbitrary geometric path represented by a sequence of states, generated by any planner (e.g., sampling-based planners l
Technical Approach: In this paper, we present an online method for converting an arbitrary geometric path represented by a sequence of states, generated by any planner (e.g., sampling-based planners like RRT or PRM, search-based planners like ARA*, etc.), into a corresponding kinematically feasible, jerk-limited trajectory. Our approach enables real-time adaptation to newly captured changes in the environment.
技術方法: 本文提出的方法:In this paper, we present an online method for converting an arbitrary geometric path represented by a sequence of states, generated by any planner (e.g., sampling-based planners like RRT or PRM, sear
Key Takeaway: Experiments on a real robot demonstrate that the proposed approach can be used in real-world scenarios including human presence.
核心發現: 核心結果:Experiments on a real robot demonstrate that the proposed approach can be used in real-world scenarios including human presence.
I-Perceive: A Foundation Model for Active Perception with Language Instructions
Authors: Yongxi Huang, Zhuohang Wang, Wenjing Tang et al. | Submitted: 2026-02-28 | arXiv: 2603.00600
Categories: cs.RO
Research Background: Active perception, the ability of a robot to proactively adjust its viewpoint to acquire task-relevant information, is essential for robust operation in unstructured real-world environments. While critical for downstream tasks such as manipulation, existing approaches have largely been confined to local settings (e.g., table-top scenes) with fixed perception objectives (e.g., occlusion reduction).
研究背景: 在機器人學習領域,Active perception, the ability of a robot to proactively adjust its viewpoint to acquire task-relevant information, is essential for robust operation in unstructured real-world env
Technical Approach: To bridge this gap, we propose I-Perceive, a foundation model for active perception conditioned on natural language instructions, designed for mobile manipulators and indoor environments.
技術方法: 本文提出的方法:To bridge this gap, we propose I-Perceive, a foundation model for active perception conditioned on natural language instructions, designed for mobile manipulators and indoor environments.
Key Takeaway: Experiments demonstrate that I-Perceive significantly outperforms state-of-the-art VLMs in both prediction accuracy and instruction following of generated camera views, and exhibits strong zero-shot generalization to novel scenes and tasks.
核心發現: 核心結果:Experiments demonstrate that I-Perceive significantly outperforms state-of-the-art VLMs in both prediction accuracy and instruction following of generated camera views, and exhibits strong zero-shot g
Planning Method for Skill-Based Control of Robots Using a PLC as Skill Trigger
Authors: Andreas Gaugenrieder, Hari Hara Balasubramaniam, Jannik Möhrle et al. | Submitted: 2026-02-28 | arXiv: 2603.00555
Categories: cs.RO
Research Background: Skill-based programming of robots provides a flexible approach for automation. Existing solutions neglect the optimization of motion sequences, leading to inefficiencies in execution.
研究背景: 在機器人學習領域,Skill-based programming of robots provides a flexible approach for automation. Existing solutions neglect the optimization of motion sequences, leading to inefficiencies in executi
Technical Approach: Existing solutions neglect the optimization of motion sequences, leading to inefficiencies in execution. This work introduces a planning method that enhances skill-based robot programming by integrating motion sequence optimization. This optimization leads to a new MoveContinuousSkill.
技術方法: 本文提出的方法:Existing solutions neglect the optimization of motion sequences, leading to inefficiencies in execution. This work introduces a planning method that enhances skill-based robot programming by integrati
Key Takeaway: Experimental results demonstrate a significant improvement in execution time through optimized motion sequence.
核心發現: 核心結果:Experimental results demonstrate a significant improvement in execution time through optimized motion sequence.
Test-Driven Agentic Framework for Reliable Robot Controller
Authors: Shivanshu Tripathi, Reza Akbarian Bafghi, Maziar Raissi | Submitted: 2026-02-28 | arXiv: 2603.00455
Categories: cs.RO, eess.SY
Research Background: In this work, we present a test-driven, agentic framework for synthesizing a deployable low-level robot controller for navigation tasks. Given a 2D map with an image of an ultrasonic sensor-based robot, or a 3D robotic simulation environment, our framework iteratively refines the generated controller code using diagnostic feedback from structured test suites to achieve task success.
研究背景: 在機器人學習領域,In this work, we present a test-driven, agentic framework for synthesizing a deployable low-level robot controller for navigation tasks. Given a 2D map with an image of an ultrason
Technical Approach: In this work, we present a test-driven, agentic framework for synthesizing a deployable low-level robot controller for navigation tasks. Given a 2D map with an image of an ultrasonic sensor-based robot, or a 3D robotic simulation environment, our framework iteratively refines the generated controller code using diagnostic feedback from structured test suites to achieve task success. We propose a dual-tier repair strategy to refine the generated code that alternates between prompt-level refinement and direct code editing.
技術方法: 本文提出的方法:In this work, we present a test-driven, agentic framework for synthesizing a deployable low-level robot controller for navigation tasks. Given a 2D map with an image of an ultrasonic sensor-based robo
Key Takeaway: Experimental results show that test-driven synthesis substantially improves controller reliability and robustness over one-shot controller generation, especially when the initial prompt is underspecified.
核心發現: 核心結果:Experimental results show that test-driven synthesis substantially improves controller reliability and robustness over one-shot controller generation, especially when the initial prompt is underspecif
RAG-RUSS: A Retrieval-Augmented Robotic Ultrasound for Autonomous Carotid Examination
Authors: Dianye Huang, Ziping Cong, Nassir Navab et al. | Submitted: 2026-03-01 | arXiv: 2603.01153
Categories: cs.RO
Research Background: Robotic ultrasound (US) has recently attracted increasing attention as a means to overcome the limitations of conventional US examinations, such as the strong operator dependence. However, the decision-making process of existing methods is often either rule-based or relies on end-to-end learning models that operate as black boxes.
研究背景: 在機器人學習領域,Robotic ultrasound (US) has recently attracted increasing attention as a means to overcome the limitations of conventional US examinations, such as the strong operator dependence.
Technical Approach: To tackle this challenge, we introduce the RAG-RUSS, an interpretable framework capable of performing a full carotid examination in accordance with the clinical workflow while explicitly explaining both the current stage and the next planned action.
技術方法: 本文提出的方法:To tackle this challenge, we introduce the RAG-RUSS, an interpretable framework capable of performing a full carotid examination in accordance with the clinical workflow while explicitly explaining bo
Key Takeaway: The results demonstrate that the method can explain the current scanning stage and autonomously plan probe motions to complete the carotid examination, encompassing both transverse and longitudinal planes.
核心發現: 核心結果:The results demonstrate that the method can explain the current scanning stage and autonomously plan probe motions to complete the carotid examination, encompassing both transverse and longitudinal pl
From Dialogue to Execution: Mixture-of-Agents Assisted Interactive Planning for Behavior Tree-Based Long-Horizon Robot Execution
Authors: Kanata Suzuki, Kazuki Hori, Haruka Miyoshi et al. | Submitted: 2026-03-01 | arXiv: 2603.01113
Categories: cs.RO
Research Background: Interactive task planning with large language models (LLMs) enables robots to generate high-level action plans from natural language instructions. However, in long-horizon tasks, such approaches often require many questions, increasing user burden.
研究背景: 在機器人學習領域,Interactive task planning with large language models (LLMs) enables robots to generate high-level action plans from natural language instructions. However, in long-horizon tasks, s
Technical Approach: We propose a framework that integrates Mixture-of-Agents (MoA)-based proxy answering into interactive planning and generates Behavior Trees (BTs) for structured long-term execution.
技術方法: 本文提出的方法:We propose a framework that integrates Mixture-of-Agents (MoA)-based proxy answering into interactive planning and generates Behavior Trees (BTs) for structured long-term execution.
Key Takeaway: These results indicate that MoA-assisted interactive planning improves dialogue efficiency while preserving execution quality in real-world robotic tasks.
核心發現: 核心結果:These results indicate that MoA-assisted interactive planning improves dialogue efficiency while preserving execution quality in real-world robotic tasks.
ArtLLM: Generating Articulated Assets via 3D LLM
Authors: Penghao Wang, Siyuan Xie, Hongyu Yan et al. | Submitted: 2026-03-01 | arXiv: 2603.01142
Categories: cs.CV
Research Background: Creating interactive digital environments for gaming, robotics, and simulation relies on articulated 3D objects whose functionality emerges from their part geometry and kinematic structure. However, existing approaches remain fundamentally limited: optimization-based reconstruction methods require slow, per-object joint fitting and typically handle only simple, single-joint objects, while retrieval-based methods assemble parts from a fixed library, leading to repetitive geometry and poor generalization.
研究背景: 在機器人學習領域,Creating interactive digital environments for gaming, robotics, and simulation relies on articulated 3D objects whose functionality emerges from their part geometry and kinematic s
Technical Approach: To address these challenges, we introduce ArtLLM, a novel framework for generating high-quality articulated assets directly from complete 3D meshes.
技術方法: 本文提出的方法:To address these challenges, we introduce ArtLLM, a novel framework for generating high-quality articulated assets directly from complete 3D meshes.
Key Takeaway: Finally, we demonstrate its utility in constructing digital twins, highlighting its potential for scalable robot learning.
核心發現: 核心結果:Finally, we demonstrate its utility in constructing digital twins, highlighting its potential for scalable robot learning.
Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures
Authors: Yuechen Luo, Qimao Chen, Fang Li et al. | Submitted: 2026-03-01 | arXiv: 2603.01063
Categories: cs.CV
Research Background: Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration capabilities constrained by previous Supervised Fine-Tuning (SFT), leading to persistent failures in long-tail scenarios.
研究背景: 在機器人學習領域,Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration
Technical Approach: To address this limitation, we propose VLA with Explicit Learning from Failures (ELF-VLA), a framework that augments RL with structured diagnostic feedback. Instead of relying on a vague scalar reward, our method produces detailed, interpretable reports that identify the specific failure mode. By injecting these corrected, high-reward samples back into the RL training batch, our approach provides a targeted gradient, which enables the policy to solve critical scenarios that unguided exploration cannot.
技術方法: 本文提出的方法:To address this limitation, we propose VLA with Explicit Learning from Failures (ELF-VLA), a framework that augments RL with structured diagnostic feedback. Instead of relying on a vague scalar reward
Key Takeaway: Extensive experiments demonstrate that our method unlocks the latent capabilities of VLA models, achieving state-of-the-art (SOTA) performance on the public NAVSIM benchmark for overall PDMS, EPDMS score and high-level planning accuracy.
核心發現: 核心結果:Extensive experiments demonstrate that our method unlocks the latent capabilities of VLA models, achieving state-of-the-art (SOTA) performance on the public NAVSIM benchmark for overall PDMS, EPDMS sc