arXiv Weekly Digest — Week 41, 2026

Fetched: 2026-10-05 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 20


AdaStep: Adaptive Step Credit Weighting for Agentic Reinforcement Learning

Authors: Xin Wang, Wenhao Wu, Menghao Zhang et al. | Submitted: 2026-10-02 | arXiv: 2610.03223
Categories: cs.LG, cs.CL

Research Background: Long-horizon LLM agents are typically trained with sparse outcome rewards, making step-level credit assignment unreliable because observed returns depend on subsequent actions and trajectory length.

Technical Approach: AdaStep formulates step-level credit as an MSE estimation problem for latent step advantage, deriving a per-state shrinkage coefficient (signal-to-total-variance ratio) that controls how strongly local advantages modify the trajectory-level signal.

Key Takeaway: Adaptive shrinkage-based step credit weighting improves multi-step LLM agent training without requiring explicit process reward models.


Safe Streaming Flow Planning by Aligning Sampling Dynamics with Execution Dynamics

Authors: Seunghwan Jang, Jeongyong Yang, Siddharth Ancha et al. | Submitted: 2026-10-02 | arXiv: 2610.03132
Categories: cs.RO, cs.LG

Research Background: Diffusion/flow-matching generative planners struggle with real-world robot deployment because enforcing safety constraints via perturbation introduces distribution shift and is too slow for online replanning.

Technical Approach: SafeStreamingFlow aligns flow sampling dynamics with robot execution dynamics using a goal-conditioned state vector field with hierarchical replanning, integrating safety constraints directly into the generation process.

Key Takeaway: Aligning generative planner dynamics with execution dynamics enables real-time safe trajectory generation without distribution shift.


How to Find and Reuse Policies for Continuous Adaptation in Lifelong Reinforcement Learning

Authors: Saptarshi Nath, Inish M. D’Souza, Antonio Carta et al. | Submitted: 2026-10-02 | arXiv: 2610.03119
Categories: cs.LG, cs.AI, cs.RO

Research Background: Lifelong robot learning requires transferring knowledge from prior tasks, but identifying which past policies remain relevant as experience grows is an open problem.

Technical Approach: AMSC estimates task similarity via non-parametric Wasserstein embeddings from state-action-reward samples, then applies sparsemax normalization to compose a variable-size prior from the most similar past policies when learning a new task.

Key Takeaway: Wasserstein-based task similarity enables effective policy composition in continual robot learning without manual task specification.


Learning Transferable Policies from Action-free Time Series Through Dynamical Embeddings

Authors: Niklas Emonds, Georgia Koppe | Submitted: 2026-10-02 | arXiv: 2610.03065
Categories: cs.LG

Research Background: Learning robot control from action-free recordings is challenging because intervention effects are unobserved, limiting cross-system policy transfer in imitation learning.

Technical Approach: A hierarchical MBRL framework learns shared dynamical structure across related systems via low-dimensional embeddings, which parameterize shared policy networks trained entirely in simulation under an additive latent perturbation intervention model.

Key Takeaway: Shared dynamical embeddings enable cross-system control policy transfer without requiring action labels in source recordings.


Permutation Robustness Is Not Enough: Action Collapse in Multi-Agent Transformer Policies

Authors: Amit Thakur, Mukesh Singhal | Submitted: 2026-10-02 | arXiv: 2610.02848
Categories: cs.RO, cs.LG, cs.MA

Research Background: Multi-agent robot transformer policies face a fundamental mismatch: agents form unordered sets, but transformers process ordered token sequences, creating order-sensitivity and potential policy degeneracy.

Technical Approach: The paper introduces action-collapse diagnostics (action diversity, same-action fraction, maximum action frequency) alongside permutation-consistency metrics, auditing PPO and equivariance-regularized baselines on cooperative navigation tasks.

Key Takeaway: Low permutation error can mask degenerate policies where all agents output identical actions; action diversity metrics are essential for multi-agent evaluation.


FastOPD: On-Policy Distillation for Lightweight VLA Deployment

Authors: Yoojin Oh, Jeongsol Kim, Yeonwoo Seo et al. | Submitted: 2026-10-02 | arXiv: 2610.02832
Categories: cs.RO, cs.AI, cs.CV, cs.LG

Research Background: VLA foundation models have achieved strong manipulation performance through scale, but their computational cost makes real-time robot deployment impractical for resource-constrained hardware.

Technical Approach: FastOPD adapts a flow map for single-step teacher supervision and combines it with a self-consistency objective, training a compact student that matches large VLA teacher dynamics without iterative denoising at inference.

Key Takeaway: On-policy flow-map distillation enables single-step lightweight VLA inference while preserving generalizability from the large teacher model.


VIGOR: Zero-Shot Visual Generalization via Latent-Space Consistency in Model-Based Reinforcement Learning

Authors: Mingyu Park, Samyeul Noh, Hyun Myung et al. | Submitted: 2026-10-02 | arXiv: 2610.02801
Categories: cs.AI, cs.LG, cs.RO

Research Background: Model-based RL is highly sample-efficient but severely degrades under visual distractions (background, lighting, camera shifts) because errors compound through recursive latent rollouts during planning.

Technical Approach: VIGOR enforces latent-space consistency by jointly training the encoder and world model with distraction-augmented contrastive objectives, anchoring representations to distraction-invariant features throughout the rollout horizon.

Key Takeaway: Latent-space consistency regularization enables zero-shot visual generalization in MBRL without sacrificing sample efficiency.


Localized Conformal Safety Monitoring with Vision-Language Models for Autonomous Driving

Authors: Luís Marques, Rong Fang, Disha Kamale et al. | Submitted: 2026-10-02 | arXiv: 2610.02765
Categories: cs.RO, cs.LG

Research Background: Autonomous driving requires calibrated collision likelihood estimates for safety monitoring, but VLMs produce approximate predictions unsuitable for safety-critical decisions.

Technical Approach: Split Label-Localized Conformal Prediction (SLLCP) post-hoc calibrates frozen VLM predictions into probabilistically valid safety certificates using local label coverage, without retraining the VLM.

Key Takeaway: Conformal prediction layers over VLMs provide statistically rigorous, calibrated safety monitoring for autonomous driving trajectories.


Mind the Refinement Gap: When Safe High-Level Robot Plans Produce Unsafe Executions

Authors: Stabak Das, Priyesh Ranjan, Xiangfang Li et al. | Submitted: 2026-10-02 | arXiv: 2610.02662
Categories: cs.LG, cs.RO

Research Background: Language-guided robot systems combine semantic planning with LTL safety monitors, but it is unclear whether high-level safety verdicts transfer to low-level executions that include navigation and implicit action effects.

Technical Approach: The authors audit the trace-completeness assumption in RoboGuard, comparing LTL verdicts on surface plans vs. graph-refined traces across 28 controlled cases and 14 end-to-end cases with natural-language instructions.

Key Takeaway: High-level LTL safety guarantees systematically fail to transfer to execution-level traces, exposing a critical verification gap in language-guided robot safety systems.


Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker

Authors: David Nadrchal, Monorama Swain, Florian Schmid et al. | Submitted: 2026-10-02 | arXiv: 2610.03017
Categories: cs.AI, cs.CL, cs.HC

Research Background: Dysarthric speech is effectively unintelligible to standard ASR systems, severely limiting communication access for users with motor speech disorders — a key barrier for HRI and assistive robotics interfaces.

Technical Approach: A multi-stage Whisper fine-tuning pipeline uses standard Czech speech, acoustically simulated tracheostomic speech, and speaker-specific data collected via an “artificial conversation” protocol designed for naturalistic engagement.

Key Takeaway: Simulated-to-real multi-stage ASR adaptation achieves 50% relative CER reduction, enabling reliable speech interfaces for severely dysarthric users.


HexVIO: Towards All-Day Stereo-Inertial Tracking Through Commodity DSPs

Authors: Patrick Wolf, Mateo de Mayo, Daniel Cremers | Submitted: 2026-10-02 | arXiv: 2610.03283
Categories: cs.RO, cs.CV

Research Background: Visual-inertial odometry is essential for robot, drone, and XR device localization, but continuous operation on battery-constrained edge hardware demands much greater power efficiency than current GPU implementations allow.

Technical Approach: HexVIO offloads the visual frontend of stereo-inertial odometry to the Hexagon DSP co-processor on Snapdragon devices, optimizing feature extraction and tracking for DSP architecture while retaining the optimization backend on CPU.

Key Takeaway: DSP-accelerated VIO frontends reduce power consumption significantly while maintaining tracking accuracy, enabling all-day localization on mobile robots and XR devices.


EmbPASS: Towards Cross-Embodiment Open Panoramic Segmentation

Authors: Pujun Guo, Yuanfan Zheng, Fei Teng et al. | Submitted: 2026-10-02 | arXiv: 2610.03248
Categories: cs.CV, cs.RO

Research Background: Panoramic 360° perception is crucial for embodied agents, but heterogeneous platforms (vehicle, drone, wearable, quadruped) have different viewpoints that create systematic cross-embodiment observation shifts.

Technical Approach: EmbPASS establishes a multi-platform panoramic semantic segmentation benchmark spanning four embodiment types under a unified semantic taxonomy, providing systematic evaluation of cross-embodiment adaptation methods.

Key Takeaway: Cross-embodiment observation shifts are a significant unsolved challenge; the EmbPASS benchmark provides a rigorous testbed for adaptation research across robot platforms.


Lightweight and Resource-Efficient Perception for Robotic Guide Dogs

Authors: Jinse Kwon, Yoojin Lim, Choonghan Lee et al. | Submitted: 2026-10-02 | arXiv: 2610.03187
Categories: cs.DC, cs.CV

Research Background: Multi-camera streaming perception on edge platforms must share accelerator resources with co-resident workloads, yet standard isolated benchmarks can mislead deployment decisions for real-time robot perception.

Technical Approach: Two end-to-end pipelines (GPU vs. NPU) are evaluated on a single GPU-NPU platform under realistic contention, using streaming average precision (sAP) metrics that account for deadline misses from resource contention.

Key Takeaway: Realistic contention evaluation can reverse preferred GPU-over-NPU placement, making co-resident workload testing essential for guide dog and mobile robot perception deployment.


CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environments

Authors: Feiyang Chen, Jincheng Hu, Yiduo Chen et al. | Submitted: 2026-10-02 | arXiv: 2610.03031
Categories: cs.CV, cs.RO

Research Background: Monocular semantic scene completion in crowded indoor spaces is underexplored for quadruped robots, where human occlusions disrupt static geometry and cause incomplete occupancy predictions.

Technical Approach: CrowdOcc combines Normal Guided Scene Geometry Fusion (NGSGF) for occlusion-robust depth lifting with Human-Centric Sparse Interaction (HCSI) modules that model human-human and local human-scene 3D relationships.

Key Takeaway: Explicit human-scene decoupling with surface-normal geometry cues achieves state-of-the-art indoor semantic scene completion for quadruped navigation.


OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection

Authors: Runtong Wu, Fei Teng, Di Wen et al. | Submitted: 2026-10-02 | arXiv: 2610.03015
Categories: cs.CV, cs.AI, cs.RO

Research Background: 3D object detection from 360° equirectangular images is critical for mobile robots, but perspective-trained VFMs cannot directly transfer because ERP geometry differs fundamentally from pinhole projection.

Technical Approach: OmniAct3D uses an ERP-Ray Geometry Adapter (ERGA-Ray) that models spherical viewing rays and periodic spatial structure, adapting perspective VFM detectors to equirectangular images while preserving transferable priors.

Key Takeaway: Spherical geometry adaptation of perspective VFMs enables accurate panoramic 3D detection for embodied agents without retraining from scratch.


RYOPO: Bringing End-to-End Category-Level Object Pose Estimation into Real Time

Authors: Hakjin Lee, Junghoon Seo, Jaehoon Sim | Submitted: 2026-10-02 | arXiv: 2610.03013
Categories: cs.CV, cs.RO

Research Background: Category-level 6DoF object pose estimation for robot manipulation typically depends on separate detection and pose estimation stages with per-object processing costs that prevent real-time operation.

Technical Approach: RYOPO is an end-to-end query-based RGB-D predictor that jointly detects, segments, and estimates 9-DoF poses in a single forward pass, sharing image and scene encoding across all objects via query-conditioned geometry pathways.

Key Takeaway: End-to-end query-based joint detection and pose estimation achieves real-time 9-DoF category-level pose estimation without CAD priors or separate pipeline stages.


From Language Priors to Field Adaptation: Preference Learning for Traversability Estimation

Authors: Simon Schwaiger, David Seyser, Alessandro Scherl et al. | Submitted: 2026-10-02 | arXiv: 2610.02974
Categories: cs.RO, cs.CV

Research Background: Traversability estimation for field robots is inherently platform- and domain-specific, requiring expensive retraining or annotation for each new deployment environment.

Technical Approach: The method uses von Mises-Fisher mixture prototypes in a frozen VLM feature space, initializing with natural-language commonsense rules and fine-tuning with sparse relative image annotations for efficient target-domain adaptation.

Key Takeaway: VLM-grounded preference learning enables sample-efficient traversability adaptation to new robot domains with minimal expert annotations.


Found but Not Read: When Extracted Text Closes the Retrieval-Reading Gap in Document VLMs

Authors: Qingtao Xia, Siyao Cheng, Jiahua Bao et al. | Submitted: 2026-10-02 | arXiv: 2610.02880
Categories: cs.CV

Research Background: Retrieval-augmented document QA assumes that once the right page is retrieved, VLMs can extract the answer — but evidence suggests this assumption fails in practice, creating a retrieval-reading gap.

Technical Approach: A paired protocol on FoveDoc-Bench isolates the gap by comparing VLM accuracy with page images alone vs. images augmented with CPU-OCR extracted text, evaluated across six VLM families.

Key Takeaway: Adding extracted text overlays raises strict accuracy by 13–16 points across VLMs, showing that vision-based text reading, not retrieval, is the primary bottleneck in document QA.


PointWAM: 3D World Action Modeling for Dexterous Robotic Manipulation

Authors: Chunghyun Park, Beomjun Kim, Seungcheol Park et al. | Submitted: 2026-10-02 | arXiv: 2610.02840
Categories: cs.RO, cs.CV

Research Background: World action models that jointly learn environment dynamics and robot actions struggle to represent the 3D spatial structure and contact geometry central to dexterous manipulation.

Technical Approach: PointWAM decomposes the world into disentangled scene and hand components, jointly forecasting both as 3D point trajectories in a shared space-time coordinate frame, enabling pre-training on large-scale human demonstration videos.

Key Takeaway: Disentangled 3D point trajectory modeling of hands and scenes enables effective pre-training on human video for transferable dexterous robot manipulation policies.